Aug 29 01:03:39 devstack cinder-volume[75153]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Aug 29 01:03:39 devstack cinder-volume[75153]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 29 01:03:39 devstack cinder-volume[75153]: we strongly recommend against using it for new projects. Aug 29 01:03:39 devstack cinder-volume[75153]: If you are already using Eventlet, we recommend migrating to a different Aug 29 01:03:39 devstack cinder-volume[75153]: framework. For more detail see Aug 29 01:03:39 devstack cinder-volume[75153]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 29 01:03:39 devstack cinder-volume[75153]: import eventlet # noqa Aug 29 01:03:42 devstack cinder-volume[75153]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75153) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 29 01:03:42 devstack cinder-volume[75153]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75153) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 29 01:03:42 devstack cinder-volume[75153]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75153) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 29 01:03:43 devstack cinder-volume[75153]: INFO dbcounter [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] Registered counter for database cinder Aug 29 01:03:43 devstack cinder-volume[75153]: DEBUG oslo_db.sqlalchemy.engines [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75153) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 29 01:03:43 devstack cinder-volume[75153]: DEBUG dbcounter [-] [75153] Writer thread running {{(pid=75153) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 29 01:03:43 devstack cinder-volume[75153]: INFO cinder.rpc [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Aug 29 01:03:43 devstack cinder-volume[75153]: INFO cinder.rpc [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Aug 29 01:03:43 devstack cinder-volume[75153]: DEBUG oslo_db.sqlalchemy.engines [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75153) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 29 01:03:43 devstack cinder-volume[75153]: INFO cinder.volume.manager [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] Determined volume DB was empty at startup. Aug 29 01:03:43 devstack cinder-volume[75153]: DEBUG cinder.volume.manager [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75153) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Aug 29 01:03:43 devstack cinder-volume[75153]: INFO cinder.volume.manager [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] Service not found for updating active_backend_id, assuming default for driver init. Aug 29 01:03:43 devstack cinder-volume[75153]: WARNING stevedore.named [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 29 01:03:43 devstack cinder-volume[75153]: WARNING castellan.key_manager [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 29 01:03:43 devstack cinder-volume[75153]: WARNING cinder.keymgr.conf_key_mgr [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 29 01:03:43 devstack cinder-volume[75153]: DEBUG cinder.volume.drivers.lvm [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75153) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Aug 29 01:03:43 devstack cinder-volume[75153]: DEBUG oslo_concurrency.processutils [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_concurrency.processutils [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] CMD "cinder-rtstool verify" returned: 0 in 0.491s {{(pid=75153) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_db.sqlalchemy.engines [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75153) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 29 01:03:44 devstack cinder-volume[75153]: INFO cinder.rpc [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Aug 29 01:03:44 devstack cinder-volume[75153]: INFO cinder.rpc [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Aug 29 01:03:44 devstack cinder-volume[75153]: WARNING stevedore.named [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 29 01:03:44 devstack cinder-volume[75153]: WARNING castellan.key_manager [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 29 01:03:44 devstack cinder-volume[75153]: INFO cinder.volume.manager [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_db.sqlalchemy.engines [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75153) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 29 01:03:44 devstack cinder-volume[75153]: INFO oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] Starting 1 workers Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] Started child 75335 {{(pid=75153) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] Full set of CONF: {{(pid=75153) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] ******************************************************************************** {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] Configuration options gathered from: {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] ================================================================================ {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] allow_availability_zone_fallback = False {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75335]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] allow_compression_on_image_upload = False {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] allowed_direct_url_schemes = [] {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] api_rate_limit = True {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] auth_strategy = keystone {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] az_cache_duration = 3600 {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] backend_availability_zone = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] backend_host = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] backend_name = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] backend_stats_polling_interval = 60 {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] backup_api_class = cinder.backup.api.API {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] backup_name_template = backup-%s {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] backup_use_same_host = False {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] backup_use_temp_snapshot = False {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] chap_password = **** {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] chap_username = {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] cinder_internal_tenant_project_id = 7a4cf32a58f94d27881d289e35b4f0ad {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] cinder_internal_tenant_user_id = 5c42c7643926494cb72c778ea82fc190 {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] cloned_volume_same_az = True {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] cluster = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] compression_format = gzip {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] compute_api_class = cinder.compute.nova.API {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] config_dir = [] {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] config_source = [] {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] control_exchange = openstack {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] debug = True {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] default_availability_zone = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] default_group_type = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] default_volume_type = lvmdriver-1 {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] disk_geometry = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] driver_client_cert = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] driver_client_cert_key = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] driver_data_namespace = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] driver_ssl_cert_path = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] driver_ssl_cert_verify = False {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] driver_use_ssl = False {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] enable_force_upload = False {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] enable_new_services = True {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] enable_unsupported_driver = False {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] enabled_backends = ['lvmdriver-1'] {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] enforce_multipath_for_image_xfer = False {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] filter_function = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] glance_api_insecure = False {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] glance_api_servers = ['http://192.168.122.202/image'] {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] glance_api_ssl_compression = False {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] glance_ca_certificates_file = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] glance_catalog_info = image:glance:publicURL {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] glance_certfile = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] glance_keyfile = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] glance_num_retries = 3 {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] glance_request_timeout = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] goodness_function = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] graceful_shutdown_timeout = 5 {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] group_api_class = cinder.group.api.API {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] host = devstack {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] image_compress_on_upload = True {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] image_conversion_address_space_limit = 1 {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] image_conversion_cpu_limit = 60 {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] image_conversion_disable = False {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] image_upload_use_cinder_backend = False {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] image_upload_use_internal_tenant = False {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] image_volume_cache_enabled = False {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] image_volume_cache_max_count = 0 {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] image_volume_cache_max_size_gb = 0 {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] init_host_max_objects_retrieval = 0 {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] instance_format = [instance: %(uuid)s] {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] iscsi_target_flags = {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] iscsi_write_cache = on {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] iser_helper = tgtadm {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] iser_ip_address = 192.168.122.202 {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] iser_port = 3260 {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] log_color = False {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] log_config_append = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] log_dir = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] log_file = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] log_options = True {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] log_rotate_interval = 1 {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] log_rotate_interval_type = days {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] log_rotation_type = none {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] max_age = 0 {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] max_logfile_count = 30 {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] max_logfile_size_mb = 200 {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] max_over_subscription_ratio = 20.0 {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] message_reap_interval = 86400 {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] message_ttl = 2592000 {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] migration_create_volume_timeout_secs = 300 {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] monkey_patch = False {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] monkey_patch_modules = [] {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] my_ip = 192.168.122.202 {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] no_snapshot_gb_quota = False {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] num_iser_scan_tries = 3 {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] num_shell_tries = 3 {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] num_volume_device_scan_tries = 3 {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] nvmeof_conn_info_version = 1 {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] nvmet_ns_id = 10 {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] nvmet_port_id = 1 {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] osapi_max_limit = 1000 {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] osapi_volume_ext_list = [] {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] osapi_volume_listen = 0.0.0.0 {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75335]: INFO cinder.volume.manager [None req-17856a6e-d2bf-4efd-8bb8-9244bc869846 None None] Starting volume driver LVMVolumeDriver (3.0.0) Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] osapi_volume_listen_port = 8776 {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75335]: DEBUG oslo_concurrency.processutils [None req-17856a6e-d2bf-4efd-8bb8-9244bc869846 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] osapi_volume_use_ssl = False {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] osapi_volume_workers = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] per_volume_size_limit = -1 {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] periodic_fuzzy_delay = 60 {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] periodic_interval = 60 {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] project_id_regex = [0-9a-f\-]+ {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] public_endpoint = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] publish_errors = False {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] quota_backup_gigabytes = 1000 {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] quota_backups = 10 {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] quota_gigabytes = 1000 {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] quota_groups = 10 {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] quota_snapshots = 10 {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] quota_volumes = 10 {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] rate_limit_burst = 0 {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] rate_limit_except_level = CRITICAL {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] rate_limit_interval = 0 {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] reinit_driver_count = 3 {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] replication_device = **** {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] report_discard_supported = False {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] report_interval = 120 {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] reservation_clean_interval = 86400 {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] reservation_expire = 86400 {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] reserved_image_namespaces = [] {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] reserved_percentage = 0 {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] rpc_response_timeout = 120 {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] run_external_periodic_tasks = True {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75335]: DEBUG oslo_concurrency.processutils [None req-17856a6e-d2bf-4efd-8bb8-9244bc869846 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.027s {{(pid=75335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] scst_target_driver = iscsi {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] scst_target_iqn_name = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] service_down_time = 720 {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] shell_completion = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] snapshot_name_template = snapshot-%s {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75335]: DEBUG oslo_concurrency.processutils [None req-17856a6e-d2bf-4efd-8bb8-9244bc869846 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] snapshot_same_host = True {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] split_loggers = False {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] state_path = /opt/stack/data/cinder {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] storage_availability_zone = nova {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] storage_protocol = iSCSI {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] syslog_log_facility = LOG_USER {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] target_helper = lioadm {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] target_ip_address = 192.168.122.202 {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] target_port = 3260 {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] target_protocol = iscsi {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] target_secondary_ip_addresses = [] {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] trace_flags = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] transfer_api_class = cinder.transfer.api.API {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] transport_url = **** {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] until_refresh = 0 {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] use_chap_auth = False {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] use_default_quota_class = True {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] use_journal = False {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] use_json = False {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] use_multipath_for_image_xfer = False {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] use_stderr = False {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] use_syslog = False {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] verify_glance_signatures = enabled {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] volume_api_class = cinder.volume.api.API {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] volume_backend_name = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] volume_clear = zero {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] volume_clear_ionice = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] volume_clear_size = 0 {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] volume_copy_bps_limit = 0 {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] volume_dd_blocksize = 1M {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] volume_name_template = volume-%s {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] volume_service_inithost_offload = False {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] volume_usage_audit_period = month {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] zoning_mode = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] oslo_concurrency.disable_process_locking = False {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75335]: DEBUG oslo_concurrency.processutils [None req-17856a6e-d2bf-4efd-8bb8-9244bc869846 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.029s {{(pid=75335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:03:44 devstack cinder-volume[75335]: DEBUG oslo_concurrency.processutils [None req-17856a6e-d2bf-4efd-8bb8-9244bc869846 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] keystone_authtoken.auth_section = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] keystone_authtoken.auth_type = password {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] keystone_authtoken.auth_version = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] keystone_authtoken.cache = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] keystone_authtoken.certfile = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] keystone_authtoken.include_service_catalog = True {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] keystone_authtoken.insecure = False {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] keystone_authtoken.interface = public {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] keystone_authtoken.keyfile = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] keystone_authtoken.memcache_password = **** {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] keystone_authtoken.memcache_username = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] keystone_authtoken.region_name = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] keystone_authtoken.service_token_roles_required = True {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] keystone_authtoken.service_type = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.202/identity {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] cache.backend = dogpile.cache.null {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] cache.backend_argument = **** {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] cache.backend_expiration_time = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] cache.config_prefix = cache.oslo {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] cache.debug_cache_backend = False {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] cache.enable_retry_client = False {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] cache.enable_socket_keepalive = False {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] cache.enabled = False {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] cache.expiration_time = 600 {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] cache.hashclient_retry_attempts = 2 {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75335]: DEBUG oslo_concurrency.processutils [None req-17856a6e-d2bf-4efd-8bb8-9244bc869846 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.027s {{(pid=75335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] cache.memcache_dead_retry = 300 {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75335]: DEBUG oslo_concurrency.processutils [None req-17856a6e-d2bf-4efd-8bb8-9244bc869846 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] cache.memcache_pool_maxsize = 10 {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] cache.memcache_sasl_enabled = False {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] cache.password = **** {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] cache.proxies = [] {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] cache.redis_db = 0 {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] cache.redis_server = localhost:6379 {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] cache.retry_attempts = 2 {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] cache.retry_delay = 0.0 {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] cache.socket_keepalive_count = 1 {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] cache.socket_keepalive_idle = 1 {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] cache.socket_keepalive_interval = 1 {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] cache.socket_timeout = 1.0 {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] cache.tls_allowed_ciphers = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] cache.tls_cafile = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] cache.tls_certfile = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] cache.tls_enabled = False {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] cache.tls_keyfile = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] cache.username = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] coordination.backend_url = **** {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] database.asyncio_connection = **** {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] database.asyncio_slave_connection = **** {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] database.backend = sqlalchemy {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] database.connection = **** {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] database.connection_debug = 0 {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] database.connection_parameters = {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] database.connection_recycle_time = 3600 {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] database.connection_trace = False {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] database.db_inc_retry_interval = True {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] database.db_max_retries = 20 {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] database.db_max_retry_interval = 10 {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] database.db_retry_interval = 1 {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] database.max_overflow = 50 {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] database.max_pool_size = 5 {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] database.max_retries = 10 {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] database.mysql_wsrep_sync_wait = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] database.pool_timeout = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] database.retry_interval = 10 {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] database.slave_connection = **** {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] database.sqlite_synchronous = True {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] database.synchronous_reader = True {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] database.use_db_reconnect = False {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] oslo_messaging_tracing.insecure = False {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] profiler.connection_string = messaging:// {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] profiler.enabled = False {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] profiler.es_doc_type = notification {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] profiler.es_scroll_size = 10000 {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] profiler.es_scroll_time = 2m {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] profiler.filter_error_trace = False {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] profiler.hmac_keys = **** {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] profiler.sentinel_service_name = mymaster {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] profiler.socket_timeout = 0.1 {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] profiler.trace_requests = False {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] profiler.trace_sqlalchemy = False {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] profiler_jaeger.process_tags = {} {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] profiler_jaeger.service_name_prefix = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] profiler_otlp.service_name_prefix = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] oslo_policy.enforce_new_defaults = True {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] oslo_policy.policy_default_rule = default {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] oslo_policy.policy_file = policy.yaml {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] oslo_policy.remote_timeout = 60.0 {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] privsep_osbrick.group = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] privsep_osbrick.helper_command = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack sudo[75404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Aug 29 01:03:44 devstack sudo[75404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] privsep_osbrick.user = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] cinder_sys_admin.group = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] cinder_sys_admin.helper_command = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] cinder_sys_admin.user = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] service_user.auth_section = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] service_user.auth_type = password {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] service_user.cafile = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] service_user.certfile = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] service_user.collect_timing = False {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] service_user.insecure = False {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] service_user.keyfile = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] service_user.send_service_user_token = True {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] service_user.split_loggers = False {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] service_user.timeout = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] glance.auth_section = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] glance.auth_type = password {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] glance.certfile = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] glance.collect_timing = False {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] glance.insecure = False {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] glance.keyfile = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] glance.region_name = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] glance.split_loggers = False {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] glance.timeout = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] backend_defaults.backend_availability_zone = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] backend_defaults.chap_password = **** {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] backend_defaults.chap_username = {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] backend_defaults.disk_geometry = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] backend_defaults.driver_client_cert = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] backend_defaults.driver_client_cert_key = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] backend_defaults.driver_data_namespace = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] backend_defaults.driver_use_ssl = False {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] backend_defaults.extra_capabilities = {} {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] backend_defaults.filter_function = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] backend_defaults.goodness_function = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] backend_defaults.iscsi_target_flags = {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] backend_defaults.iscsi_write_cache = on {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] backend_defaults.iser_helper = tgtadm {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] backend_defaults.iser_ip_address = 192.168.122.202 {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] backend_defaults.iser_port = 3260 {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] backend_defaults.lvm_mirrors = 0 {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] backend_defaults.lvm_share_target = False {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] backend_defaults.lvm_type = auto {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] backend_defaults.num_shell_tries = 3 {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] backend_defaults.replication_device = **** {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] backend_defaults.report_discard_supported = False {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] backend_defaults.reserved_percentage = 0 {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] backend_defaults.target_helper = tgtadm {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] backend_defaults.target_ip_address = 192.168.122.202 {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] backend_defaults.target_port = 3260 {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] backend_defaults.target_protocol = iscsi {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] backend_defaults.trace_flags = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] backend_defaults.unique_fqdn_network = True {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] backend_defaults.use_chap_auth = False {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] backend_defaults.volume_backend_name = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] backend_defaults.volume_clear = zero {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] backend_defaults.volume_clear_ionice = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] backend_defaults.volume_clear_size = 0 {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] backend_defaults.volume_group = cinder-volumes {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] oslo_reports.file_event_handler = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] oslo_reports.log_dir = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] lvmdriver-1.backend_host = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] lvmdriver-1.chap_password = **** {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] lvmdriver-1.chap_username = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] lvmdriver-1.chiscsi_conf = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] lvmdriver-1.disk_geometry = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] lvmdriver-1.driver_client_cert = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] lvmdriver-1.driver_use_ssl = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] lvmdriver-1.extra_capabilities = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] lvmdriver-1.filter_function = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] lvmdriver-1.goodness_function = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] lvmdriver-1.iser_helper = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] lvmdriver-1.iser_ip_address = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] lvmdriver-1.iser_port = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] lvmdriver-1.lvm_conf_file = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] lvmdriver-1.lvm_mirrors = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] lvmdriver-1.lvm_share_target = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] lvmdriver-1.lvm_type = auto {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] lvmdriver-1.num_shell_tries = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:44 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:45 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] lvmdriver-1.nvmet_port_id = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:45 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] lvmdriver-1.replication_device = **** {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:45 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] lvmdriver-1.report_discard_supported = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:45 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] lvmdriver-1.reserved_percentage = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:45 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] lvmdriver-1.scst_target_driver = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:45 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:45 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] lvmdriver-1.storage_protocol = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:45 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:45 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] lvmdriver-1.target_helper = lioadm {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:45 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] lvmdriver-1.target_ip_address = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:45 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] lvmdriver-1.target_port = 3260 {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:45 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:45 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] lvmdriver-1.target_protocol = iscsi {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:45 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:45 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] lvmdriver-1.trace_flags = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:45 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:45 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] lvmdriver-1.use_chap_auth = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:45 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:45 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:45 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] lvmdriver-1.volume_clear = zero {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:45 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:45 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] lvmdriver-1.volume_clear_size = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:45 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:45 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:45 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:45 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:45 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:45 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] lvmdriver-1.volumes_dir = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:45 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:45 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:45 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:45 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:45 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:45 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:45 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:45 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:45 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:45 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:45 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:45 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:45 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:45 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:45 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:45 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:45 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:45 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:45 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:45 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:45 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:45 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:45 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:45 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:45 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:45 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:45 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:45 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:45 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:45 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] oslo_messaging_rabbit.ssl = False {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:45 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:45 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:45 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:45 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:45 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:45 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] oslo_messaging_rabbit.ssl_version = {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:45 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:45 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] oslo_messaging_notifications.driver = [] {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:45 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] oslo_messaging_notifications.retry = -1 {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:45 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:45 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:45 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:45 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] key_manager.fixed_key = **** {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:45 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:45 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] barbican.barbican_api_version = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:45 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] barbican.barbican_endpoint = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:45 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] barbican.barbican_endpoint_type = public {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:45 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] barbican.barbican_region_name = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:45 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] barbican.cafile = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:45 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] barbican.certfile = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:45 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] barbican.collect_timing = False {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:45 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] barbican.insecure = False {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:45 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] barbican.keyfile = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:45 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] barbican.number_of_retries = 60 {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:45 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] barbican.retry_delay = 1 {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:45 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] barbican.send_service_user_token = False {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:45 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] barbican.split_loggers = False {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:45 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] barbican.timeout = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:45 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] barbican.verify_ssl = True {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:45 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] barbican.verify_ssl_path = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:45 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] barbican_service_user.auth_section = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:45 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] barbican_service_user.auth_type = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:45 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] barbican_service_user.cafile = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:45 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] barbican_service_user.certfile = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:45 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] barbican_service_user.collect_timing = False {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:45 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] barbican_service_user.insecure = False {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:45 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] barbican_service_user.keyfile = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:45 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] barbican_service_user.split_loggers = False {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:45 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] barbican_service_user.timeout = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:45 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] vault.approle_role_id = **** {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:45 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] vault.approle_secret_id = **** {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:45 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] vault.auth_method = approle {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:45 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] vault.auth_path = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:45 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] vault.kv_mountpoint = secret {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:45 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] vault.kv_path = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:45 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] vault.kv_version = 2 {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:45 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] vault.namespace = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:45 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] vault.root_token_id = **** {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:45 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] vault.ssl_ca_crt_file = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:45 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] vault.timeout = 60.0 {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:45 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] vault.token_file = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:45 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] vault.token_role = None {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:45 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] vault.use_ssl = False {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:45 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:03:45 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] ******************************************************************************** {{(pid=75153) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Aug 29 01:03:45 devstack sudo[75404]: pam_unix(sudo:session): session closed for user root Aug 29 01:03:45 devstack cinder-volume[75335]: DEBUG oslo_concurrency.processutils [None req-17856a6e-d2bf-4efd-8bb8-9244bc869846 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.317s {{(pid=75335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:03:45 devstack cinder-volume[75335]: DEBUG oslo_concurrency.processutils [None req-17856a6e-d2bf-4efd-8bb8-9244bc869846 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:03:45 devstack sudo[75502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 29 01:03:45 devstack sudo[75502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:03:45 devstack sudo[75502]: pam_unix(sudo:session): session closed for user root Aug 29 01:03:45 devstack cinder-volume[75335]: DEBUG oslo_concurrency.processutils [None req-17856a6e-d2bf-4efd-8bb8-9244bc869846 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.285s {{(pid=75335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:03:45 devstack cinder-volume[75335]: DEBUG oslo_concurrency.processutils [None req-17856a6e-d2bf-4efd-8bb8-9244bc869846 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 29 01:03:45 devstack cinder-volume[75335]: INFO cinder.brick.local_dev.lvm [None req-17856a6e-d2bf-4efd-8bb8-9244bc869846 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Aug 29 01:03:45 devstack cinder-volume[75335]: DEBUG oslo_concurrency.processutils [None req-17856a6e-d2bf-4efd-8bb8-9244bc869846 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:03:45 devstack cinder-volume[75335]: DEBUG oslo_concurrency.processutils [None req-17856a6e-d2bf-4efd-8bb8-9244bc869846 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=75335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:03:45 devstack cinder-volume[75335]: DEBUG oslo_concurrency.processutils [None req-17856a6e-d2bf-4efd-8bb8-9244bc869846 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:03:45 devstack sudo[75591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 29 01:03:45 devstack sudo[75591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:03:45 devstack sudo[75591]: pam_unix(sudo:session): session closed for user root Aug 29 01:03:45 devstack cinder-volume[75335]: DEBUG oslo_concurrency.processutils [None req-17856a6e-d2bf-4efd-8bb8-9244bc869846 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=75335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:03:45 devstack cinder-volume[75335]: DEBUG cinder.brick.local_dev.lvm [None req-17856a6e-d2bf-4efd-8bb8-9244bc869846 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75335) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Aug 29 01:03:45 devstack cinder-volume[75335]: DEBUG oslo_concurrency.processutils [None req-17856a6e-d2bf-4efd-8bb8-9244bc869846 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:03:45 devstack sudo[75694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 29 01:03:45 devstack sudo[75694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:03:47 devstack sudo[75694]: pam_unix(sudo:session): session closed for user root Aug 29 01:03:47 devstack cinder-volume[75335]: DEBUG oslo_concurrency.processutils [None req-17856a6e-d2bf-4efd-8bb8-9244bc869846 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.579s {{(pid=75335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:03:47 devstack cinder-volume[75335]: DEBUG oslo_concurrency.processutils [None req-17856a6e-d2bf-4efd-8bb8-9244bc869846 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:03:47 devstack cinder-volume[75335]: DEBUG oslo_concurrency.processutils [None req-17856a6e-d2bf-4efd-8bb8-9244bc869846 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=75335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:03:47 devstack cinder-volume[75335]: DEBUG oslo_concurrency.processutils [None req-17856a6e-d2bf-4efd-8bb8-9244bc869846 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:03:47 devstack sudo[75999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 29 01:03:47 devstack sudo[75999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:03:47 devstack sudo[75999]: pam_unix(sudo:session): session closed for user root Aug 29 01:03:47 devstack cinder-volume[75335]: DEBUG oslo_concurrency.processutils [None req-17856a6e-d2bf-4efd-8bb8-9244bc869846 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.404s {{(pid=75335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:03:47 devstack cinder-volume[75335]: DEBUG oslo_concurrency.processutils [None req-17856a6e-d2bf-4efd-8bb8-9244bc869846 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:03:47 devstack cinder-volume[75335]: DEBUG oslo_concurrency.processutils [None req-17856a6e-d2bf-4efd-8bb8-9244bc869846 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.033s {{(pid=75335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:03:47 devstack cinder-volume[75335]: DEBUG oslo_concurrency.processutils [None req-17856a6e-d2bf-4efd-8bb8-9244bc869846 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:03:47 devstack sudo[76077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Aug 29 01:03:47 devstack sudo[76077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:03:48 devstack sudo[76077]: pam_unix(sudo:session): session closed for user root Aug 29 01:03:48 devstack cinder-volume[75335]: DEBUG oslo_concurrency.processutils [None req-17856a6e-d2bf-4efd-8bb8-9244bc869846 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.321s {{(pid=75335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:03:48 devstack cinder-volume[75335]: DEBUG oslo_concurrency.processutils [None req-17856a6e-d2bf-4efd-8bb8-9244bc869846 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:03:48 devstack sudo[76080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 29 01:03:48 devstack sudo[76080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:03:48 devstack sudo[76080]: pam_unix(sudo:session): session closed for user root Aug 29 01:03:48 devstack cinder-volume[75335]: DEBUG oslo_concurrency.processutils [None req-17856a6e-d2bf-4efd-8bb8-9244bc869846 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.280s {{(pid=75335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:03:48 devstack cinder-volume[75335]: DEBUG oslo_concurrency.processutils [None req-17856a6e-d2bf-4efd-8bb8-9244bc869846 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:03:48 devstack sudo[76089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 29 01:03:48 devstack sudo[76089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:03:48 devstack sudo[76089]: pam_unix(sudo:session): session closed for user root Aug 29 01:03:48 devstack cinder-volume[75335]: DEBUG oslo_concurrency.processutils [None req-17856a6e-d2bf-4efd-8bb8-9244bc869846 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.272s {{(pid=75335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:03:48 devstack cinder-volume[75335]: DEBUG oslo_concurrency.processutils [None req-17856a6e-d2bf-4efd-8bb8-9244bc869846 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:03:48 devstack sudo[76092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 29 01:03:48 devstack sudo[76092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:03:48 devstack sudo[76092]: pam_unix(sudo:session): session closed for user root Aug 29 01:03:48 devstack cinder-volume[75335]: DEBUG oslo_concurrency.processutils [None req-17856a6e-d2bf-4efd-8bb8-9244bc869846 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=75335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:03:48 devstack cinder-volume[75335]: DEBUG oslo_concurrency.processutils [None req-17856a6e-d2bf-4efd-8bb8-9244bc869846 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:03:49 devstack sudo[76095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 29 01:03:49 devstack sudo[76095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:03:49 devstack sudo[76095]: pam_unix(sudo:session): session closed for user root Aug 29 01:03:49 devstack cinder-volume[75335]: DEBUG oslo_concurrency.processutils [None req-17856a6e-d2bf-4efd-8bb8-9244bc869846 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.262s {{(pid=75335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:03:49 devstack cinder-volume[75335]: DEBUG oslo_concurrency.processutils [None req-17856a6e-d2bf-4efd-8bb8-9244bc869846 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:03:49 devstack cinder-volume[75335]: DEBUG oslo_concurrency.processutils [None req-17856a6e-d2bf-4efd-8bb8-9244bc869846 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=75335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:03:49 devstack cinder-volume[75335]: DEBUG oslo_concurrency.processutils [None req-17856a6e-d2bf-4efd-8bb8-9244bc869846 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:03:49 devstack sudo[76099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 29 01:03:49 devstack sudo[76099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:03:49 devstack sudo[76099]: pam_unix(sudo:session): session closed for user root Aug 29 01:03:49 devstack cinder-volume[75335]: DEBUG oslo_concurrency.processutils [None req-17856a6e-d2bf-4efd-8bb8-9244bc869846 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.268s {{(pid=75335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:03:49 devstack cinder-volume[75335]: INFO cinder.volume.drivers.lvm [None req-17856a6e-d2bf-4efd-8bb8-9244bc869846 None None] Enabling LVM thin provisioning by default because a thin pool exists. Aug 29 01:03:49 devstack cinder-volume[75335]: DEBUG oslo_concurrency.processutils [None req-17856a6e-d2bf-4efd-8bb8-9244bc869846 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:03:49 devstack cinder-volume[75335]: DEBUG oslo_concurrency.processutils [None req-17856a6e-d2bf-4efd-8bb8-9244bc869846 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=75335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:03:49 devstack cinder-volume[75335]: DEBUG oslo_concurrency.processutils [None req-17856a6e-d2bf-4efd-8bb8-9244bc869846 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:03:49 devstack sudo[76103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 29 01:03:49 devstack sudo[76103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:03:49 devstack sudo[76103]: pam_unix(sudo:session): session closed for user root Aug 29 01:03:49 devstack cinder-volume[75335]: DEBUG oslo_concurrency.processutils [None req-17856a6e-d2bf-4efd-8bb8-9244bc869846 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.275s {{(pid=75335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:03:49 devstack cinder-volume[75335]: DEBUG cinder.volume.drivers.lvm [None req-17856a6e-d2bf-4efd-8bb8-9244bc869846 None None] Updating volume stats {{(pid=75335) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 29 01:03:49 devstack cinder-volume[75335]: DEBUG oslo_concurrency.processutils [None req-17856a6e-d2bf-4efd-8bb8-9244bc869846 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:03:49 devstack sudo[76109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 29 01:03:49 devstack sudo[76109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:03:50 devstack sudo[76109]: pam_unix(sudo:session): session closed for user root Aug 29 01:03:50 devstack cinder-volume[75335]: DEBUG oslo_concurrency.processutils [None req-17856a6e-d2bf-4efd-8bb8-9244bc869846 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.310s {{(pid=75335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:03:50 devstack cinder-volume[75335]: DEBUG oslo_concurrency.processutils [None req-17856a6e-d2bf-4efd-8bb8-9244bc869846 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:03:50 devstack sudo[76112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 29 01:03:50 devstack sudo[76112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:03:50 devstack sudo[76112]: pam_unix(sudo:session): session closed for user root Aug 29 01:03:50 devstack cinder-volume[75335]: DEBUG oslo_concurrency.processutils [None req-17856a6e-d2bf-4efd-8bb8-9244bc869846 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.277s {{(pid=75335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:03:50 devstack cinder-volume[75335]: DEBUG oslo_concurrency.processutils [None req-17856a6e-d2bf-4efd-8bb8-9244bc869846 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:03:50 devstack sudo[76115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 29 01:03:50 devstack sudo[76115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:03:50 devstack sudo[76115]: pam_unix(sudo:session): session closed for user root Aug 29 01:03:50 devstack cinder-volume[75335]: DEBUG oslo_concurrency.processutils [None req-17856a6e-d2bf-4efd-8bb8-9244bc869846 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.282s {{(pid=75335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:03:50 devstack cinder-volume[75335]: DEBUG oslo_concurrency.processutils [None req-17856a6e-d2bf-4efd-8bb8-9244bc869846 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:03:50 devstack sudo[76118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 29 01:03:50 devstack sudo[76118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:03:50 devstack sudo[76118]: pam_unix(sudo:session): session closed for user root Aug 29 01:03:50 devstack cinder-volume[75335]: DEBUG oslo_concurrency.processutils [None req-17856a6e-d2bf-4efd-8bb8-9244bc869846 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=75335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:03:50 devstack cinder-volume[75335]: INFO cinder.volume.driver [None req-17856a6e-d2bf-4efd-8bb8-9244bc869846 None None] Driver hasn't implemented _init_vendor_properties() Aug 29 01:03:50 devstack cinder-volume[75335]: DEBUG cinder.volume.driver [None req-17856a6e-d2bf-4efd-8bb8-9244bc869846 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75335) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Aug 29 01:03:51 devstack cinder-volume[75335]: DEBUG oslo_db.sqlalchemy.engines [None req-17856a6e-d2bf-4efd-8bb8-9244bc869846 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75335) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 29 01:03:51 devstack cinder-volume[75335]: DEBUG dbcounter [-] [75335] Writer thread running {{(pid=75335) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 29 01:03:51 devstack cinder-volume[75335]: DEBUG cinder.db.api [None req-17856a6e-d2bf-4efd-8bb8-9244bc869846 None None] Building query based on filter {{(pid=75335) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Aug 29 01:03:51 devstack cinder-volume[75335]: DEBUG cinder.image.image_utils [None req-17856a6e-d2bf-4efd-8bb8-9244bc869846 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75335) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Aug 29 01:03:51 devstack cinder-volume[75335]: INFO cinder.keymgr.migration [None req-0c2322e1-9ddf-46f5-b2fa-9c9e972fba5d None None] Not migrating encryption keys because the ConfKeyManager is still in use. Aug 29 01:03:51 devstack cinder-volume[75335]: DEBUG cinder.volume.drivers.lvm [None req-17856a6e-d2bf-4efd-8bb8-9244bc869846 None None] Updating volume stats {{(pid=75335) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 29 01:03:51 devstack cinder-volume[75335]: DEBUG oslo_concurrency.processutils [None req-17856a6e-d2bf-4efd-8bb8-9244bc869846 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:03:51 devstack sudo[76123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 29 01:03:51 devstack sudo[76123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:03:51 devstack sudo[76123]: pam_unix(sudo:session): session closed for user root Aug 29 01:03:51 devstack cinder-volume[75335]: DEBUG oslo_concurrency.processutils [None req-17856a6e-d2bf-4efd-8bb8-9244bc869846 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.281s {{(pid=75335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:03:51 devstack cinder-volume[75335]: DEBUG oslo_concurrency.processutils [None req-17856a6e-d2bf-4efd-8bb8-9244bc869846 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:03:51 devstack sudo[76127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 29 01:03:51 devstack sudo[76127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:03:51 devstack sudo[76127]: pam_unix(sudo:session): session closed for user root Aug 29 01:03:51 devstack cinder-volume[75335]: DEBUG oslo_concurrency.processutils [None req-17856a6e-d2bf-4efd-8bb8-9244bc869846 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.281s {{(pid=75335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:03:51 devstack cinder-volume[75335]: DEBUG oslo_concurrency.processutils [None req-17856a6e-d2bf-4efd-8bb8-9244bc869846 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:03:51 devstack sudo[76133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 29 01:03:51 devstack sudo[76133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:03:51 devstack sudo[76133]: pam_unix(sudo:session): session closed for user root Aug 29 01:03:51 devstack cinder-volume[75335]: DEBUG oslo_concurrency.processutils [None req-17856a6e-d2bf-4efd-8bb8-9244bc869846 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.254s {{(pid=75335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:03:51 devstack cinder-volume[75335]: DEBUG oslo_concurrency.processutils [None req-17856a6e-d2bf-4efd-8bb8-9244bc869846 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:03:51 devstack sudo[76136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 29 01:03:51 devstack sudo[76136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:03:52 devstack sudo[76136]: pam_unix(sudo:session): session closed for user root Aug 29 01:03:52 devstack cinder-volume[75335]: DEBUG oslo_concurrency.processutils [None req-17856a6e-d2bf-4efd-8bb8-9244bc869846 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.247s {{(pid=75335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:03:52 devstack cinder-volume[75335]: DEBUG cinder.manager [None req-17856a6e-d2bf-4efd-8bb8-9244bc869846 None None] Notifying Schedulers of capabilities ... {{(pid=75335) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:03:52 devstack cinder-volume[75335]: INFO cinder.volume.manager [None req-17856a6e-d2bf-4efd-8bb8-9244bc869846 None None] Driver initialization completed successfully. Aug 29 01:03:52 devstack cinder-volume[75335]: INFO cinder.manager [None req-17856a6e-d2bf-4efd-8bb8-9244bc869846 None None] Initiating service 2 cleanup Aug 29 01:03:52 devstack cinder-volume[75335]: INFO cinder.manager [None req-17856a6e-d2bf-4efd-8bb8-9244bc869846 None None] Service 2 cleanup completed. Aug 29 01:03:52 devstack cinder-volume[75335]: DEBUG cinder.service [None req-17856a6e-d2bf-4efd-8bb8-9244bc869846 None None] Creating RPC server for service cinder-volume {{(pid=75335) start /opt/stack/cinder/cinder/service.py:231}} Aug 29 01:03:52 devstack cinder-volume[75335]: DEBUG cinder.service [None req-17856a6e-d2bf-4efd-8bb8-9244bc869846 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75335) start /opt/stack/cinder/cinder/service.py:237}} Aug 29 01:03:52 devstack cinder-volume[75335]: INFO cinder.volume.manager [None req-17856a6e-d2bf-4efd-8bb8-9244bc869846 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Aug 29 01:03:52 devstack cinder-volume[75335]: DEBUG cinder.volume.drivers.lvm [None req-17856a6e-d2bf-4efd-8bb8-9244bc869846 None None] Updating volume stats {{(pid=75335) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 29 01:03:52 devstack cinder-volume[75335]: DEBUG oslo_concurrency.processutils [None req-17856a6e-d2bf-4efd-8bb8-9244bc869846 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:03:52 devstack sudo[76139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 29 01:03:52 devstack sudo[76139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:03:52 devstack sudo[76139]: pam_unix(sudo:session): session closed for user root Aug 29 01:03:52 devstack cinder-volume[75335]: DEBUG oslo_concurrency.processutils [None req-17856a6e-d2bf-4efd-8bb8-9244bc869846 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.278s {{(pid=75335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:03:52 devstack cinder-volume[75335]: DEBUG oslo_concurrency.processutils [None req-17856a6e-d2bf-4efd-8bb8-9244bc869846 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:03:52 devstack sudo[76143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 29 01:03:52 devstack sudo[76143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:03:52 devstack sudo[76143]: pam_unix(sudo:session): session closed for user root Aug 29 01:03:53 devstack cinder-volume[75335]: DEBUG oslo_concurrency.processutils [None req-17856a6e-d2bf-4efd-8bb8-9244bc869846 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.276s {{(pid=75335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:03:53 devstack cinder-volume[75335]: DEBUG oslo_concurrency.processutils [None req-17856a6e-d2bf-4efd-8bb8-9244bc869846 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:03:53 devstack sudo[76151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 29 01:03:53 devstack sudo[76151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:03:53 devstack sudo[76151]: pam_unix(sudo:session): session closed for user root Aug 29 01:03:53 devstack cinder-volume[75335]: DEBUG oslo_concurrency.processutils [None req-17856a6e-d2bf-4efd-8bb8-9244bc869846 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.432s {{(pid=75335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:03:53 devstack cinder-volume[75335]: DEBUG oslo_concurrency.processutils [None req-17856a6e-d2bf-4efd-8bb8-9244bc869846 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:03:53 devstack sudo[76197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 29 01:03:53 devstack sudo[76197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:03:53 devstack sudo[76197]: pam_unix(sudo:session): session closed for user root Aug 29 01:03:53 devstack cinder-volume[75335]: DEBUG oslo_concurrency.processutils [None req-17856a6e-d2bf-4efd-8bb8-9244bc869846 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.270s {{(pid=75335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:03:53 devstack cinder-volume[75335]: INFO cinder.volume.manager [None req-17856a6e-d2bf-4efd-8bb8-9244bc869846 None None] Driver post RPC initialization completed successfully. Aug 29 01:03:54 devstack cinder-volume[75153]: DEBUG dbcounter [-] [75153] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75153) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 29 01:04:03 devstack cinder-volume[75335]: DEBUG dbcounter [-] [75335] Writing DB stats cinder:SELECT=12,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75335) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 29 01:04:03 devstack cinder-volume[75335]: DEBUG dbcounter [-] [75335] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=75335) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 29 01:04:36 devstack cinder-volume[75335]: DEBUG oslo_service.periodic_task [None req-1070955d-fd32-4cbe-8765-dbf81ea3b242 None None] Running periodic task VolumeManager._thread_info {{(pid=75335) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 29 01:04:36 devstack cinder-volume[75335]: DEBUG cinder.volume.manager [None req-1070955d-fd32-4cbe-8765-dbf81ea3b242 None None] thread count: 6 {{(pid=75335) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 29 01:04:36 devstack cinder-volume[75335]: DEBUG cinder.volume.manager [None req-1070955d-fd32-4cbe-8765-dbf81ea3b242 None None] thread info: [<_MainThread(MainThread, started 132480080019584)>, , , , , ] {{(pid=75335) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 29 01:05:36 devstack cinder-volume[75335]: DEBUG oslo_service.periodic_task [None req-1070955d-fd32-4cbe-8765-dbf81ea3b242 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75335) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 29 01:05:36 devstack cinder-volume[75335]: DEBUG cinder.volume.drivers.lvm [None req-1070955d-fd32-4cbe-8765-dbf81ea3b242 None None] Updating volume stats {{(pid=75335) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 29 01:05:36 devstack cinder-volume[75335]: DEBUG oslo_concurrency.processutils [None req-1070955d-fd32-4cbe-8765-dbf81ea3b242 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:05:36 devstack sudo[81376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 29 01:05:36 devstack sudo[81376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:05:37 devstack sudo[81376]: pam_unix(sudo:session): session closed for user root Aug 29 01:05:37 devstack cinder-volume[75335]: DEBUG oslo_concurrency.processutils [None req-1070955d-fd32-4cbe-8765-dbf81ea3b242 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=75335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:05:37 devstack cinder-volume[75335]: DEBUG oslo_concurrency.processutils [None req-1070955d-fd32-4cbe-8765-dbf81ea3b242 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:05:37 devstack sudo[81379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 29 01:05:37 devstack sudo[81379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:05:37 devstack sudo[81379]: pam_unix(sudo:session): session closed for user root Aug 29 01:05:37 devstack cinder-volume[75335]: DEBUG oslo_concurrency.processutils [None req-1070955d-fd32-4cbe-8765-dbf81ea3b242 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.282s {{(pid=75335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:05:37 devstack cinder-volume[75335]: DEBUG oslo_concurrency.processutils [None req-1070955d-fd32-4cbe-8765-dbf81ea3b242 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:05:37 devstack sudo[81382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 29 01:05:37 devstack sudo[81382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:05:37 devstack sudo[81382]: pam_unix(sudo:session): session closed for user root Aug 29 01:05:37 devstack cinder-volume[75335]: DEBUG oslo_concurrency.processutils [None req-1070955d-fd32-4cbe-8765-dbf81ea3b242 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.250s {{(pid=75335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:05:37 devstack cinder-volume[75335]: DEBUG oslo_concurrency.processutils [None req-1070955d-fd32-4cbe-8765-dbf81ea3b242 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:05:37 devstack sudo[81385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 29 01:05:37 devstack sudo[81385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:05:37 devstack sudo[81385]: pam_unix(sudo:session): session closed for user root Aug 29 01:05:37 devstack cinder-volume[75335]: DEBUG oslo_concurrency.processutils [None req-1070955d-fd32-4cbe-8765-dbf81ea3b242 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=75335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:05:37 devstack cinder-volume[75335]: DEBUG cinder.manager [None req-1070955d-fd32-4cbe-8765-dbf81ea3b242 None None] Notifying Schedulers of capabilities ... {{(pid=75335) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:05:37 devstack cinder-volume[75335]: DEBUG oslo_service.periodic_task [None req-1070955d-fd32-4cbe-8765-dbf81ea3b242 None None] Running periodic task VolumeManager._thread_info {{(pid=75335) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 29 01:05:37 devstack cinder-volume[75335]: DEBUG cinder.volume.manager [None req-1070955d-fd32-4cbe-8765-dbf81ea3b242 None None] thread count: 6 {{(pid=75335) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 29 01:05:37 devstack cinder-volume[75335]: DEBUG cinder.volume.manager [None req-1070955d-fd32-4cbe-8765-dbf81ea3b242 None None] thread info: [<_MainThread(MainThread, started 132480080019584)>, , , , , ] {{(pid=75335) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 29 01:06:03 devstack cinder-volume[75335]: DEBUG dbcounter [-] [75335] Writing DB stats cinder:SELECT=1 {{(pid=75335) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 29 01:06:03 devstack cinder-volume[75335]: DEBUG dbcounter [-] [75335] Writing DB stats cinder:UPDATE=1 {{(pid=75335) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 29 01:06:36 devstack cinder-volume[75335]: DEBUG oslo_service.periodic_task [None req-1070955d-fd32-4cbe-8765-dbf81ea3b242 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75335) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 29 01:06:36 devstack cinder-volume[75335]: DEBUG cinder.volume.drivers.lvm [None req-1070955d-fd32-4cbe-8765-dbf81ea3b242 None None] Updating volume stats {{(pid=75335) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 29 01:06:36 devstack cinder-volume[75335]: DEBUG oslo_concurrency.processutils [None req-1070955d-fd32-4cbe-8765-dbf81ea3b242 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:06:36 devstack sudo[83040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 29 01:06:36 devstack sudo[83040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:06:37 devstack sudo[83040]: pam_unix(sudo:session): session closed for user root Aug 29 01:06:37 devstack cinder-volume[75335]: DEBUG oslo_concurrency.processutils [None req-1070955d-fd32-4cbe-8765-dbf81ea3b242 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.278s {{(pid=75335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:06:37 devstack cinder-volume[75335]: DEBUG oslo_concurrency.processutils [None req-1070955d-fd32-4cbe-8765-dbf81ea3b242 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:06:37 devstack sudo[83043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 29 01:06:37 devstack sudo[83043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:06:37 devstack sudo[83043]: pam_unix(sudo:session): session closed for user root Aug 29 01:06:37 devstack cinder-volume[75335]: DEBUG oslo_concurrency.processutils [None req-1070955d-fd32-4cbe-8765-dbf81ea3b242 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.279s {{(pid=75335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:06:37 devstack cinder-volume[75335]: DEBUG oslo_concurrency.processutils [None req-1070955d-fd32-4cbe-8765-dbf81ea3b242 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:06:37 devstack sudo[83057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 29 01:06:37 devstack sudo[83057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:06:37 devstack sudo[83057]: pam_unix(sudo:session): session closed for user root Aug 29 01:06:37 devstack cinder-volume[75335]: DEBUG oslo_concurrency.processutils [None req-1070955d-fd32-4cbe-8765-dbf81ea3b242 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.264s {{(pid=75335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:06:37 devstack cinder-volume[75335]: DEBUG oslo_concurrency.processutils [None req-1070955d-fd32-4cbe-8765-dbf81ea3b242 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:06:37 devstack sudo[83060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 29 01:06:37 devstack sudo[83060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:06:37 devstack sudo[83060]: pam_unix(sudo:session): session closed for user root Aug 29 01:06:37 devstack cinder-volume[75335]: DEBUG oslo_concurrency.processutils [None req-1070955d-fd32-4cbe-8765-dbf81ea3b242 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=75335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:06:37 devstack cinder-volume[75335]: DEBUG cinder.manager [None req-1070955d-fd32-4cbe-8765-dbf81ea3b242 None None] Notifying Schedulers of capabilities ... {{(pid=75335) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:06:37 devstack cinder-volume[75335]: DEBUG oslo_service.periodic_task [None req-1070955d-fd32-4cbe-8765-dbf81ea3b242 None None] Running periodic task VolumeManager._thread_info {{(pid=75335) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 29 01:06:37 devstack cinder-volume[75335]: DEBUG cinder.volume.manager [None req-1070955d-fd32-4cbe-8765-dbf81ea3b242 None None] thread count: 6 {{(pid=75335) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 29 01:06:37 devstack cinder-volume[75335]: DEBUG cinder.volume.manager [None req-1070955d-fd32-4cbe-8765-dbf81ea3b242 None None] thread info: [<_MainThread(MainThread, started 132480080019584)>, , , , , ] {{(pid=75335) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 29 01:07:36 devstack cinder-volume[75335]: DEBUG oslo_service.periodic_task [None req-1070955d-fd32-4cbe-8765-dbf81ea3b242 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75335) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 29 01:07:36 devstack cinder-volume[75335]: DEBUG cinder.volume.drivers.lvm [None req-1070955d-fd32-4cbe-8765-dbf81ea3b242 None None] Updating volume stats {{(pid=75335) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 29 01:07:36 devstack cinder-volume[75335]: DEBUG oslo_concurrency.processutils [None req-1070955d-fd32-4cbe-8765-dbf81ea3b242 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:07:36 devstack sudo[84444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 29 01:07:36 devstack sudo[84444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:07:37 devstack sudo[84444]: pam_unix(sudo:session): session closed for user root Aug 29 01:07:37 devstack cinder-volume[75335]: DEBUG oslo_concurrency.processutils [None req-1070955d-fd32-4cbe-8765-dbf81ea3b242 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.280s {{(pid=75335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:07:37 devstack cinder-volume[75335]: DEBUG oslo_concurrency.processutils [None req-1070955d-fd32-4cbe-8765-dbf81ea3b242 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:07:37 devstack sudo[84450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 29 01:07:37 devstack sudo[84450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:07:37 devstack sudo[84450]: pam_unix(sudo:session): session closed for user root Aug 29 01:07:37 devstack cinder-volume[75335]: DEBUG oslo_concurrency.processutils [None req-1070955d-fd32-4cbe-8765-dbf81ea3b242 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=75335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:07:37 devstack cinder-volume[75335]: DEBUG oslo_concurrency.processutils [None req-1070955d-fd32-4cbe-8765-dbf81ea3b242 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:07:37 devstack sudo[84454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 29 01:07:37 devstack sudo[84454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:07:37 devstack sudo[84454]: pam_unix(sudo:session): session closed for user root Aug 29 01:07:37 devstack cinder-volume[75335]: DEBUG oslo_concurrency.processutils [None req-1070955d-fd32-4cbe-8765-dbf81ea3b242 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.270s {{(pid=75335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:07:37 devstack cinder-volume[75335]: DEBUG oslo_concurrency.processutils [None req-1070955d-fd32-4cbe-8765-dbf81ea3b242 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:07:37 devstack sudo[84457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 29 01:07:37 devstack sudo[84457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:07:37 devstack sudo[84457]: pam_unix(sudo:session): session closed for user root Aug 29 01:07:37 devstack cinder-volume[75335]: DEBUG oslo_concurrency.processutils [None req-1070955d-fd32-4cbe-8765-dbf81ea3b242 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=75335) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:07:37 devstack cinder-volume[75335]: DEBUG cinder.manager [None req-1070955d-fd32-4cbe-8765-dbf81ea3b242 None None] Notifying Schedulers of capabilities ... {{(pid=75335) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:07:37 devstack cinder-volume[75335]: DEBUG oslo_service.periodic_task [None req-1070955d-fd32-4cbe-8765-dbf81ea3b242 None None] Running periodic task VolumeManager._thread_info {{(pid=75335) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 29 01:07:37 devstack cinder-volume[75335]: DEBUG cinder.volume.manager [None req-1070955d-fd32-4cbe-8765-dbf81ea3b242 None None] thread count: 6 {{(pid=75335) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 29 01:07:37 devstack cinder-volume[75335]: DEBUG cinder.volume.manager [None req-1070955d-fd32-4cbe-8765-dbf81ea3b242 None None] thread info: [<_MainThread(MainThread, started 132480080019584)>, , , , , ] {{(pid=75335) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 29 01:08:03 devstack cinder-volume[75335]: DEBUG dbcounter [-] [75335] Writing DB stats cinder:SELECT=1 {{(pid=75335) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 29 01:08:03 devstack cinder-volume[75335]: DEBUG dbcounter [-] [75335] Writing DB stats cinder:UPDATE=1 {{(pid=75335) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 29 01:08:13 devstack cinder-volume[75153]: INFO oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] Caught SIGTERM, stopping children Aug 29 01:08:13 devstack cinder-volume[75153]: DEBUG oslo_concurrency.lockutils [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] Acquiring lock "singleton_lock" {{(pid=75153) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 29 01:08:13 devstack cinder-volume[75153]: DEBUG oslo_concurrency.lockutils [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] Acquired lock "singleton_lock" {{(pid=75153) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 29 01:08:13 devstack cinder-volume[75153]: DEBUG oslo_concurrency.lockutils [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] Releasing lock "singleton_lock" {{(pid=75153) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 29 01:08:13 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] Stop services. {{(pid=75153) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Aug 29 01:08:13 devstack cinder-volume[75153]: DEBUG oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] Killing children. {{(pid=75153) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Aug 29 01:08:13 devstack cinder-volume[75153]: INFO oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] Waiting on 1 children to exit Aug 29 01:08:17 devstack cinder-volume[75335]: DEBUG oslo_concurrency.lockutils [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] Acquiring lock "singleton_lock" {{(pid=75335) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 29 01:08:17 devstack cinder-volume[75335]: DEBUG oslo_concurrency.lockutils [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] Acquired lock "singleton_lock" {{(pid=75335) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 29 01:08:17 devstack cinder-volume[75335]: DEBUG oslo_concurrency.lockutils [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] Releasing lock "singleton_lock" {{(pid=75335) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 29 01:08:17 devstack cinder-volume[75335]: WARNING amqp [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 29 01:08:17 devstack cinder-volume[75335]: WARNING amqp [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 29 01:08:17 devstack cinder-volume[75153]: INFO oslo_service.backend._eventlet.service [None req-65d68d1b-b28b-47b4-89d4-132e73f39b52 None None] Child 75335 exited with status 0 Aug 29 01:08:17 devstack cinder-volume[85285]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Aug 29 01:08:17 devstack cinder-volume[85285]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 29 01:08:17 devstack cinder-volume[85285]: we strongly recommend against using it for new projects. Aug 29 01:08:17 devstack cinder-volume[85285]: If you are already using Eventlet, we recommend migrating to a different Aug 29 01:08:17 devstack cinder-volume[85285]: framework. For more detail see Aug 29 01:08:17 devstack cinder-volume[85285]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 29 01:08:17 devstack cinder-volume[85285]: import eventlet # noqa Aug 29 01:08:19 devstack cinder-volume[85285]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85285) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 29 01:08:19 devstack cinder-volume[85285]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85285) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 29 01:08:19 devstack cinder-volume[85285]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85285) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 29 01:08:20 devstack cinder-volume[85285]: INFO dbcounter [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] Registered counter for database cinder Aug 29 01:08:20 devstack cinder-volume[85285]: DEBUG oslo_db.sqlalchemy.engines [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85285) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 29 01:08:20 devstack cinder-volume[85285]: DEBUG dbcounter [-] [85285] Writer thread running {{(pid=85285) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 29 01:08:20 devstack cinder-volume[85285]: INFO cinder.rpc [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Aug 29 01:08:20 devstack cinder-volume[85285]: INFO cinder.rpc [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Aug 29 01:08:20 devstack cinder-volume[85285]: DEBUG oslo_db.sqlalchemy.engines [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85285) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 29 01:08:21 devstack cinder-volume[85285]: INFO cinder.volume.manager [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] Determined volume DB was empty at startup. Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG cinder.volume.manager [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85285) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Aug 29 01:08:21 devstack cinder-volume[85285]: INFO cinder.volume.manager [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] Service not found for updating active_backend_id, assuming default for driver init. Aug 29 01:08:21 devstack cinder-volume[85285]: WARNING stevedore.named [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 29 01:08:21 devstack cinder-volume[85285]: WARNING castellan.key_manager [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 29 01:08:21 devstack cinder-volume[85285]: WARNING cinder.keymgr.conf_key_mgr [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 29 01:08:21 devstack cinder-volume[85285]: INFO cinder.volume.manager [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] Image-volume cache disabled for host devstack@QuobyteHD. Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_db.sqlalchemy.engines [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85285) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 29 01:08:21 devstack cinder-volume[85285]: INFO oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] Starting 1 workers Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] Started child 85505 {{(pid=85285) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] Full set of CONF: {{(pid=85285) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] ******************************************************************************** {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] Configuration options gathered from: {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] ================================================================================ {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Aug 29 01:08:21 devstack cinder-volume[85505]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] allow_availability_zone_fallback = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] allow_compression_on_image_upload = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] allowed_direct_url_schemes = [] {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] api_rate_limit = True {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] auth_strategy = keystone {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] backend_availability_zone = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] backend_host = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] backend_name = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] backend_stats_polling_interval = 60 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] backup_api_class = cinder.backup.api.API {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] backup_name_template = backup-%s {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] backup_use_same_host = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] backup_use_temp_snapshot = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] chap_password = **** {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] chap_username = {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] cinder_internal_tenant_project_id = 7a4cf32a58f94d27881d289e35b4f0ad {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] cinder_internal_tenant_user_id = 5c42c7643926494cb72c778ea82fc190 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] cluster = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] compression_format = gzip {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] compute_api_class = cinder.compute.nova.API {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] config_dir = [] {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] config_source = [] {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] control_exchange = openstack {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] debug = True {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] default_availability_zone = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] default_group_type = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] default_volume_type = QuobyteHD {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] disk_geometry = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] driver_client_cert = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] driver_client_cert_key = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] driver_data_namespace = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] driver_ssl_cert_path = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] driver_ssl_cert_verify = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] driver_use_ssl = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] enable_new_services = True {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] enable_unsupported_driver = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] enabled_backends = ['QuobyteHD'] {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] enforce_multipath_for_image_xfer = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] filter_function = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] glance_api_insecure = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] glance_api_servers = ['http://192.168.122.202/image'] {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] glance_api_ssl_compression = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] glance_ca_certificates_file = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] glance_catalog_info = image:glance:publicURL {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] glance_certfile = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] glance_keyfile = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] glance_num_retries = 3 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] glance_request_timeout = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] goodness_function = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] graceful_shutdown_timeout = 5 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] group_api_class = cinder.group.api.API {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] host = devstack {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] image_compress_on_upload = True {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] image_conversion_address_space_limit = 1 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] image_conversion_cpu_limit = 60 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] image_conversion_disable = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] image_upload_use_cinder_backend = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] image_upload_use_internal_tenant = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] image_volume_cache_enabled = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] image_volume_cache_max_count = 0 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] image_volume_cache_max_size_gb = 0 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] init_host_max_objects_retrieval = 0 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] instance_format = [instance: %(uuid)s] {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] iscsi_target_flags = {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] iscsi_write_cache = on {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] iser_helper = tgtadm {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] iser_ip_address = 192.168.122.202 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85505]: INFO cinder.volume.manager [None req-68b1a41b-3137-4106-ba33-33d3d17d0aea None None] Starting volume driver QuobyteDriver (1.2.1) Aug 29 01:08:21 devstack cinder-volume[85505]: DEBUG cinder.volume.drivers.remotefs [None req-68b1a41b-3137-4106-ba33-33d3d17d0aea None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=85505) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] iser_port = 3260 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] log_color = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] log_config_append = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] log_dir = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] log_file = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] log_options = True {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] log_rotate_interval = 1 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] log_rotate_interval_type = days {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] log_rotation_type = none {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] max_age = 0 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] max_logfile_count = 30 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] max_logfile_size_mb = 200 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] max_over_subscription_ratio = 20.0 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] message_reap_interval = 86400 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] message_ttl = 2592000 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] migration_create_volume_timeout_secs = 300 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] monkey_patch = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] monkey_patch_modules = [] {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] my_ip = 192.168.122.202 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] no_snapshot_gb_quota = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] num_iser_scan_tries = 3 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] num_shell_tries = 3 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] num_volume_device_scan_tries = 3 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] nvmeof_conn_info_version = 1 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] nvmet_ns_id = 10 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] nvmet_port_id = 1 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] osapi_max_limit = 1000 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] osapi_volume_ext_list = [] {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] osapi_volume_listen = 0.0.0.0 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] osapi_volume_listen_port = 8776 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] osapi_volume_use_ssl = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] osapi_volume_workers = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] per_volume_size_limit = -1 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] periodic_fuzzy_delay = 60 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] periodic_interval = 60 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] project_id_regex = [0-9a-f\-]+ {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] public_endpoint = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] publish_errors = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] quota_backup_gigabytes = 1000 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] quota_backups = 10 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] quota_gigabytes = 1000 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] quota_groups = 10 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] quota_snapshots = 10 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] quota_volumes = 10 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] rate_limit_burst = 0 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] rate_limit_except_level = CRITICAL {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] rate_limit_interval = 0 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] reinit_driver_count = 3 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] replication_device = **** {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] report_discard_supported = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] report_interval = 120 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] reservation_clean_interval = 86400 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] reservation_expire = 86400 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] reserved_image_namespaces = [] {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] reserved_percentage = 0 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] rpc_response_timeout = 120 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] run_external_periodic_tasks = True {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] scst_target_driver = iscsi {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] scst_target_iqn_name = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] service_down_time = 720 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] shell_completion = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] snapshot_name_template = snapshot-%s {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] split_loggers = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] state_path = /opt/stack/data/cinder {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] storage_availability_zone = nova {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] storage_protocol = iSCSI {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] syslog_log_facility = LOG_USER {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] target_helper = lioadm {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] target_ip_address = 192.168.122.202 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] target_port = 3260 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] target_protocol = iscsi {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] target_secondary_ip_addresses = [] {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] trace_flags = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] transfer_api_class = cinder.transfer.api.API {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] transport_url = **** {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] until_refresh = 0 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] use_chap_auth = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] use_default_quota_class = True {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] use_journal = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] use_json = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] use_multipath_for_image_xfer = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] use_stderr = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] use_syslog = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] verify_glance_signatures = enabled {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] volume_api_class = cinder.volume.api.API {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] volume_backend_name = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] volume_clear = zero {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] volume_clear_ionice = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] volume_clear_size = 0 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] volume_copy_bps_limit = 0 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] volume_dd_blocksize = 1M {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] volume_name_template = volume-%s {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] volume_service_inithost_offload = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] volume_usage_audit_period = month {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] zoning_mode = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] oslo_concurrency.disable_process_locking = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] keystone_authtoken.auth_section = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] keystone_authtoken.auth_type = password {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] keystone_authtoken.auth_version = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] keystone_authtoken.cache = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] keystone_authtoken.certfile = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] keystone_authtoken.delay_auth_decision = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] keystone_authtoken.http_connect_timeout = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] keystone_authtoken.include_service_catalog = True {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] keystone_authtoken.insecure = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] keystone_authtoken.interface = public {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] keystone_authtoken.keyfile = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] keystone_authtoken.memcache_password = **** {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] keystone_authtoken.memcache_username = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] keystone_authtoken.region_name = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] keystone_authtoken.service_token_roles_required = True {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] keystone_authtoken.service_type = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] keystone_authtoken.token_cache_time = 300 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85505]: DEBUG cinder.volume.drivers.quobyte [None req-68b1a41b-3137-4106-ba33-33d3d17d0aea None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=85505) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Aug 29 01:08:21 devstack cinder-volume[85505]: WARNING cinder.volume.drivers.quobyte [None req-68b1a41b-3137-4106-ba33-33d3d17d0aea None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Aug 29 01:08:21 devstack cinder-volume[85505]: WARNING cinder.volume.drivers.quobyte [None req-68b1a41b-3137-4106-ba33-33d3d17d0aea None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.202/identity {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] cache.backend = dogpile.cache.null {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] cache.backend_argument = **** {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] cache.backend_expiration_time = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] cache.config_prefix = cache.oslo {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85505]: DEBUG oslo_concurrency.processutils [None req-68b1a41b-3137-4106-ba33-33d3d17d0aea None None] Running cmd (subprocess): mount.quobyte {{(pid=85505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] cache.debug_cache_backend = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] cache.enable_retry_client = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] cache.enable_socket_keepalive = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] cache.enabled = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] cache.expiration_time = 600 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] cache.hashclient_dead_timeout = 60.0 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] cache.hashclient_retry_attempts = 2 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] cache.memcache_dead_retry = 300 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] cache.memcache_pool_maxsize = 10 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] cache.memcache_sasl_enabled = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] cache.memcache_servers = ['localhost:11211'] {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] cache.password = **** {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] cache.proxies = [] {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] cache.redis_db = 0 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] cache.redis_sentinel_service_name = mymaster {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] cache.redis_server = localhost:6379 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] cache.retry_attempts = 2 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] cache.retry_delay = 0.0 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] cache.socket_keepalive_count = 1 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] cache.socket_keepalive_idle = 1 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] cache.socket_keepalive_interval = 1 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] cache.socket_timeout = 1.0 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] cache.tls_allowed_ciphers = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] cache.tls_cafile = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] cache.tls_certfile = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] cache.tls_enabled = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] cache.tls_keyfile = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] cache.username = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] coordination.backend_url = **** {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] database.asyncio_connection = **** {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] database.asyncio_slave_connection = **** {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] database.backend = sqlalchemy {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] database.connection = **** {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] database.connection_debug = 0 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] database.connection_parameters = {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] database.connection_recycle_time = 3600 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] database.connection_trace = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] database.db_inc_retry_interval = True {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] database.db_max_retries = 20 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] database.db_max_retry_interval = 10 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] database.db_retry_interval = 1 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] database.max_overflow = 50 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] database.max_pool_size = 5 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] database.max_retries = 10 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] database.mysql_sql_mode = TRADITIONAL {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] database.mysql_wsrep_sync_wait = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] database.pool_timeout = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] database.retry_interval = 10 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] database.slave_connection = **** {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] database.sqlite_synchronous = True {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] database.synchronous_reader = True {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] database.use_db_reconnect = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] oslo_messaging_metrics.metrics_process_name = {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] oslo_messaging_tracing.insecure = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] profiler.connection_string = messaging:// {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] profiler.enabled = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] profiler.es_doc_type = notification {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] profiler.es_scroll_size = 10000 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] profiler.es_scroll_time = 2m {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] profiler.filter_error_trace = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] profiler.hmac_keys = **** {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] profiler.sentinel_service_name = mymaster {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] profiler.socket_timeout = 0.1 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] profiler.trace_requests = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] profiler.trace_sqlalchemy = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] profiler_jaeger.process_tags = {} {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] profiler_jaeger.service_name_prefix = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] profiler_otlp.service_name_prefix = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] oslo_policy.enforce_new_defaults = True {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] oslo_policy.policy_default_rule = default {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] oslo_policy.policy_file = policy.yaml {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] oslo_policy.remote_timeout = 60.0 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] privsep_osbrick.capabilities = [21, 2] {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] privsep_osbrick.group = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] privsep_osbrick.helper_command = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] privsep_osbrick.user = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] cinder_sys_admin.group = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] cinder_sys_admin.helper_command = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] cinder_sys_admin.user = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] service_user.auth_section = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] service_user.auth_type = password {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] service_user.cafile = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] service_user.certfile = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] service_user.collect_timing = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] service_user.insecure = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack quobyte-client[85508]: Reading configuration file: /etc/quobyte/client.cfg Aug 29 01:08:21 devstack quobyte-client[85508]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] service_user.keyfile = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] service_user.send_service_user_token = True {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] service_user.split_loggers = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] service_user.timeout = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] glance.auth_section = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85505]: DEBUG oslo_concurrency.processutils [None req-68b1a41b-3137-4106-ba33-33d3d17d0aea None None] CMD "mount.quobyte" returned: 1 in 0.116s {{(pid=85505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:08:21 devstack cinder-volume[85505]: DEBUG oslo_concurrency.lockutils [None req-68b1a41b-3137-4106-ba33-33d3d17d0aea None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:08:21 devstack cinder-volume[85505]: DEBUG oslo_concurrency.lockutils [None req-68b1a41b-3137-4106-ba33-33d3d17d0aea None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:08:21 devstack cinder-volume[85505]: DEBUG cinder.volume.drivers.quobyte [None req-68b1a41b-3137-4106-ba33-33d3d17d0aea None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=85505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] glance.auth_type = password {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85505]: INFO cinder.volume.drivers.quobyte [None req-68b1a41b-3137-4106-ba33-33d3d17d0aea None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 ... Aug 29 01:08:21 devstack cinder-volume[85505]: DEBUG oslo_concurrency.processutils [None req-68b1a41b-3137-4106-ba33-33d3d17d0aea None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac -c /etc/quobyte/client-cinder.cfg {{(pid=85505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] glance.certfile = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] glance.collect_timing = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] glance.insecure = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] glance.keyfile = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] glance.region_name = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] glance.split_loggers = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] glance.timeout = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] backend_defaults.backend_availability_zone = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] backend_defaults.chap_password = **** {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] backend_defaults.chap_username = {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] backend_defaults.disk_geometry = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] backend_defaults.driver_client_cert = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] backend_defaults.driver_client_cert_key = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] backend_defaults.driver_data_namespace = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] backend_defaults.driver_use_ssl = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] backend_defaults.enable_unsupported_driver = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] backend_defaults.extra_capabilities = {} {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] backend_defaults.filter_function = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] backend_defaults.goodness_function = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] backend_defaults.iscsi_target_flags = {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] backend_defaults.iscsi_write_cache = on {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] backend_defaults.iser_helper = tgtadm {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] backend_defaults.iser_ip_address = 192.168.122.202 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] backend_defaults.iser_port = 3260 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] backend_defaults.nas_host = {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] backend_defaults.nas_login = admin {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack sudo[85512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac -c /etc/quobyte/client-cinder.cfg Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] backend_defaults.nas_mount_options = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack sudo[85512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] backend_defaults.nas_password = **** {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] backend_defaults.nas_private_key = {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] backend_defaults.nas_share_path = {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] backend_defaults.nas_ssh_port = 22 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] backend_defaults.num_shell_tries = 3 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] backend_defaults.nvmet_ns_id = 10 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] backend_defaults.nvmet_port_id = 1 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] backend_defaults.quobyte_client_cfg = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] backend_defaults.quobyte_volume_url = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] backend_defaults.replication_device = **** {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] backend_defaults.report_discard_supported = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] backend_defaults.reserved_percentage = 0 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] backend_defaults.scst_target_driver = iscsi {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] backend_defaults.scst_target_iqn_name = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] backend_defaults.storage_protocol = iSCSI {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] backend_defaults.target_helper = tgtadm {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] backend_defaults.target_ip_address = 192.168.122.202 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] backend_defaults.target_port = 3260 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] backend_defaults.target_protocol = iscsi {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] backend_defaults.trace_flags = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] backend_defaults.unique_fqdn_network = True {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] backend_defaults.use_chap_auth = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] backend_defaults.volume_backend_name = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] backend_defaults.volume_clear = zero {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] backend_defaults.volume_clear_ionice = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] backend_defaults.volume_clear_size = 0 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] oslo_reports.file_event_handler = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] oslo_reports.log_dir = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] QuobyteHD.backend_availability_zone = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] QuobyteHD.backend_host = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] QuobyteHD.chap_password = **** {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] QuobyteHD.chap_username = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] QuobyteHD.chiscsi_conf = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] QuobyteHD.disk_geometry = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] QuobyteHD.driver_client_cert = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] QuobyteHD.driver_client_cert_key = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] QuobyteHD.driver_data_namespace = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] QuobyteHD.driver_use_ssl = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] QuobyteHD.enable_unsupported_driver = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] QuobyteHD.extra_capabilities = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] QuobyteHD.filter_function = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] QuobyteHD.goodness_function = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] QuobyteHD.iscsi_target_flags = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] QuobyteHD.iscsi_write_cache = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] QuobyteHD.iser_helper = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] QuobyteHD.iser_ip_address = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] QuobyteHD.iser_port = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] QuobyteHD.iser_target_prefix = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] QuobyteHD.nas_host = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] QuobyteHD.nas_login = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] QuobyteHD.nas_mount_options = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] QuobyteHD.nas_password = **** {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] QuobyteHD.nas_private_key = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] QuobyteHD.nas_share_path = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] QuobyteHD.nas_ssh_port = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] QuobyteHD.num_iser_scan_tries = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] QuobyteHD.num_shell_tries = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] QuobyteHD.nvmet_ns_id = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] QuobyteHD.nvmet_port_id = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] QuobyteHD.replication_device = **** {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] QuobyteHD.report_discard_supported = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] QuobyteHD.reserved_percentage = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] QuobyteHD.scst_target_driver = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] QuobyteHD.storage_protocol = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] QuobyteHD.target_helper = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] QuobyteHD.target_ip_address = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] QuobyteHD.target_port = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] QuobyteHD.target_prefix = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] QuobyteHD.target_protocol = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] QuobyteHD.trace_flags = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] QuobyteHD.unique_fqdn_network = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] QuobyteHD.use_chap_auth = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] QuobyteHD.volume_clear = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] QuobyteHD.volume_clear_ionice = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] QuobyteHD.volume_clear_size = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] QuobyteHD.volume_dd_blocksize = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] QuobyteHD.volumes_dir = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] oslo_messaging_rabbit.ssl = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] oslo_messaging_rabbit.ssl_version = {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] oslo_messaging_notifications.driver = [] {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] oslo_messaging_notifications.retry = -1 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] oslo_messaging_notifications.transport_url = **** {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] key_manager.fixed_key = **** {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] barbican.barbican_api_version = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] barbican.barbican_endpoint = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] barbican.barbican_endpoint_type = public {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] barbican.barbican_region_name = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] barbican.cafile = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] barbican.certfile = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] barbican.collect_timing = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] barbican.insecure = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] barbican.keyfile = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] barbican.number_of_retries = 60 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] barbican.retry_delay = 1 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] barbican.send_service_user_token = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] barbican.split_loggers = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] barbican.timeout = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] barbican.verify_ssl = True {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] barbican.verify_ssl_path = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] barbican_service_user.auth_section = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] barbican_service_user.auth_type = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] barbican_service_user.cafile = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] barbican_service_user.certfile = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] barbican_service_user.collect_timing = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] barbican_service_user.insecure = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] barbican_service_user.keyfile = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] barbican_service_user.split_loggers = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] barbican_service_user.timeout = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] vault.approle_role_id = **** {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] vault.approle_secret_id = **** {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] vault.auth_method = approle {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] vault.auth_path = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] vault.kv_mountpoint = secret {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] vault.kv_path = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] vault.kv_version = 2 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] vault.namespace = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] vault.root_token_id = **** {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] vault.ssl_ca_crt_file = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] vault.timeout = 60.0 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] vault.token_file = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] vault.token_role = None {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] vault.use_ssl = False {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:21 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] ******************************************************************************** {{(pid=85285) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Aug 29 01:08:22 devstack sudo[85512]: pam_unix(sudo:session): session closed for user root Aug 29 01:08:22 devstack cinder-volume[85505]: DEBUG oslo_concurrency.processutils [None req-68b1a41b-3137-4106-ba33-33d3d17d0aea None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.372s {{(pid=85505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:08:22 devstack cinder-volume[85505]: INFO cinder.volume.drivers.quobyte [None req-68b1a41b-3137-4106-ba33-33d3d17d0aea None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 succeeded Aug 29 01:08:22 devstack cinder-volume[85505]: DEBUG cinder.volume.drivers.quobyte [None req-68b1a41b-3137-4106-ba33-33d3d17d0aea None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=85505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:08:22 devstack cinder-volume[85505]: DEBUG oslo_concurrency.lockutils [None req-68b1a41b-3137-4106-ba33-33d3d17d0aea None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.382s {{(pid=85505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:08:22 devstack cinder-volume[85505]: DEBUG oslo_concurrency.processutils [None req-68b1a41b-3137-4106-ba33-33d3d17d0aea None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=85505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:08:22 devstack sudo[85581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:08:22 devstack sudo[85581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:08:22 devstack sudo[85581]: pam_unix(sudo:session): session closed for user root Aug 29 01:08:22 devstack cinder-volume[85505]: DEBUG oslo_concurrency.processutils [None req-68b1a41b-3137-4106-ba33-33d3d17d0aea None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.251s {{(pid=85505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:08:22 devstack cinder-volume[85505]: INFO cinder.volume.driver [None req-68b1a41b-3137-4106-ba33-33d3d17d0aea None None] Driver hasn't implemented _init_vendor_properties() Aug 29 01:08:22 devstack cinder-volume[85505]: DEBUG cinder.volume.driver [None req-68b1a41b-3137-4106-ba33-33d3d17d0aea None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.5093002319336, 'free_capacity_gb': 1774.5093002319336, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=85505) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Aug 29 01:08:22 devstack cinder-volume[85505]: DEBUG oslo_db.sqlalchemy.engines [None req-68b1a41b-3137-4106-ba33-33d3d17d0aea None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85505) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 29 01:08:22 devstack cinder-volume[85505]: DEBUG dbcounter [-] [85505] Writer thread running {{(pid=85505) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 29 01:08:22 devstack cinder-volume[85505]: DEBUG cinder.db.api [None req-68b1a41b-3137-4106-ba33-33d3d17d0aea None None] Building query based on filter {{(pid=85505) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Aug 29 01:08:22 devstack cinder-volume[85505]: DEBUG cinder.image.image_utils [None req-68b1a41b-3137-4106-ba33-33d3d17d0aea None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=85505) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Aug 29 01:08:22 devstack cinder-volume[85505]: INFO cinder.keymgr.migration [None req-906baca4-fb33-482a-bf31-44be32cf4d5b None None] Not migrating encryption keys because the ConfKeyManager is still in use. Aug 29 01:08:22 devstack cinder-volume[85505]: DEBUG oslo_concurrency.lockutils [None req-68b1a41b-3137-4106-ba33-33d3d17d0aea None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:08:22 devstack cinder-volume[85505]: DEBUG oslo_concurrency.lockutils [None req-68b1a41b-3137-4106-ba33-33d3d17d0aea None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:08:22 devstack cinder-volume[85505]: DEBUG cinder.volume.drivers.quobyte [None req-68b1a41b-3137-4106-ba33-33d3d17d0aea None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=85505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:08:22 devstack cinder-volume[85505]: DEBUG cinder.volume.drivers.quobyte [None req-68b1a41b-3137-4106-ba33-33d3d17d0aea None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=85505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:08:22 devstack cinder-volume[85505]: DEBUG oslo_concurrency.lockutils [None req-68b1a41b-3137-4106-ba33-33d3d17d0aea None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=85505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:08:22 devstack cinder-volume[85505]: DEBUG oslo_concurrency.processutils [None req-68b1a41b-3137-4106-ba33-33d3d17d0aea None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=85505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:08:22 devstack sudo[85585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:08:22 devstack sudo[85585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:08:22 devstack sudo[85585]: pam_unix(sudo:session): session closed for user root Aug 29 01:08:22 devstack cinder-volume[85505]: DEBUG oslo_concurrency.processutils [None req-68b1a41b-3137-4106-ba33-33d3d17d0aea None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.225s {{(pid=85505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:08:22 devstack cinder-volume[85505]: DEBUG cinder.manager [None req-68b1a41b-3137-4106-ba33-33d3d17d0aea None None] Notifying Schedulers of capabilities ... {{(pid=85505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:08:22 devstack cinder-volume[85505]: INFO cinder.volume.manager [None req-68b1a41b-3137-4106-ba33-33d3d17d0aea None None] Driver initialization completed successfully. Aug 29 01:08:22 devstack cinder-volume[85505]: INFO cinder.manager [None req-68b1a41b-3137-4106-ba33-33d3d17d0aea None None] Initiating service 3 cleanup Aug 29 01:08:22 devstack cinder-volume[85505]: INFO cinder.manager [None req-68b1a41b-3137-4106-ba33-33d3d17d0aea None None] Service 3 cleanup completed. Aug 29 01:08:22 devstack cinder-volume[85505]: DEBUG cinder.service [None req-68b1a41b-3137-4106-ba33-33d3d17d0aea None None] Creating RPC server for service cinder-volume {{(pid=85505) start /opt/stack/cinder/cinder/service.py:231}} Aug 29 01:08:22 devstack cinder-volume[85505]: DEBUG cinder.service [None req-68b1a41b-3137-4106-ba33-33d3d17d0aea None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=85505) start /opt/stack/cinder/cinder/service.py:237}} Aug 29 01:08:22 devstack cinder-volume[85505]: INFO cinder.volume.manager [None req-68b1a41b-3137-4106-ba33-33d3d17d0aea None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Aug 29 01:08:22 devstack cinder-volume[85505]: DEBUG oslo_concurrency.lockutils [None req-68b1a41b-3137-4106-ba33-33d3d17d0aea None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:08:22 devstack cinder-volume[85505]: DEBUG oslo_concurrency.lockutils [None req-68b1a41b-3137-4106-ba33-33d3d17d0aea None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:08:22 devstack cinder-volume[85505]: DEBUG cinder.volume.drivers.quobyte [None req-68b1a41b-3137-4106-ba33-33d3d17d0aea None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=85505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:08:22 devstack cinder-volume[85505]: DEBUG cinder.volume.drivers.quobyte [None req-68b1a41b-3137-4106-ba33-33d3d17d0aea None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=85505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:08:22 devstack cinder-volume[85505]: DEBUG oslo_concurrency.lockutils [None req-68b1a41b-3137-4106-ba33-33d3d17d0aea None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:08:22 devstack cinder-volume[85505]: DEBUG oslo_concurrency.processutils [None req-68b1a41b-3137-4106-ba33-33d3d17d0aea None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=85505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:08:22 devstack sudo[85588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:08:22 devstack sudo[85588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:08:23 devstack sudo[85588]: pam_unix(sudo:session): session closed for user root Aug 29 01:08:23 devstack cinder-volume[85505]: DEBUG oslo_concurrency.processutils [None req-68b1a41b-3137-4106-ba33-33d3d17d0aea None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.284s {{(pid=85505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:08:23 devstack cinder-volume[85505]: INFO cinder.volume.manager [None req-68b1a41b-3137-4106-ba33-33d3d17d0aea None None] Driver post RPC initialization completed successfully. Aug 29 01:08:27 devstack cinder-volume[85505]: DEBUG oslo_concurrency.lockutils [None req-6202ced9-00fd-4360-92ee-fadf7b1b4c98 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:08:27 devstack cinder-volume[85505]: DEBUG oslo_concurrency.lockutils [None req-6202ced9-00fd-4360-92ee-fadf7b1b4c98 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:08:27 devstack cinder-volume[85505]: DEBUG cinder.volume.drivers.quobyte [None req-6202ced9-00fd-4360-92ee-fadf7b1b4c98 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=85505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:08:27 devstack cinder-volume[85505]: DEBUG cinder.volume.drivers.quobyte [None req-6202ced9-00fd-4360-92ee-fadf7b1b4c98 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=85505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:08:27 devstack cinder-volume[85505]: DEBUG oslo_concurrency.lockutils [None req-6202ced9-00fd-4360-92ee-fadf7b1b4c98 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=85505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:08:27 devstack cinder-volume[85505]: DEBUG oslo_concurrency.processutils [None req-6202ced9-00fd-4360-92ee-fadf7b1b4c98 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=85505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:08:27 devstack sudo[85707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:08:27 devstack sudo[85707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:08:27 devstack sudo[85707]: pam_unix(sudo:session): session closed for user root Aug 29 01:08:27 devstack cinder-volume[85505]: DEBUG oslo_concurrency.processutils [None req-6202ced9-00fd-4360-92ee-fadf7b1b4c98 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.237s {{(pid=85505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:08:27 devstack cinder-volume[85505]: DEBUG cinder.manager [None req-6202ced9-00fd-4360-92ee-fadf7b1b4c98 None None] Notifying Schedulers of capabilities ... {{(pid=85505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:08:31 devstack cinder-volume[85285]: INFO oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] Caught SIGTERM, stopping children Aug 29 01:08:31 devstack cinder-volume[85285]: DEBUG oslo_concurrency.lockutils [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] Acquiring lock "singleton_lock" {{(pid=85285) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 29 01:08:31 devstack cinder-volume[85285]: DEBUG oslo_concurrency.lockutils [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] Acquired lock "singleton_lock" {{(pid=85285) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 29 01:08:31 devstack cinder-volume[85285]: DEBUG oslo_concurrency.lockutils [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] Releasing lock "singleton_lock" {{(pid=85285) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 29 01:08:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] Stop services. {{(pid=85285) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Aug 29 01:08:31 devstack cinder-volume[85285]: DEBUG oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] Killing children. {{(pid=85285) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Aug 29 01:08:31 devstack cinder-volume[85285]: INFO oslo_service.backend._eventlet.service [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] Waiting on 1 children to exit Aug 29 01:08:31 devstack cinder-volume[85505]: DEBUG oslo_service.periodic_task [None req-1524712c-177c-40c6-bcad-da4a416ac838 None None] Running periodic task VolumeManager._thread_info {{(pid=85505) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 29 01:08:31 devstack cinder-volume[85505]: DEBUG cinder.volume.manager [None req-1524712c-177c-40c6-bcad-da4a416ac838 None None] thread count: 6 {{(pid=85505) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 29 01:08:31 devstack cinder-volume[85505]: DEBUG cinder.volume.manager [None req-1524712c-177c-40c6-bcad-da4a416ac838 None None] thread info: [<_MainThread(MainThread, started 123816696205440)>, , , , , ] {{(pid=85505) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 29 01:08:32 devstack cinder-volume[85505]: DEBUG dbcounter [-] [85505] Writing DB stats cinder:SELECT=9,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=85505) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 29 01:08:33 devstack cinder-volume[85505]: DEBUG dbcounter [-] [85505] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=85505) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 29 01:08:36 devstack cinder-volume[85505]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Aug 29 01:08:36 devstack cinder-volume[85505]: DEBUG oslo_concurrency.lockutils [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] Acquiring lock "singleton_lock" {{(pid=85505) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 29 01:08:36 devstack cinder-volume[85505]: DEBUG oslo_concurrency.lockutils [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] Acquired lock "singleton_lock" {{(pid=85505) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 29 01:08:36 devstack cinder-volume[85505]: DEBUG oslo_concurrency.lockutils [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] Releasing lock "singleton_lock" {{(pid=85505) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 29 01:08:36 devstack cinder-volume[85505]: WARNING amqp [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 29 01:08:36 devstack cinder-volume[85505]: WARNING amqp [None req-fecf2823-d83c-407c-a955-37bc189d955b None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 29 01:08:36 devstack cinder-volume[85816]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Aug 29 01:08:36 devstack cinder-volume[85816]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 29 01:08:36 devstack cinder-volume[85816]: we strongly recommend against using it for new projects. Aug 29 01:08:36 devstack cinder-volume[85816]: If you are already using Eventlet, we recommend migrating to a different Aug 29 01:08:36 devstack cinder-volume[85816]: framework. For more detail see Aug 29 01:08:36 devstack cinder-volume[85816]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 29 01:08:36 devstack cinder-volume[85816]: import eventlet # noqa Aug 29 01:08:39 devstack cinder-volume[85816]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85816) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 29 01:08:39 devstack cinder-volume[85816]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85816) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 29 01:08:39 devstack cinder-volume[85816]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85816) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 29 01:08:39 devstack cinder-volume[85816]: INFO dbcounter [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] Registered counter for database cinder Aug 29 01:08:39 devstack cinder-volume[85816]: DEBUG oslo_db.sqlalchemy.engines [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85816) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG dbcounter [-] [85816] Writer thread running {{(pid=85816) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 29 01:08:40 devstack cinder-volume[85816]: INFO cinder.rpc [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Aug 29 01:08:40 devstack cinder-volume[85816]: INFO cinder.rpc [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_db.sqlalchemy.engines [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85816) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 29 01:08:40 devstack cinder-volume[85816]: INFO cinder.volume.manager [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] Determined volume DB was empty at startup. Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG cinder.volume.manager [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85816) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Aug 29 01:08:40 devstack cinder-volume[85816]: WARNING stevedore.named [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 29 01:08:40 devstack cinder-volume[85816]: WARNING castellan.key_manager [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 29 01:08:40 devstack cinder-volume[85816]: WARNING cinder.keymgr.conf_key_mgr [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 29 01:08:40 devstack cinder-volume[85816]: INFO cinder.volume.manager [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] Image-volume cache disabled for host devstack@QuobyteHD. Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_db.sqlalchemy.engines [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85816) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 29 01:08:40 devstack cinder-volume[85816]: INFO oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] Starting 1 workers Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] Started child 86111 {{(pid=85816) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] Full set of CONF: {{(pid=85816) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] ******************************************************************************** {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] Configuration options gathered from: {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] ================================================================================ {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] allow_availability_zone_fallback = False {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] allow_compression_on_image_upload = False {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] allowed_direct_url_schemes = [] {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] api_rate_limit = True {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[86111]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] auth_strategy = keystone {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] backend_availability_zone = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] backend_host = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] backend_name = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] backend_stats_polling_interval = 60 {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] backup_api_class = cinder.backup.api.API {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] backup_name_template = backup-%s {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] backup_use_same_host = False {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] backup_use_temp_snapshot = False {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] chap_password = **** {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] chap_username = {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] cinder_internal_tenant_project_id = 7a4cf32a58f94d27881d289e35b4f0ad {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] cinder_internal_tenant_user_id = 5c42c7643926494cb72c778ea82fc190 {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] cluster = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] compression_format = gzip {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] compute_api_class = cinder.compute.nova.API {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] config_dir = [] {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] config_source = [] {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] control_exchange = openstack {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] debug = True {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] default_availability_zone = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] default_group_type = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] default_volume_type = QuobyteHD {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] disk_geometry = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] driver_client_cert = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] driver_client_cert_key = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] driver_data_namespace = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] driver_ssl_cert_path = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] driver_ssl_cert_verify = False {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] driver_use_ssl = False {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] enable_new_services = True {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] enable_unsupported_driver = False {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] enabled_backends = ['QuobyteHD'] {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] enforce_multipath_for_image_xfer = False {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] filter_function = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] glance_api_insecure = False {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] glance_api_servers = ['http://192.168.122.202/image'] {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] glance_api_ssl_compression = False {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] glance_ca_certificates_file = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] glance_catalog_info = image:glance:publicURL {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] glance_certfile = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] glance_keyfile = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] glance_num_retries = 3 {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] glance_request_timeout = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] goodness_function = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] graceful_shutdown_timeout = 5 {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] group_api_class = cinder.group.api.API {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] host = devstack {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] image_compress_on_upload = True {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] image_conversion_address_space_limit = 1 {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] image_conversion_cpu_limit = 60 {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] image_conversion_disable = False {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] image_upload_use_cinder_backend = False {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] image_upload_use_internal_tenant = False {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] image_volume_cache_enabled = False {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] image_volume_cache_max_count = 0 {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] image_volume_cache_max_size_gb = 0 {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] init_host_max_objects_retrieval = 0 {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] instance_format = [instance: %(uuid)s] {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] iscsi_target_flags = {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] iscsi_write_cache = on {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] iser_helper = tgtadm {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] iser_ip_address = 192.168.122.202 {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] iser_port = 3260 {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] log_color = False {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] log_config_append = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] log_dir = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] log_file = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] log_options = True {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] log_rotate_interval = 1 {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] log_rotate_interval_type = days {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] log_rotation_type = none {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] max_age = 0 {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] max_logfile_count = 30 {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-ea72abaf-737b-4fbf-bf92-ff8c5ff9cf80 None None] Starting volume driver QuobyteDriver (1.2.1) Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] max_logfile_size_mb = 200 {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-ea72abaf-737b-4fbf-bf92-ff8c5ff9cf80 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86111) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] max_over_subscription_ratio = 20.0 {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] message_reap_interval = 86400 {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] message_ttl = 2592000 {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] migration_create_volume_timeout_secs = 300 {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] monkey_patch = False {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] monkey_patch_modules = [] {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] my_ip = 192.168.122.202 {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] no_snapshot_gb_quota = False {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] num_iser_scan_tries = 3 {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] num_shell_tries = 3 {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] num_volume_device_scan_tries = 3 {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] nvmeof_conn_info_version = 1 {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] nvmet_ns_id = 10 {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] nvmet_port_id = 1 {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] osapi_max_limit = 1000 {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] osapi_volume_ext_list = [] {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] osapi_volume_listen = 0.0.0.0 {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] osapi_volume_listen_port = 8776 {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] osapi_volume_use_ssl = False {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] osapi_volume_workers = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] per_volume_size_limit = -1 {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] periodic_fuzzy_delay = 60 {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] periodic_interval = 60 {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] project_id_regex = [0-9a-f\-]+ {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] public_endpoint = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] publish_errors = False {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] quota_backup_gigabytes = 1000 {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] quota_backups = 10 {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] quota_gigabytes = 1000 {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] quota_groups = 10 {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] quota_snapshots = 10 {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] quota_volumes = 10 {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] rate_limit_burst = 0 {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] rate_limit_except_level = CRITICAL {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] rate_limit_interval = 0 {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] reinit_driver_count = 3 {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] replication_device = **** {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] report_discard_supported = False {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] report_interval = 120 {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] reservation_clean_interval = 86400 {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] reservation_expire = 86400 {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] reserved_image_namespaces = [] {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] reserved_percentage = 0 {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] rpc_response_timeout = 120 {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] run_external_periodic_tasks = True {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] scst_target_driver = iscsi {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] scst_target_iqn_name = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] service_down_time = 720 {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] shell_completion = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] snapshot_name_template = snapshot-%s {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] split_loggers = False {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] state_path = /opt/stack/data/cinder {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] storage_availability_zone = nova {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] storage_protocol = iSCSI {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] syslog_log_facility = LOG_USER {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] target_helper = lioadm {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] target_ip_address = 192.168.122.202 {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] target_port = 3260 {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] target_protocol = iscsi {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] target_secondary_ip_addresses = [] {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] trace_flags = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] transfer_api_class = cinder.transfer.api.API {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] transport_url = **** {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] until_refresh = 0 {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] use_chap_auth = False {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] use_default_quota_class = True {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] use_journal = False {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] use_json = False {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] use_multipath_for_image_xfer = False {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] use_stderr = False {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] use_syslog = False {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] verify_glance_signatures = enabled {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] volume_api_class = cinder.volume.api.API {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] volume_backend_name = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] volume_clear = zero {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] volume_clear_ionice = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] volume_clear_size = 0 {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] volume_copy_bps_limit = 0 {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] volume_dd_blocksize = 1M {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] volume_name_template = volume-%s {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] volume_service_inithost_offload = False {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] volume_usage_audit_period = month {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] zoning_mode = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] oslo_concurrency.disable_process_locking = False {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] keystone_authtoken.auth_section = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] keystone_authtoken.auth_type = password {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] keystone_authtoken.auth_version = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] keystone_authtoken.cache = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] keystone_authtoken.certfile = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] keystone_authtoken.delay_auth_decision = False {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] keystone_authtoken.http_connect_timeout = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] keystone_authtoken.include_service_catalog = True {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] keystone_authtoken.insecure = False {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] keystone_authtoken.interface = public {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] keystone_authtoken.keyfile = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] keystone_authtoken.memcache_password = **** {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] keystone_authtoken.memcache_username = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] keystone_authtoken.region_name = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] keystone_authtoken.service_token_roles_required = True {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] keystone_authtoken.service_type = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] keystone_authtoken.token_cache_time = 300 {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.202/identity {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] cache.backend = dogpile.cache.null {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] cache.backend_argument = **** {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] cache.backend_expiration_time = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] cache.config_prefix = cache.oslo {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] cache.debug_cache_backend = False {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] cache.enable_retry_client = False {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] cache.enable_socket_keepalive = False {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] cache.enabled = False {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] cache.expiration_time = 600 {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] cache.hashclient_retry_attempts = 2 {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] cache.memcache_dead_retry = 300 {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] cache.memcache_pool_maxsize = 10 {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] cache.memcache_sasl_enabled = False {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-ea72abaf-737b-4fbf-bf92-ff8c5ff9cf80 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86111) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] cache.password = **** {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[86111]: WARNING cinder.volume.drivers.quobyte [None req-ea72abaf-737b-4fbf-bf92-ff8c5ff9cf80 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] cache.proxies = [] {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] cache.redis_db = 0 {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] cache.redis_sentinel_service_name = mymaster {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] cache.redis_server = localhost:6379 {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] cache.retry_attempts = 2 {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[86111]: WARNING cinder.volume.drivers.quobyte [None req-ea72abaf-737b-4fbf-bf92-ff8c5ff9cf80 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] cache.retry_delay = 0.0 {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] cache.socket_keepalive_count = 1 {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] cache.socket_keepalive_idle = 1 {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-ea72abaf-737b-4fbf-bf92-ff8c5ff9cf80 None None] Running cmd (subprocess): mount.quobyte {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] cache.socket_keepalive_interval = 1 {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] cache.socket_timeout = 1.0 {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] cache.tls_allowed_ciphers = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] cache.tls_cafile = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] cache.tls_certfile = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] cache.tls_enabled = False {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] cache.tls_keyfile = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] cache.username = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] coordination.backend_url = **** {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] database.asyncio_connection = **** {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] database.asyncio_slave_connection = **** {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] database.backend = sqlalchemy {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] database.connection = **** {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] database.connection_debug = 0 {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] database.connection_parameters = {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] database.connection_recycle_time = 3600 {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] database.connection_trace = False {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] database.db_inc_retry_interval = True {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] database.db_max_retries = 20 {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] database.db_max_retry_interval = 10 {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] database.db_retry_interval = 1 {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] database.max_overflow = 50 {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] database.max_pool_size = 5 {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] database.max_retries = 10 {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] database.mysql_wsrep_sync_wait = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] database.pool_timeout = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] database.retry_interval = 10 {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] database.slave_connection = **** {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] database.sqlite_synchronous = True {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] database.synchronous_reader = True {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] database.use_db_reconnect = False {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] oslo_messaging_tracing.insecure = False {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] profiler.connection_string = messaging:// {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] profiler.enabled = False {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] profiler.es_doc_type = notification {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] profiler.es_scroll_size = 10000 {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] profiler.es_scroll_time = 2m {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] profiler.filter_error_trace = False {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] profiler.hmac_keys = **** {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] profiler.sentinel_service_name = mymaster {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] profiler.socket_timeout = 0.1 {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] profiler.trace_requests = False {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] profiler.trace_sqlalchemy = False {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] profiler_jaeger.process_tags = {} {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] profiler_jaeger.service_name_prefix = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] profiler_otlp.service_name_prefix = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] oslo_policy.enforce_new_defaults = True {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] oslo_policy.policy_default_rule = default {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] oslo_policy.policy_file = policy.yaml {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] oslo_policy.remote_timeout = 60.0 {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] privsep_osbrick.group = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] privsep_osbrick.helper_command = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] privsep_osbrick.user = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] cinder_sys_admin.group = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] cinder_sys_admin.helper_command = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] cinder_sys_admin.user = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] service_user.auth_section = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] service_user.auth_type = password {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] service_user.cafile = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] service_user.certfile = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] service_user.collect_timing = False {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] service_user.insecure = False {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] service_user.keyfile = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] service_user.send_service_user_token = True {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] service_user.split_loggers = False {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] service_user.timeout = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] glance.auth_section = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] glance.auth_type = password {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] glance.certfile = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] glance.collect_timing = False {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] glance.insecure = False {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] glance.keyfile = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] glance.region_name = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] glance.split_loggers = False {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] glance.timeout = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] backend_defaults.backend_availability_zone = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] backend_defaults.chap_password = **** {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] backend_defaults.chap_username = {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] backend_defaults.disk_geometry = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] backend_defaults.driver_client_cert = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] backend_defaults.driver_client_cert_key = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] backend_defaults.driver_data_namespace = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] backend_defaults.driver_use_ssl = False {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] backend_defaults.enable_unsupported_driver = False {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] backend_defaults.extra_capabilities = {} {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] backend_defaults.filter_function = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] backend_defaults.goodness_function = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] backend_defaults.iscsi_target_flags = {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] backend_defaults.iscsi_write_cache = on {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] backend_defaults.iser_helper = tgtadm {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] backend_defaults.iser_ip_address = 192.168.122.202 {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] backend_defaults.iser_port = 3260 {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack quobyte-client[86112]: Reading configuration file: /etc/quobyte/client.cfg Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] backend_defaults.nas_host = {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] backend_defaults.nas_login = admin {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack quobyte-client[86112]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] backend_defaults.nas_mount_options = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] backend_defaults.nas_password = **** {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] backend_defaults.nas_private_key = {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] backend_defaults.nas_share_path = {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] backend_defaults.nas_ssh_port = 22 {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-ea72abaf-737b-4fbf-bf92-ff8c5ff9cf80 None None] CMD "mount.quobyte" returned: 1 in 0.048s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-ea72abaf-737b-4fbf-bf92-ff8c5ff9cf80 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] backend_defaults.num_shell_tries = 3 {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-ea72abaf-737b-4fbf-bf92-ff8c5ff9cf80 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-ea72abaf-737b-4fbf-bf92-ff8c5ff9cf80 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] backend_defaults.nvmet_port_id = 1 {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] backend_defaults.quobyte_client_cfg = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] backend_defaults.quobyte_volume_url = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] backend_defaults.replication_device = **** {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] backend_defaults.report_discard_supported = False {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] backend_defaults.reserved_percentage = 0 {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] backend_defaults.scst_target_driver = iscsi {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] backend_defaults.scst_target_iqn_name = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] backend_defaults.storage_protocol = iSCSI {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] backend_defaults.target_helper = tgtadm {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] backend_defaults.target_ip_address = 192.168.122.202 {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] backend_defaults.target_port = 3260 {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] backend_defaults.target_protocol = iscsi {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-ea72abaf-737b-4fbf-bf92-ff8c5ff9cf80 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-ea72abaf-737b-4fbf-bf92-ff8c5ff9cf80 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] backend_defaults.trace_flags = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] backend_defaults.unique_fqdn_network = True {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-ea72abaf-737b-4fbf-bf92-ff8c5ff9cf80 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] backend_defaults.use_chap_auth = False {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] backend_defaults.volume_backend_name = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] backend_defaults.volume_clear = zero {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] backend_defaults.volume_clear_ionice = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] backend_defaults.volume_clear_size = 0 {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] oslo_reports.file_event_handler = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] oslo_reports.log_dir = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] QuobyteHD.backend_availability_zone = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] QuobyteHD.backend_host = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] QuobyteHD.chap_password = **** {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] QuobyteHD.chap_username = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] QuobyteHD.chiscsi_conf = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] QuobyteHD.disk_geometry = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] QuobyteHD.driver_client_cert = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] QuobyteHD.driver_client_cert_key = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] QuobyteHD.driver_data_namespace = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] QuobyteHD.driver_use_ssl = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] QuobyteHD.extra_capabilities = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] QuobyteHD.filter_function = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] QuobyteHD.goodness_function = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] QuobyteHD.iscsi_target_flags = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] QuobyteHD.iscsi_write_cache = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] QuobyteHD.iser_helper = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] QuobyteHD.iser_ip_address = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] QuobyteHD.iser_port = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] QuobyteHD.iser_target_prefix = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] QuobyteHD.nas_host = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] QuobyteHD.nas_login = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] QuobyteHD.nas_mount_options = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] QuobyteHD.nas_password = **** {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] QuobyteHD.nas_private_key = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] QuobyteHD.nas_share_path = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] QuobyteHD.nas_ssh_port = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] QuobyteHD.num_shell_tries = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] QuobyteHD.nvmet_ns_id = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] QuobyteHD.nvmet_port_id = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack sudo[86113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] QuobyteHD.replication_device = **** {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] QuobyteHD.report_discard_supported = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] QuobyteHD.reserved_percentage = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] QuobyteHD.scst_target_driver = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack sudo[86113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] QuobyteHD.storage_protocol = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] QuobyteHD.target_helper = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] QuobyteHD.target_ip_address = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] QuobyteHD.target_port = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] QuobyteHD.target_prefix = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] QuobyteHD.target_protocol = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] QuobyteHD.trace_flags = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] QuobyteHD.unique_fqdn_network = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] QuobyteHD.use_chap_auth = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] QuobyteHD.volume_clear = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] QuobyteHD.volume_clear_ionice = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] QuobyteHD.volume_clear_size = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] QuobyteHD.volumes_dir = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] oslo_messaging_rabbit.ssl = False {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] oslo_messaging_rabbit.ssl_version = {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] oslo_messaging_notifications.driver = [] {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] oslo_messaging_notifications.retry = -1 {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] oslo_messaging_notifications.transport_url = **** {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] key_manager.fixed_key = **** {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] barbican.barbican_api_version = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] barbican.barbican_endpoint = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] barbican.barbican_endpoint_type = public {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] barbican.barbican_region_name = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] barbican.cafile = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] barbican.certfile = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] barbican.collect_timing = False {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] barbican.insecure = False {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] barbican.keyfile = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] barbican.number_of_retries = 60 {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] barbican.retry_delay = 1 {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] barbican.send_service_user_token = False {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] barbican.split_loggers = False {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] barbican.timeout = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] barbican.verify_ssl = True {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] barbican.verify_ssl_path = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] barbican_service_user.auth_section = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] barbican_service_user.auth_type = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] barbican_service_user.cafile = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] barbican_service_user.certfile = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] barbican_service_user.collect_timing = False {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] barbican_service_user.insecure = False {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] barbican_service_user.keyfile = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] barbican_service_user.split_loggers = False {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] barbican_service_user.timeout = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] vault.approle_role_id = **** {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] vault.approle_secret_id = **** {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] vault.auth_method = approle {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] vault.auth_path = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] vault.kv_mountpoint = secret {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] vault.kv_path = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] vault.kv_version = 2 {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] vault.namespace = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] vault.root_token_id = **** {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] vault.ssl_ca_crt_file = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] vault.timeout = 60.0 {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] vault.token_file = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] vault.token_role = None {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] vault.use_ssl = False {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 29 01:08:40 devstack cinder-volume[85816]: DEBUG oslo_service.backend._eventlet.service [None req-a6646bdb-2910-45f8-b1b5-60d12e6569e7 None None] ******************************************************************************** {{(pid=85816) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Aug 29 01:08:40 devstack sudo[86113]: pam_unix(sudo:session): session closed for user root Aug 29 01:08:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-ea72abaf-737b-4fbf-bf92-ff8c5ff9cf80 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.237s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:08:40 devstack cinder-volume[86111]: INFO cinder.volume.driver [None req-ea72abaf-737b-4fbf-bf92-ff8c5ff9cf80 None None] Driver hasn't implemented _init_vendor_properties() Aug 29 01:08:40 devstack cinder-volume[86111]: DEBUG cinder.volume.driver [None req-ea72abaf-737b-4fbf-bf92-ff8c5ff9cf80 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.433609008789, 'free_capacity_gb': 1774.433609008789, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86111) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Aug 29 01:08:41 devstack cinder-volume[86111]: DEBUG oslo_db.sqlalchemy.engines [None req-ea72abaf-737b-4fbf-bf92-ff8c5ff9cf80 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86111) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 29 01:08:41 devstack cinder-volume[86111]: DEBUG dbcounter [-] [86111] Writer thread running {{(pid=86111) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 29 01:08:41 devstack cinder-volume[86111]: DEBUG cinder.db.api [None req-ea72abaf-737b-4fbf-bf92-ff8c5ff9cf80 None None] Building query based on filter {{(pid=86111) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Aug 29 01:08:41 devstack cinder-volume[86111]: DEBUG cinder.image.image_utils [None req-ea72abaf-737b-4fbf-bf92-ff8c5ff9cf80 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86111) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Aug 29 01:08:41 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-ea72abaf-737b-4fbf-bf92-ff8c5ff9cf80 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:08:41 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-ea72abaf-737b-4fbf-bf92-ff8c5ff9cf80 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:08:41 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-ea72abaf-737b-4fbf-bf92-ff8c5ff9cf80 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:08:41 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-ea72abaf-737b-4fbf-bf92-ff8c5ff9cf80 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:08:41 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-ea72abaf-737b-4fbf-bf92-ff8c5ff9cf80 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:08:41 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-ea72abaf-737b-4fbf-bf92-ff8c5ff9cf80 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:08:41 devstack cinder-volume[86111]: INFO cinder.keymgr.migration [None req-beff8a73-3089-49a2-aaa5-64bdf0ef914a None None] Not migrating encryption keys because the ConfKeyManager is still in use. Aug 29 01:08:41 devstack sudo[86124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:08:41 devstack sudo[86124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:08:41 devstack sudo[86124]: pam_unix(sudo:session): session closed for user root Aug 29 01:08:41 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-ea72abaf-737b-4fbf-bf92-ff8c5ff9cf80 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.246s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:08:41 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-ea72abaf-737b-4fbf-bf92-ff8c5ff9cf80 None None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:08:41 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-ea72abaf-737b-4fbf-bf92-ff8c5ff9cf80 None None] Driver initialization completed successfully. Aug 29 01:08:41 devstack cinder-volume[86111]: INFO cinder.manager [None req-ea72abaf-737b-4fbf-bf92-ff8c5ff9cf80 None None] Initiating service 3 cleanup Aug 29 01:08:41 devstack cinder-volume[86111]: INFO cinder.manager [None req-ea72abaf-737b-4fbf-bf92-ff8c5ff9cf80 None None] Service 3 cleanup completed. Aug 29 01:08:41 devstack cinder-volume[86111]: DEBUG cinder.service [None req-ea72abaf-737b-4fbf-bf92-ff8c5ff9cf80 None None] Creating RPC server for service cinder-volume {{(pid=86111) start /opt/stack/cinder/cinder/service.py:231}} Aug 29 01:08:41 devstack cinder-volume[86111]: DEBUG cinder.service [None req-ea72abaf-737b-4fbf-bf92-ff8c5ff9cf80 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86111) start /opt/stack/cinder/cinder/service.py:237}} Aug 29 01:08:41 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-ea72abaf-737b-4fbf-bf92-ff8c5ff9cf80 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Aug 29 01:08:41 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-ea72abaf-737b-4fbf-bf92-ff8c5ff9cf80 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:08:41 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-ea72abaf-737b-4fbf-bf92-ff8c5ff9cf80 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:08:41 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-ea72abaf-737b-4fbf-bf92-ff8c5ff9cf80 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:08:41 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-ea72abaf-737b-4fbf-bf92-ff8c5ff9cf80 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:08:41 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-ea72abaf-737b-4fbf-bf92-ff8c5ff9cf80 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:08:41 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-ea72abaf-737b-4fbf-bf92-ff8c5ff9cf80 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:08:41 devstack sudo[86135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:08:41 devstack sudo[86135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:08:41 devstack sudo[86135]: pam_unix(sudo:session): session closed for user root Aug 29 01:08:41 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-ea72abaf-737b-4fbf-bf92-ff8c5ff9cf80 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.247s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:08:41 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-ea72abaf-737b-4fbf-bf92-ff8c5ff9cf80 None None] Driver post RPC initialization completed successfully. Aug 29 01:08:50 devstack cinder-volume[85816]: DEBUG dbcounter [-] [85816] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=85816) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 29 01:08:51 devstack cinder-volume[86111]: DEBUG dbcounter [-] [86111] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=86111) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 29 01:08:51 devstack cinder-volume[86111]: DEBUG dbcounter [-] [86111] Writing DB stats cinder:SELECT=2 {{(pid=86111) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 29 01:09:40 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c7e665a-96e5-40d8-ab7f-8d0eecc3852b tempest-VolumesTestJSON-225754658 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:09:40 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-3c7e665a-96e5-40d8-ab7f-8d0eecc3852b tempest-VolumesTestJSON-225754658 None] Flow 'volume_create_manager' (e32f6791-8bce-4191-9d0a-7295d26ac76d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:09:40 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-3c7e665a-96e5-40d8-ab7f-8d0eecc3852b tempest-VolumesTestJSON-225754658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0195ab1-1cbb-460e-a596-844f32eda99b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:09:40 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-3c7e665a-96e5-40d8-ab7f-8d0eecc3852b tempest-VolumesTestJSON-225754658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0195ab1-1cbb-460e-a596-844f32eda99b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:08:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-819582148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01871fa1-c462-4528-adfd-bdb5ff6114d6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='56b99a7ebcdc498594d562060025ceb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:09:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:09:40Z,use_quota=True,user_id='abd440a8c57b42ecab16b1ff3932100c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:09:40 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-3c7e665a-96e5-40d8-ab7f-8d0eecc3852b tempest-VolumesTestJSON-225754658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (159273ae-1452-41d6-b3d4-0eb95ac14ac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:09:40 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-3c7e665a-96e5-40d8-ab7f-8d0eecc3852b tempest-VolumesTestJSON-225754658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (159273ae-1452-41d6-b3d4-0eb95ac14ac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:09:40 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-3c7e665a-96e5-40d8-ab7f-8d0eecc3852b tempest-VolumesTestJSON-225754658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1561d80f-74e2-41a9-9eea-65089862a671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:09:40 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-3c7e665a-96e5-40d8-ab7f-8d0eecc3852b tempest-VolumesTestJSON-225754658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1561d80f-74e2-41a9-9eea-65089862a671) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01871fa1-c462-4528-adfd-bdb5ff6114d6', 'volume_name': 'volume-01871fa1-c462-4528-adfd-bdb5ff6114d6', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:09:40 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-3c7e665a-96e5-40d8-ab7f-8d0eecc3852b tempest-VolumesTestJSON-225754658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1f8a5c9-d4df-4cbc-8aaf-8c2e3e486fd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:09:40 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-3c7e665a-96e5-40d8-ab7f-8d0eecc3852b tempest-VolumesTestJSON-225754658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1f8a5c9-d4df-4cbc-8aaf-8c2e3e486fd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:09:40 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-3c7e665a-96e5-40d8-ab7f-8d0eecc3852b tempest-VolumesTestJSON-225754658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b353abe5-16e6-4886-9bb4-93fe330ffcce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:09:40 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-3c7e665a-96e5-40d8-ab7f-8d0eecc3852b tempest-VolumesTestJSON-225754658 None] Volume 01871fa1-c462-4528-adfd-bdb5ff6114d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01871fa1-c462-4528-adfd-bdb5ff6114d6', 'volume_size': 1} Aug 29 01:09:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-3c7e665a-96e5-40d8-ab7f-8d0eecc3852b tempest-VolumesTestJSON-225754658 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:09:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-3c7e665a-96e5-40d8-ab7f-8d0eecc3852b tempest-VolumesTestJSON-225754658 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:09:40 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-3c7e665a-96e5-40d8-ab7f-8d0eecc3852b tempest-VolumesTestJSON-225754658 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:08:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-819582148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01871fa1-c462-4528-adfd-bdb5ff6114d6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='56b99a7ebcdc498594d562060025ceb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:09:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:09:40Z,use_quota=True,user_id='abd440a8c57b42ecab16b1ff3932100c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:09:40 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-3c7e665a-96e5-40d8-ab7f-8d0eecc3852b tempest-VolumesTestJSON-225754658 None] Creating volume 01871fa1-c462-4528-adfd-bdb5ff6114d6 {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:09:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-3c7e665a-96e5-40d8-ab7f-8d0eecc3852b tempest-VolumesTestJSON-225754658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:09:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-3c7e665a-96e5-40d8-ab7f-8d0eecc3852b tempest-VolumesTestJSON-225754658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:09:40 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-3c7e665a-96e5-40d8-ab7f-8d0eecc3852b tempest-VolumesTestJSON-225754658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:09:40 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-3c7e665a-96e5-40d8-ab7f-8d0eecc3852b tempest-VolumesTestJSON-225754658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:09:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-3c7e665a-96e5-40d8-ab7f-8d0eecc3852b tempest-VolumesTestJSON-225754658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:09:40 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-3c7e665a-96e5-40d8-ab7f-8d0eecc3852b tempest-VolumesTestJSON-225754658 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:09:40 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-3c7e665a-96e5-40d8-ab7f-8d0eecc3852b tempest-VolumesTestJSON-225754658 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:09:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-3c7e665a-96e5-40d8-ab7f-8d0eecc3852b tempest-VolumesTestJSON-225754658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-01871fa1-c462-4528-adfd-bdb5ff6114d6 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:09:40 devstack sudo[86636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-01871fa1-c462-4528-adfd-bdb5ff6114d6 1073741824 Aug 29 01:09:40 devstack sudo[86636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:09:40 devstack cinder-volume[86111]: DEBUG oslo_service.periodic_task [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86111) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 29 01:09:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:09:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:09:40 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:09:40 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:09:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:09:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:09:40 devstack sudo[86638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:09:40 devstack sudo[86638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:09:41 devstack sudo[86638]: pam_unix(sudo:session): session closed for user root Aug 29 01:09:41 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-de752545-d617-440e-8362-d04fae0901a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.445s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:09:41 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:09:41 devstack cinder-volume[86111]: DEBUG oslo_service.periodic_task [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Running periodic task VolumeManager._thread_info {{(pid=86111) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 29 01:09:41 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-de752545-d617-440e-8362-d04fae0901a5 None None] thread count: 6 {{(pid=86111) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 29 01:09:41 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-de752545-d617-440e-8362-d04fae0901a5 None None] thread info: [<_MainThread(MainThread, started 129173440548992)>, , , , , ] {{(pid=86111) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 29 01:09:41 devstack sudo[86636]: pam_unix(sudo:session): session closed for user root Aug 29 01:09:41 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-3c7e665a-96e5-40d8-ab7f-8d0eecc3852b tempest-VolumesTestJSON-225754658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-01871fa1-c462-4528-adfd-bdb5ff6114d6 1073741824" returned: 0 in 1.232s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:09:41 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-3c7e665a-96e5-40d8-ab7f-8d0eecc3852b tempest-VolumesTestJSON-225754658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-01871fa1-c462-4528-adfd-bdb5ff6114d6 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:09:41 devstack sudo[86984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-01871fa1-c462-4528-adfd-bdb5ff6114d6 Aug 29 01:09:41 devstack sudo[86984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:09:42 devstack sudo[86984]: pam_unix(sudo:session): session closed for user root Aug 29 01:09:42 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-3c7e665a-96e5-40d8-ab7f-8d0eecc3852b tempest-VolumesTestJSON-225754658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-01871fa1-c462-4528-adfd-bdb5ff6114d6" returned: 0 in 0.564s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:09:42 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-3c7e665a-96e5-40d8-ab7f-8d0eecc3852b tempest-VolumesTestJSON-225754658 None] <== create_volume: return (1900ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:09:42 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-3c7e665a-96e5-40d8-ab7f-8d0eecc3852b tempest-VolumesTestJSON-225754658 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.902s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:09:42 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-3c7e665a-96e5-40d8-ab7f-8d0eecc3852b tempest-VolumesTestJSON-225754658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b353abe5-16e6-4886-9bb4-93fe330ffcce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01871fa1-c462-4528-adfd-bdb5ff6114d6', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:09:42 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-3c7e665a-96e5-40d8-ab7f-8d0eecc3852b tempest-VolumesTestJSON-225754658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49302d9e-c128-4adc-8394-941d93aafd87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:09:42 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-3c7e665a-96e5-40d8-ab7f-8d0eecc3852b tempest-VolumesTestJSON-225754658 None] Volume volume-01871fa1-c462-4528-adfd-bdb5ff6114d6 (01871fa1-c462-4528-adfd-bdb5ff6114d6): created successfully Aug 29 01:09:42 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-3c7e665a-96e5-40d8-ab7f-8d0eecc3852b tempest-VolumesTestJSON-225754658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49302d9e-c128-4adc-8394-941d93aafd87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:09:42 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-3c7e665a-96e5-40d8-ab7f-8d0eecc3852b tempest-VolumesTestJSON-225754658 None] Flow 'volume_create_manager' (e32f6791-8bce-4191-9d0a-7295d26ac76d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:09:42 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-3c7e665a-96e5-40d8-ab7f-8d0eecc3852b tempest-VolumesTestJSON-225754658 None] Created volume successfully. Aug 29 01:09:44 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3c886f8-9399-44ca-8fe4-1d8bca92e04c tempest-VolumesTestJSON-225754658 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:09:44 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-d3c886f8-9399-44ca-8fe4-1d8bca92e04c tempest-VolumesTestJSON-225754658 None] Flow 'volume_create_manager' (418cfe43-86c7-4c82-ba19-d7c9b31fa11e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:09:44 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-d3c886f8-9399-44ca-8fe4-1d8bca92e04c tempest-VolumesTestJSON-225754658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c4f881d-939f-44b6-a12b-0422d80deb3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:09:44 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-d3c886f8-9399-44ca-8fe4-1d8bca92e04c tempest-VolumesTestJSON-225754658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c4f881d-939f-44b6-a12b-0422d80deb3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:09:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1115881943',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=519e4bcc-9c1c-49b5-833e-e57f1ee608ee,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='56b99a7ebcdc498594d562060025ceb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:09:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:09:44Z,use_quota=True,user_id='abd440a8c57b42ecab16b1ff3932100c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:09:44 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-d3c886f8-9399-44ca-8fe4-1d8bca92e04c tempest-VolumesTestJSON-225754658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (332f04d2-98a6-45c1-8872-0d2f7e7159b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:09:44 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-d3c886f8-9399-44ca-8fe4-1d8bca92e04c tempest-VolumesTestJSON-225754658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (332f04d2-98a6-45c1-8872-0d2f7e7159b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:09:44 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-d3c886f8-9399-44ca-8fe4-1d8bca92e04c tempest-VolumesTestJSON-225754658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b75cedac-930c-4134-9e09-853b4afda1e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:09:44 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-d3c886f8-9399-44ca-8fe4-1d8bca92e04c tempest-VolumesTestJSON-225754658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b75cedac-930c-4134-9e09-853b4afda1e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '519e4bcc-9c1c-49b5-833e-e57f1ee608ee', 'volume_name': 'volume-519e4bcc-9c1c-49b5-833e-e57f1ee608ee', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:09:44 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-d3c886f8-9399-44ca-8fe4-1d8bca92e04c tempest-VolumesTestJSON-225754658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6efc6fbc-e0ce-4b6e-b431-5e28d08e12f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:09:44 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-d3c886f8-9399-44ca-8fe4-1d8bca92e04c tempest-VolumesTestJSON-225754658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6efc6fbc-e0ce-4b6e-b431-5e28d08e12f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:09:44 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-d3c886f8-9399-44ca-8fe4-1d8bca92e04c tempest-VolumesTestJSON-225754658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bab74664-62a4-4444-90e2-970ff8534cb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:09:44 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-d3c886f8-9399-44ca-8fe4-1d8bca92e04c tempest-VolumesTestJSON-225754658 None] Volume 519e4bcc-9c1c-49b5-833e-e57f1ee608ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-519e4bcc-9c1c-49b5-833e-e57f1ee608ee', 'volume_size': 1} Aug 29 01:09:44 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-d3c886f8-9399-44ca-8fe4-1d8bca92e04c tempest-VolumesTestJSON-225754658 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:09:44 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-d3c886f8-9399-44ca-8fe4-1d8bca92e04c tempest-VolumesTestJSON-225754658 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:09:44 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-d3c886f8-9399-44ca-8fe4-1d8bca92e04c tempest-VolumesTestJSON-225754658 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:09:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1115881943',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=519e4bcc-9c1c-49b5-833e-e57f1ee608ee,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='56b99a7ebcdc498594d562060025ceb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:09:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:09:44Z,use_quota=True,user_id='abd440a8c57b42ecab16b1ff3932100c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:09:44 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-d3c886f8-9399-44ca-8fe4-1d8bca92e04c tempest-VolumesTestJSON-225754658 None] Creating volume 519e4bcc-9c1c-49b5-833e-e57f1ee608ee {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:09:44 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-d3c886f8-9399-44ca-8fe4-1d8bca92e04c tempest-VolumesTestJSON-225754658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:09:44 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-d3c886f8-9399-44ca-8fe4-1d8bca92e04c tempest-VolumesTestJSON-225754658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:09:44 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-d3c886f8-9399-44ca-8fe4-1d8bca92e04c tempest-VolumesTestJSON-225754658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:09:44 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-d3c886f8-9399-44ca-8fe4-1d8bca92e04c tempest-VolumesTestJSON-225754658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:09:44 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-d3c886f8-9399-44ca-8fe4-1d8bca92e04c tempest-VolumesTestJSON-225754658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:09:44 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-d3c886f8-9399-44ca-8fe4-1d8bca92e04c tempest-VolumesTestJSON-225754658 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:09:44 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-d3c886f8-9399-44ca-8fe4-1d8bca92e04c tempest-VolumesTestJSON-225754658 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:09:44 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d3c886f8-9399-44ca-8fe4-1d8bca92e04c tempest-VolumesTestJSON-225754658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-519e4bcc-9c1c-49b5-833e-e57f1ee608ee 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:09:44 devstack sudo[87039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-519e4bcc-9c1c-49b5-833e-e57f1ee608ee 1073741824 Aug 29 01:09:44 devstack sudo[87039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:09:45 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-d69b1492-f2a3-482f-8f8d-c1605f6a3f54 tempest-DeleteServersTestJSON-1077080811 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:09:45 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-d69b1492-f2a3-482f-8f8d-c1605f6a3f54 tempest-DeleteServersTestJSON-1077080811 None] Flow 'volume_create_manager' (24d286d6-9534-4b41-bb3d-384b8ed5a411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:09:45 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-d69b1492-f2a3-482f-8f8d-c1605f6a3f54 tempest-DeleteServersTestJSON-1077080811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96dfa437-29ac-4413-9d5c-97bfb44375cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:09:45 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-d69b1492-f2a3-482f-8f8d-c1605f6a3f54 tempest-DeleteServersTestJSON-1077080811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96dfa437-29ac-4413-9d5c-97bfb44375cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:09:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-824797846',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4edb1d3-95d6-42f6-968e-7be209624c1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9c9cb164f384e259a395f9ddaf66840',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:09:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:09:45Z,use_quota=True,user_id='64ae08eb91d44cd69895293a932739ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:09:45 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-d69b1492-f2a3-482f-8f8d-c1605f6a3f54 tempest-DeleteServersTestJSON-1077080811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fb22d92-f162-4bd3-a623-56ba0f59b3e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:09:45 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-d69b1492-f2a3-482f-8f8d-c1605f6a3f54 tempest-DeleteServersTestJSON-1077080811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fb22d92-f162-4bd3-a623-56ba0f59b3e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:09:45 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-d69b1492-f2a3-482f-8f8d-c1605f6a3f54 tempest-DeleteServersTestJSON-1077080811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3100776-3304-4f1a-a2af-3d4eceddd429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:09:45 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-d69b1492-f2a3-482f-8f8d-c1605f6a3f54 tempest-DeleteServersTestJSON-1077080811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3100776-3304-4f1a-a2af-3d4eceddd429) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4edb1d3-95d6-42f6-968e-7be209624c1a', 'volume_name': 'volume-a4edb1d3-95d6-42f6-968e-7be209624c1a', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:09:45 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-d69b1492-f2a3-482f-8f8d-c1605f6a3f54 tempest-DeleteServersTestJSON-1077080811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d64a6a6-b025-4f99-a742-dd562145c58d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:09:45 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-d69b1492-f2a3-482f-8f8d-c1605f6a3f54 tempest-DeleteServersTestJSON-1077080811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d64a6a6-b025-4f99-a742-dd562145c58d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:09:45 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-d69b1492-f2a3-482f-8f8d-c1605f6a3f54 tempest-DeleteServersTestJSON-1077080811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fd325ab-0012-41e7-bad7-0946ee29ad79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:09:45 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-d69b1492-f2a3-482f-8f8d-c1605f6a3f54 tempest-DeleteServersTestJSON-1077080811 None] Volume a4edb1d3-95d6-42f6-968e-7be209624c1a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4edb1d3-95d6-42f6-968e-7be209624c1a', 'volume_size': 1} Aug 29 01:09:45 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-d69b1492-f2a3-482f-8f8d-c1605f6a3f54 tempest-DeleteServersTestJSON-1077080811 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:09:46 devstack sudo[87039]: pam_unix(sudo:session): session closed for user root Aug 29 01:09:46 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d3c886f8-9399-44ca-8fe4-1d8bca92e04c tempest-VolumesTestJSON-225754658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-519e4bcc-9c1c-49b5-833e-e57f1ee608ee 1073741824" returned: 0 in 1.231s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:09:46 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d3c886f8-9399-44ca-8fe4-1d8bca92e04c tempest-VolumesTestJSON-225754658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-519e4bcc-9c1c-49b5-833e-e57f1ee608ee {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:09:46 devstack sudo[87096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-519e4bcc-9c1c-49b5-833e-e57f1ee608ee Aug 29 01:09:46 devstack sudo[87096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:09:46 devstack sudo[87096]: pam_unix(sudo:session): session closed for user root Aug 29 01:09:46 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d3c886f8-9399-44ca-8fe4-1d8bca92e04c tempest-VolumesTestJSON-225754658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-519e4bcc-9c1c-49b5-833e-e57f1ee608ee" returned: 0 in 0.527s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:09:46 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-d3c886f8-9399-44ca-8fe4-1d8bca92e04c tempest-VolumesTestJSON-225754658 None] <== create_volume: return (1882ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:09:46 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-d3c886f8-9399-44ca-8fe4-1d8bca92e04c tempest-VolumesTestJSON-225754658 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.887s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:09:46 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-d69b1492-f2a3-482f-8f8d-c1605f6a3f54 tempest-DeleteServersTestJSON-1077080811 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.478s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:09:46 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-d69b1492-f2a3-482f-8f8d-c1605f6a3f54 tempest-DeleteServersTestJSON-1077080811 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:09:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-824797846',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4edb1d3-95d6-42f6-968e-7be209624c1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9c9cb164f384e259a395f9ddaf66840',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:09:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:09:45Z,use_quota=True,user_id='64ae08eb91d44cd69895293a932739ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:09:46 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-d69b1492-f2a3-482f-8f8d-c1605f6a3f54 tempest-DeleteServersTestJSON-1077080811 None] Creating volume a4edb1d3-95d6-42f6-968e-7be209624c1a {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:09:46 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-d69b1492-f2a3-482f-8f8d-c1605f6a3f54 tempest-DeleteServersTestJSON-1077080811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:09:46 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-d69b1492-f2a3-482f-8f8d-c1605f6a3f54 tempest-DeleteServersTestJSON-1077080811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:09:46 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-d69b1492-f2a3-482f-8f8d-c1605f6a3f54 tempest-DeleteServersTestJSON-1077080811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:09:46 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-d69b1492-f2a3-482f-8f8d-c1605f6a3f54 tempest-DeleteServersTestJSON-1077080811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:09:46 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-d69b1492-f2a3-482f-8f8d-c1605f6a3f54 tempest-DeleteServersTestJSON-1077080811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:09:46 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-d69b1492-f2a3-482f-8f8d-c1605f6a3f54 tempest-DeleteServersTestJSON-1077080811 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:09:46 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-d69b1492-f2a3-482f-8f8d-c1605f6a3f54 tempest-DeleteServersTestJSON-1077080811 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:09:46 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d69b1492-f2a3-482f-8f8d-c1605f6a3f54 tempest-DeleteServersTestJSON-1077080811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a4edb1d3-95d6-42f6-968e-7be209624c1a 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:09:46 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-d3c886f8-9399-44ca-8fe4-1d8bca92e04c tempest-VolumesTestJSON-225754658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bab74664-62a4-4444-90e2-970ff8534cb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-519e4bcc-9c1c-49b5-833e-e57f1ee608ee', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:09:46 devstack sudo[87102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a4edb1d3-95d6-42f6-968e-7be209624c1a 1073741824 Aug 29 01:09:46 devstack sudo[87102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:09:46 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-d3c886f8-9399-44ca-8fe4-1d8bca92e04c tempest-VolumesTestJSON-225754658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (979fee22-8210-4213-93ce-c88b8524b2b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:09:46 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-d3c886f8-9399-44ca-8fe4-1d8bca92e04c tempest-VolumesTestJSON-225754658 None] Volume volume-519e4bcc-9c1c-49b5-833e-e57f1ee608ee (519e4bcc-9c1c-49b5-833e-e57f1ee608ee): created successfully Aug 29 01:09:46 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-d3c886f8-9399-44ca-8fe4-1d8bca92e04c tempest-VolumesTestJSON-225754658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (979fee22-8210-4213-93ce-c88b8524b2b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:09:46 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-d3c886f8-9399-44ca-8fe4-1d8bca92e04c tempest-VolumesTestJSON-225754658 None] Flow 'volume_create_manager' (418cfe43-86c7-4c82-ba19-d7c9b31fa11e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:09:46 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-d3c886f8-9399-44ca-8fe4-1d8bca92e04c tempest-VolumesTestJSON-225754658 None] Created volume successfully. Aug 29 01:09:47 devstack sudo[87102]: pam_unix(sudo:session): session closed for user root Aug 29 01:09:47 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d69b1492-f2a3-482f-8f8d-c1605f6a3f54 tempest-DeleteServersTestJSON-1077080811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a4edb1d3-95d6-42f6-968e-7be209624c1a 1073741824" returned: 0 in 1.246s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:09:48 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d69b1492-f2a3-482f-8f8d-c1605f6a3f54 tempest-DeleteServersTestJSON-1077080811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a4edb1d3-95d6-42f6-968e-7be209624c1a {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:09:48 devstack sudo[87123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a4edb1d3-95d6-42f6-968e-7be209624c1a Aug 29 01:09:48 devstack sudo[87123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:09:48 devstack sudo[87123]: pam_unix(sudo:session): session closed for user root Aug 29 01:09:48 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d69b1492-f2a3-482f-8f8d-c1605f6a3f54 tempest-DeleteServersTestJSON-1077080811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a4edb1d3-95d6-42f6-968e-7be209624c1a" returned: 0 in 0.708s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:09:48 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-d69b1492-f2a3-482f-8f8d-c1605f6a3f54 tempest-DeleteServersTestJSON-1077080811 None] <== create_volume: return (2060ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:09:48 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-d69b1492-f2a3-482f-8f8d-c1605f6a3f54 tempest-DeleteServersTestJSON-1077080811 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.064s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:09:48 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-d69b1492-f2a3-482f-8f8d-c1605f6a3f54 tempest-DeleteServersTestJSON-1077080811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fd325ab-0012-41e7-bad7-0946ee29ad79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4edb1d3-95d6-42f6-968e-7be209624c1a', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:09:48 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-d69b1492-f2a3-482f-8f8d-c1605f6a3f54 tempest-DeleteServersTestJSON-1077080811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef4983fa-8b4c-4fa9-adfd-efbef5cbaf52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:09:48 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-d69b1492-f2a3-482f-8f8d-c1605f6a3f54 tempest-DeleteServersTestJSON-1077080811 None] Volume volume-a4edb1d3-95d6-42f6-968e-7be209624c1a (a4edb1d3-95d6-42f6-968e-7be209624c1a): created successfully Aug 29 01:09:48 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-d69b1492-f2a3-482f-8f8d-c1605f6a3f54 tempest-DeleteServersTestJSON-1077080811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef4983fa-8b4c-4fa9-adfd-efbef5cbaf52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:09:48 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-d69b1492-f2a3-482f-8f8d-c1605f6a3f54 tempest-DeleteServersTestJSON-1077080811 None] Flow 'volume_create_manager' (24d286d6-9534-4b41-bb3d-384b8ed5a411) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:09:48 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-d69b1492-f2a3-482f-8f8d-c1605f6a3f54 tempest-DeleteServersTestJSON-1077080811 None] Created volume successfully. Aug 29 01:09:49 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a64404f-a8ed-4ad8-9834-306b42cd5002 tempest-VolumesTestJSON-225754658 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:09:49 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6a64404f-a8ed-4ad8-9834-306b42cd5002 tempest-VolumesTestJSON-225754658 None] Flow 'volume_create_manager' (d643c92a-ea89-4adb-9ec9-d1e0306730cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:09:49 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6a64404f-a8ed-4ad8-9834-306b42cd5002 tempest-VolumesTestJSON-225754658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (319b8fc7-9fee-4c9b-986d-605c3be3625a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:09:49 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6a64404f-a8ed-4ad8-9834-306b42cd5002 tempest-VolumesTestJSON-225754658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (319b8fc7-9fee-4c9b-986d-605c3be3625a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:09:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1559045526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64c2ce59-1b96-40ad-865f-c077fe703e1e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='56b99a7ebcdc498594d562060025ceb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:09:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:09:49Z,use_quota=True,user_id='abd440a8c57b42ecab16b1ff3932100c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:09:49 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6a64404f-a8ed-4ad8-9834-306b42cd5002 tempest-VolumesTestJSON-225754658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89453725-8f1e-4c6b-902c-5afac1e21016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:09:49 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6a64404f-a8ed-4ad8-9834-306b42cd5002 tempest-VolumesTestJSON-225754658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89453725-8f1e-4c6b-902c-5afac1e21016) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:09:49 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6a64404f-a8ed-4ad8-9834-306b42cd5002 tempest-VolumesTestJSON-225754658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (741a8c8e-9d99-48d9-80cd-04a6fc61c896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:09:49 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6a64404f-a8ed-4ad8-9834-306b42cd5002 tempest-VolumesTestJSON-225754658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (741a8c8e-9d99-48d9-80cd-04a6fc61c896) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64c2ce59-1b96-40ad-865f-c077fe703e1e', 'volume_name': 'volume-64c2ce59-1b96-40ad-865f-c077fe703e1e', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:09:49 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6a64404f-a8ed-4ad8-9834-306b42cd5002 tempest-VolumesTestJSON-225754658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ce8a4ae-fecc-4821-aa15-0ba7dcbf8e3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:09:49 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6a64404f-a8ed-4ad8-9834-306b42cd5002 tempest-VolumesTestJSON-225754658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ce8a4ae-fecc-4821-aa15-0ba7dcbf8e3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:09:49 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6a64404f-a8ed-4ad8-9834-306b42cd5002 tempest-VolumesTestJSON-225754658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27d8df7b-f3f1-413c-9892-7d5bd9308a5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:09:49 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-6a64404f-a8ed-4ad8-9834-306b42cd5002 tempest-VolumesTestJSON-225754658 None] Volume 64c2ce59-1b96-40ad-865f-c077fe703e1e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64c2ce59-1b96-40ad-865f-c077fe703e1e', 'volume_size': 1} Aug 29 01:09:49 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-6a64404f-a8ed-4ad8-9834-306b42cd5002 tempest-VolumesTestJSON-225754658 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:09:49 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-6a64404f-a8ed-4ad8-9834-306b42cd5002 tempest-VolumesTestJSON-225754658 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:09:49 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-6a64404f-a8ed-4ad8-9834-306b42cd5002 tempest-VolumesTestJSON-225754658 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:09:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1559045526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64c2ce59-1b96-40ad-865f-c077fe703e1e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='56b99a7ebcdc498594d562060025ceb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:09:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:09:49Z,use_quota=True,user_id='abd440a8c57b42ecab16b1ff3932100c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:09:49 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-6a64404f-a8ed-4ad8-9834-306b42cd5002 tempest-VolumesTestJSON-225754658 None] Creating volume 64c2ce59-1b96-40ad-865f-c077fe703e1e {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:09:49 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-6a64404f-a8ed-4ad8-9834-306b42cd5002 tempest-VolumesTestJSON-225754658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:09:49 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-6a64404f-a8ed-4ad8-9834-306b42cd5002 tempest-VolumesTestJSON-225754658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:09:49 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-6a64404f-a8ed-4ad8-9834-306b42cd5002 tempest-VolumesTestJSON-225754658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:09:49 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-6a64404f-a8ed-4ad8-9834-306b42cd5002 tempest-VolumesTestJSON-225754658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:09:49 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-6a64404f-a8ed-4ad8-9834-306b42cd5002 tempest-VolumesTestJSON-225754658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:09:49 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-6a64404f-a8ed-4ad8-9834-306b42cd5002 tempest-VolumesTestJSON-225754658 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:09:49 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-6a64404f-a8ed-4ad8-9834-306b42cd5002 tempest-VolumesTestJSON-225754658 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:09:49 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-6a64404f-a8ed-4ad8-9834-306b42cd5002 tempest-VolumesTestJSON-225754658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-64c2ce59-1b96-40ad-865f-c077fe703e1e 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:09:49 devstack sudo[87126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-64c2ce59-1b96-40ad-865f-c077fe703e1e 1073741824 Aug 29 01:09:49 devstack sudo[87126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:09:49 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-87a08298-364b-41ee-b788-67c351017b72 tempest-VolumesAdminNegativeTest-204853654 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:09:49 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-87a08298-364b-41ee-b788-67c351017b72 tempest-VolumesAdminNegativeTest-204853654 None] Flow 'volume_create_manager' (6ccabf28-5880-4e12-a266-c6dbb5bb1fc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:09:50 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-87a08298-364b-41ee-b788-67c351017b72 tempest-VolumesAdminNegativeTest-204853654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f03c514d-0d6f-42d6-a9bf-74dbbd0d9801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:09:50 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-87a08298-364b-41ee-b788-67c351017b72 tempest-VolumesAdminNegativeTest-204853654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f03c514d-0d6f-42d6-a9bf-74dbbd0d9801) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:09:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1218796973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01801cb1-f3d5-4f40-a01a-a5de96b19a02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6877726bc9e44683a9ec9d6453906c07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:09:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:09:50Z,use_quota=True,user_id='52ffc9010ec3456fb04020fbd008d979',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:09:50 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-87a08298-364b-41ee-b788-67c351017b72 tempest-VolumesAdminNegativeTest-204853654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e814699a-1236-4735-ab0a-3f57eddb54ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:09:50 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-87a08298-364b-41ee-b788-67c351017b72 tempest-VolumesAdminNegativeTest-204853654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e814699a-1236-4735-ab0a-3f57eddb54ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:09:50 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-87a08298-364b-41ee-b788-67c351017b72 tempest-VolumesAdminNegativeTest-204853654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1edcfb0-d615-4df1-926e-1c984ab94703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:09:50 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-87a08298-364b-41ee-b788-67c351017b72 tempest-VolumesAdminNegativeTest-204853654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1edcfb0-d615-4df1-926e-1c984ab94703) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01801cb1-f3d5-4f40-a01a-a5de96b19a02', 'volume_name': 'volume-01801cb1-f3d5-4f40-a01a-a5de96b19a02', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:09:50 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-87a08298-364b-41ee-b788-67c351017b72 tempest-VolumesAdminNegativeTest-204853654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79b87bc4-f471-4347-876e-ff9624f5cb01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:09:50 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-87a08298-364b-41ee-b788-67c351017b72 tempest-VolumesAdminNegativeTest-204853654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79b87bc4-f471-4347-876e-ff9624f5cb01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:09:50 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-87a08298-364b-41ee-b788-67c351017b72 tempest-VolumesAdminNegativeTest-204853654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efaf68e7-18bb-4ad9-bafb-4b8c65d56786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:09:50 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-87a08298-364b-41ee-b788-67c351017b72 tempest-VolumesAdminNegativeTest-204853654 None] Volume 01801cb1-f3d5-4f40-a01a-a5de96b19a02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01801cb1-f3d5-4f40-a01a-a5de96b19a02', 'volume_size': 1} Aug 29 01:09:50 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-87a08298-364b-41ee-b788-67c351017b72 tempest-VolumesAdminNegativeTest-204853654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:09:50 devstack sudo[87126]: pam_unix(sudo:session): session closed for user root Aug 29 01:09:50 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-6a64404f-a8ed-4ad8-9834-306b42cd5002 tempest-VolumesTestJSON-225754658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-64c2ce59-1b96-40ad-865f-c077fe703e1e 1073741824" returned: 0 in 0.883s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:09:50 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-6a64404f-a8ed-4ad8-9834-306b42cd5002 tempest-VolumesTestJSON-225754658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-64c2ce59-1b96-40ad-865f-c077fe703e1e {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:09:50 devstack sudo[87132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-64c2ce59-1b96-40ad-865f-c077fe703e1e Aug 29 01:09:50 devstack sudo[87132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:09:50 devstack sudo[87132]: pam_unix(sudo:session): session closed for user root Aug 29 01:09:50 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-6a64404f-a8ed-4ad8-9834-306b42cd5002 tempest-VolumesTestJSON-225754658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-64c2ce59-1b96-40ad-865f-c077fe703e1e" returned: 0 in 0.383s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:09:50 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-6a64404f-a8ed-4ad8-9834-306b42cd5002 tempest-VolumesTestJSON-225754658 None] <== create_volume: return (1339ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:09:50 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-6a64404f-a8ed-4ad8-9834-306b42cd5002 tempest-VolumesTestJSON-225754658 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.342s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:09:50 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-87a08298-364b-41ee-b788-67c351017b72 tempest-VolumesAdminNegativeTest-204853654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.496s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:09:50 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-87a08298-364b-41ee-b788-67c351017b72 tempest-VolumesAdminNegativeTest-204853654 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:09:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1218796973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01801cb1-f3d5-4f40-a01a-a5de96b19a02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6877726bc9e44683a9ec9d6453906c07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:09:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:09:50Z,use_quota=True,user_id='52ffc9010ec3456fb04020fbd008d979',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:09:50 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-87a08298-364b-41ee-b788-67c351017b72 tempest-VolumesAdminNegativeTest-204853654 None] Creating volume 01801cb1-f3d5-4f40-a01a-a5de96b19a02 {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:09:50 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-87a08298-364b-41ee-b788-67c351017b72 tempest-VolumesAdminNegativeTest-204853654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:09:50 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-87a08298-364b-41ee-b788-67c351017b72 tempest-VolumesAdminNegativeTest-204853654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:09:50 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-87a08298-364b-41ee-b788-67c351017b72 tempest-VolumesAdminNegativeTest-204853654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:09:50 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-87a08298-364b-41ee-b788-67c351017b72 tempest-VolumesAdminNegativeTest-204853654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:09:50 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-87a08298-364b-41ee-b788-67c351017b72 tempest-VolumesAdminNegativeTest-204853654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:09:50 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-87a08298-364b-41ee-b788-67c351017b72 tempest-VolumesAdminNegativeTest-204853654 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:09:50 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-87a08298-364b-41ee-b788-67c351017b72 tempest-VolumesAdminNegativeTest-204853654 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:09:50 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-87a08298-364b-41ee-b788-67c351017b72 tempest-VolumesAdminNegativeTest-204853654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-01801cb1-f3d5-4f40-a01a-a5de96b19a02 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:09:50 devstack sudo[87139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-01801cb1-f3d5-4f40-a01a-a5de96b19a02 1073741824 Aug 29 01:09:50 devstack sudo[87139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:09:50 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6a64404f-a8ed-4ad8-9834-306b42cd5002 tempest-VolumesTestJSON-225754658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27d8df7b-f3f1-413c-9892-7d5bd9308a5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64c2ce59-1b96-40ad-865f-c077fe703e1e', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:09:50 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6a64404f-a8ed-4ad8-9834-306b42cd5002 tempest-VolumesTestJSON-225754658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (590a4fcd-f24d-415d-a8ac-88289a0a2350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:09:50 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-6a64404f-a8ed-4ad8-9834-306b42cd5002 tempest-VolumesTestJSON-225754658 None] Volume volume-64c2ce59-1b96-40ad-865f-c077fe703e1e (64c2ce59-1b96-40ad-865f-c077fe703e1e): created successfully Aug 29 01:09:50 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6a64404f-a8ed-4ad8-9834-306b42cd5002 tempest-VolumesTestJSON-225754658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (590a4fcd-f24d-415d-a8ac-88289a0a2350) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:09:50 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6a64404f-a8ed-4ad8-9834-306b42cd5002 tempest-VolumesTestJSON-225754658 None] Flow 'volume_create_manager' (d643c92a-ea89-4adb-9ec9-d1e0306730cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:09:50 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-6a64404f-a8ed-4ad8-9834-306b42cd5002 tempest-VolumesTestJSON-225754658 None] Created volume successfully. Aug 29 01:09:51 devstack sudo[87139]: pam_unix(sudo:session): session closed for user root Aug 29 01:09:51 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-87a08298-364b-41ee-b788-67c351017b72 tempest-VolumesAdminNegativeTest-204853654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-01801cb1-f3d5-4f40-a01a-a5de96b19a02 1073741824" returned: 0 in 0.985s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:09:51 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-87a08298-364b-41ee-b788-67c351017b72 tempest-VolumesAdminNegativeTest-204853654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-01801cb1-f3d5-4f40-a01a-a5de96b19a02 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:09:51 devstack sudo[87154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-01801cb1-f3d5-4f40-a01a-a5de96b19a02 Aug 29 01:09:51 devstack sudo[87154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:09:52 devstack sudo[87154]: pam_unix(sudo:session): session closed for user root Aug 29 01:09:52 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-87a08298-364b-41ee-b788-67c351017b72 tempest-VolumesAdminNegativeTest-204853654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-01801cb1-f3d5-4f40-a01a-a5de96b19a02" returned: 0 in 0.637s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:09:52 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-87a08298-364b-41ee-b788-67c351017b72 tempest-VolumesAdminNegativeTest-204853654 None] <== create_volume: return (1739ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:09:52 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-87a08298-364b-41ee-b788-67c351017b72 tempest-VolumesAdminNegativeTest-204853654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.749s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:09:52 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-87a08298-364b-41ee-b788-67c351017b72 tempest-VolumesAdminNegativeTest-204853654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efaf68e7-18bb-4ad9-bafb-4b8c65d56786) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01801cb1-f3d5-4f40-a01a-a5de96b19a02', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:09:52 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-87a08298-364b-41ee-b788-67c351017b72 tempest-VolumesAdminNegativeTest-204853654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb0017d2-95e9-4d88-a488-26dbd8c32f80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:09:52 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-87a08298-364b-41ee-b788-67c351017b72 tempest-VolumesAdminNegativeTest-204853654 None] Volume volume-01801cb1-f3d5-4f40-a01a-a5de96b19a02 (01801cb1-f3d5-4f40-a01a-a5de96b19a02): created successfully Aug 29 01:09:52 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-87a08298-364b-41ee-b788-67c351017b72 tempest-VolumesAdminNegativeTest-204853654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb0017d2-95e9-4d88-a488-26dbd8c32f80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:09:52 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-87a08298-364b-41ee-b788-67c351017b72 tempest-VolumesAdminNegativeTest-204853654 None] Flow 'volume_create_manager' (6ccabf28-5880-4e12-a266-c6dbb5bb1fc8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:09:52 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-87a08298-364b-41ee-b788-67c351017b72 tempest-VolumesAdminNegativeTest-204853654 None] Created volume successfully. Aug 29 01:09:53 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-ca6a2d7b-a98d-457b-a78d-e39a64d4ce70 tempest-VolumesTestJSON-225754658 None] Acquiring lock "cinder-64c2ce59-1b96-40ad-865f-c077fe703e1e-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:09:53 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-ca6a2d7b-a98d-457b-a78d-e39a64d4ce70 tempest-VolumesTestJSON-225754658 None] Lock "cinder-64c2ce59-1b96-40ad-865f-c077fe703e1e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:09:53 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-ca6a2d7b-a98d-457b-a78d-e39a64d4ce70 tempest-VolumesTestJSON-225754658 None] Acquiring lock "cinder-quobyte-64c2ce59-1b96-40ad-865f-c077fe703e1e" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:09:53 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-ca6a2d7b-a98d-457b-a78d-e39a64d4ce70 tempest-VolumesTestJSON-225754658 None] Lock "cinder-quobyte-64c2ce59-1b96-40ad-865f-c077fe703e1e" acquired by "delete_volume" :: waited 0.039s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:09:53 devstack cinder-volume[86111]: INFO oslo.privsep.daemon [None req-ca6a2d7b-a98d-457b-a78d-e39a64d4ce70 tempest-VolumesTestJSON-225754658 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp0moc5euc/privsep.sock'] Aug 29 01:09:53 devstack sudo[87185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp0moc5euc/privsep.sock Aug 29 01:09:53 devstack sudo[87185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:09:53 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-d48a4057-e313-4797-a945-795eb5c77620 tempest-VolumesAdminNegativeTest-204853654 None] Acquiring lock "cinder-01801cb1-f3d5-4f40-a01a-a5de96b19a02-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:09:53 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-d48a4057-e313-4797-a945-795eb5c77620 tempest-VolumesAdminNegativeTest-204853654 None] Lock "cinder-01801cb1-f3d5-4f40-a01a-a5de96b19a02-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:09:53 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-d48a4057-e313-4797-a945-795eb5c77620 tempest-VolumesAdminNegativeTest-204853654 None] Acquiring lock "cinder-quobyte-01801cb1-f3d5-4f40-a01a-a5de96b19a02" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:09:53 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-d48a4057-e313-4797-a945-795eb5c77620 tempest-VolumesAdminNegativeTest-204853654 None] Lock "cinder-quobyte-01801cb1-f3d5-4f40-a01a-a5de96b19a02" acquired by "delete_volume" :: waited 0.022s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:09:54 devstack cinder-volume[86111]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Aug 29 01:09:54 devstack cinder-volume[86111]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 29 01:09:54 devstack cinder-volume[86111]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Aug 29 01:09:54 devstack cinder-volume[86111]: WARNING oslo.privsep.daemon [-] privsep log: Aug 29 01:09:54 devstack cinder-volume[86111]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Aug 29 01:09:54 devstack cinder-volume[86111]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Aug 29 01:09:54 devstack cinder-volume[86111]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 29 01:09:54 devstack cinder-volume[86111]: WARNING oslo.privsep.daemon [-] privsep log: Aug 29 01:09:54 devstack cinder-volume[86111]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Aug 29 01:09:55 devstack cinder-volume[86111]: WARNING py.warnings [req-0dc184a2-c7cf-4f06-a006-b23c12e25325 req-18dfa14e-fcbb-4e9d-8dac-63558568542d tempest-DeleteServersTestJSON-1077080811 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Aug 29 01:09:55 devstack cinder-volume[86111]: .first() Aug 29 01:09:55 devstack cinder-volume[86111]: Aug 29 01:09:55 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [req-0dc184a2-c7cf-4f06-a006-b23c12e25325 req-18dfa14e-fcbb-4e9d-8dac-63558568542d tempest-DeleteServersTestJSON-1077080811 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:09:55 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [req-0dc184a2-c7cf-4f06-a006-b23c12e25325 req-18dfa14e-fcbb-4e9d-8dac-63558568542d tempest-DeleteServersTestJSON-1077080811 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:09:55 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [req-0dc184a2-c7cf-4f06-a006-b23c12e25325 req-18dfa14e-fcbb-4e9d-8dac-63558568542d tempest-DeleteServersTestJSON-1077080811 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:09:55 devstack sudo[87185]: pam_unix(sudo:session): session closed for user root Aug 29 01:09:55 devstack cinder-volume[86111]: INFO oslo.privsep.daemon [None req-ca6a2d7b-a98d-457b-a78d-e39a64d4ce70 tempest-VolumesTestJSON-225754658 None] Spawned new privsep daemon via rootwrap Aug 29 01:09:55 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [None req-ca6a2d7b-a98d-457b-a78d-e39a64d4ce70 tempest-VolumesTestJSON-225754658 None] Accepted privsep connection to /tmp/tmp0moc5euc/privsep.sock {{(pid=86111) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Aug 29 01:09:55 devstack cinder-volume[86111]: INFO oslo.privsep.daemon [-] privsep daemon starting Aug 29 01:09:55 devstack cinder-volume[86111]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Aug 29 01:09:55 devstack cinder-volume[86111]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Aug 29 01:09:55 devstack cinder-volume[86111]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 87199 Aug 29 01:09:55 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[cea6e112-a0f9-4cd7-ae6f-addbb48d60a3]: (2,) {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:09:55 devstack cinder-volume[86111]: WARNING oslo_privsep.priv_context [None req-d48a4057-e313-4797-a945-795eb5c77620 tempest-VolumesAdminNegativeTest-204853654 None] privsep daemon already running Aug 29 01:09:55 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [req-0dc184a2-c7cf-4f06-a006-b23c12e25325 req-18dfa14e-fcbb-4e9d-8dac-63558568542d tempest-DeleteServersTestJSON-1077080811 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630', 'name': 'volume-a4edb1d3-95d6-42f6-968e-7be209624c1a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e04c63a9-138f-48ef-bfe9-92c16ed705e5', 'enforce_multipath': True} {{(pid=86111) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 29 01:09:55 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[d360fb76-a413-429f-8a04-d4bd51db4d43]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:09:55 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdf27758-b34b-4ed7-b93b-f4587d04b9f7]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:09:55 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-ca6a2d7b-a98d-457b-a78d-e39a64d4ce70 tempest-VolumesTestJSON-225754658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-64c2ce59-1b96-40ad-865f-c077fe703e1e {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:09:55 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d48a4057-e313-4797-a945-795eb5c77620 tempest-VolumesAdminNegativeTest-204853654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-01801cb1-f3d5-4f40-a01a-a5de96b19a02 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:09:55 devstack sudo[87205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-01801cb1-f3d5-4f40-a01a-a5de96b19a02 Aug 29 01:09:55 devstack sudo[87205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:09:55 devstack sudo[87204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-64c2ce59-1b96-40ad-865f-c077fe703e1e Aug 29 01:09:55 devstack sudo[87204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:09:55 devstack cinder-volume[86111]: INFO cinder.volume.manager [req-0dc184a2-c7cf-4f06-a006-b23c12e25325 req-18dfa14e-fcbb-4e9d-8dac-63558568542d tempest-DeleteServersTestJSON-1077080811 None] attachment_update completed successfully. Aug 29 01:09:55 devstack sudo[87205]: pam_unix(sudo:session): session closed for user root Aug 29 01:09:55 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d48a4057-e313-4797-a945-795eb5c77620 tempest-VolumesAdminNegativeTest-204853654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-01801cb1-f3d5-4f40-a01a-a5de96b19a02" returned: 0 in 0.625s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:09:55 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d48a4057-e313-4797-a945-795eb5c77620 tempest-VolumesAdminNegativeTest-204853654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-01801cb1-f3d5-4f40-a01a-a5de96b19a02 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:09:55 devstack sudo[87215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-01801cb1-f3d5-4f40-a01a-a5de96b19a02 Aug 29 01:09:55 devstack sudo[87215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:09:55 devstack sudo[87204]: pam_unix(sudo:session): session closed for user root Aug 29 01:09:55 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-ca6a2d7b-a98d-457b-a78d-e39a64d4ce70 tempest-VolumesTestJSON-225754658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-64c2ce59-1b96-40ad-865f-c077fe703e1e" returned: 0 in 0.699s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:09:55 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-ca6a2d7b-a98d-457b-a78d-e39a64d4ce70 tempest-VolumesTestJSON-225754658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-64c2ce59-1b96-40ad-865f-c077fe703e1e {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:09:55 devstack sudo[87217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-64c2ce59-1b96-40ad-865f-c077fe703e1e Aug 29 01:09:55 devstack sudo[87217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:09:56 devstack sudo[87215]: pam_unix(sudo:session): session closed for user root Aug 29 01:09:56 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d48a4057-e313-4797-a945-795eb5c77620 tempest-VolumesAdminNegativeTest-204853654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-01801cb1-f3d5-4f40-a01a-a5de96b19a02" returned: 0 in 0.455s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:09:56 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-d48a4057-e313-4797-a945-795eb5c77620 tempest-VolumesAdminNegativeTest-204853654 None] Lock "cinder-quobyte-01801cb1-f3d5-4f40-a01a-a5de96b19a02" released by "delete_volume" :: held 2.400s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:09:56 devstack cinder-volume[86111]: WARNING cinder.quota [None req-d48a4057-e313-4797-a945-795eb5c77620 tempest-VolumesAdminNegativeTest-204853654 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Aug 29 01:09:56 devstack cinder-volume[86111]: WARNING cinder.quota [None req-d48a4057-e313-4797-a945-795eb5c77620 tempest-VolumesAdminNegativeTest-204853654 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Aug 29 01:09:56 devstack sudo[87217]: pam_unix(sudo:session): session closed for user root Aug 29 01:09:56 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-ca6a2d7b-a98d-457b-a78d-e39a64d4ce70 tempest-VolumesTestJSON-225754658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-64c2ce59-1b96-40ad-865f-c077fe703e1e" returned: 0 in 0.512s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:09:56 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-d48a4057-e313-4797-a945-795eb5c77620 tempest-VolumesAdminNegativeTest-204853654 None] Created reservations ['77625363-7db6-48af-92d0-3ed13cf2d74b', '4200aae0-90d5-432a-98f9-c9775965ead4', '27e3d510-7548-4e96-8288-af603a5e371b', '6bbdd445-eb26-46da-89bf-c4cb8ccedd67'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:09:56 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-ca6a2d7b-a98d-457b-a78d-e39a64d4ce70 tempest-VolumesTestJSON-225754658 None] Lock "cinder-quobyte-64c2ce59-1b96-40ad-865f-c077fe703e1e" released by "delete_volume" :: held 3.005s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:09:56 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-d48a4057-e313-4797-a945-795eb5c77620 tempest-VolumesAdminNegativeTest-204853654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:09:56 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-d48a4057-e313-4797-a945-795eb5c77620 tempest-VolumesAdminNegativeTest-204853654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:09:56 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-d48a4057-e313-4797-a945-795eb5c77620 tempest-VolumesAdminNegativeTest-204853654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:09:56 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-d48a4057-e313-4797-a945-795eb5c77620 tempest-VolumesAdminNegativeTest-204853654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:09:56 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-d48a4057-e313-4797-a945-795eb5c77620 tempest-VolumesAdminNegativeTest-204853654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:09:56 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d48a4057-e313-4797-a945-795eb5c77620 tempest-VolumesAdminNegativeTest-204853654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:09:56 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-ca6a2d7b-a98d-457b-a78d-e39a64d4ce70 tempest-VolumesTestJSON-225754658 None] Created reservations ['f402be86-edb5-42fd-87b6-b2c745063f37', '9a1ec917-b113-4ea4-9fa5-aed211aeb751', 'b9440dc5-bf71-401f-a726-92e458297818', '95b716e4-dcf9-40ab-8082-0a6586008112'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:09:56 devstack sudo[87604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:09:56 devstack sudo[87604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:09:56 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-ca6a2d7b-a98d-457b-a78d-e39a64d4ce70 tempest-VolumesTestJSON-225754658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:09:56 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-ca6a2d7b-a98d-457b-a78d-e39a64d4ce70 tempest-VolumesTestJSON-225754658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:09:56 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-ca6a2d7b-a98d-457b-a78d-e39a64d4ce70 tempest-VolumesTestJSON-225754658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:09:56 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-ca6a2d7b-a98d-457b-a78d-e39a64d4ce70 tempest-VolumesTestJSON-225754658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:09:56 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-ca6a2d7b-a98d-457b-a78d-e39a64d4ce70 tempest-VolumesTestJSON-225754658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:09:56 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-ca6a2d7b-a98d-457b-a78d-e39a64d4ce70 tempest-VolumesTestJSON-225754658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:09:57 devstack sudo[87606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:09:57 devstack sudo[87606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:09:57 devstack sudo[87604]: pam_unix(sudo:session): session closed for user root Aug 29 01:09:57 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d48a4057-e313-4797-a945-795eb5c77620 tempest-VolumesAdminNegativeTest-204853654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.533s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:09:57 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-d48a4057-e313-4797-a945-795eb5c77620 tempest-VolumesAdminNegativeTest-204853654 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:09:57 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-d48a4057-e313-4797-a945-795eb5c77620 tempest-VolumesAdminNegativeTest-204853654 None] Deleted volume successfully. Aug 29 01:09:57 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-d48a4057-e313-4797-a945-795eb5c77620 tempest-VolumesAdminNegativeTest-204853654 None] Lock "cinder-01801cb1-f3d5-4f40-a01a-a5de96b19a02-delete_volume" released by "delete_volume" :: held 3.445s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:09:57 devstack sudo[87606]: pam_unix(sudo:session): session closed for user root Aug 29 01:09:57 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-ca6a2d7b-a98d-457b-a78d-e39a64d4ce70 tempest-VolumesTestJSON-225754658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.457s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:09:57 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-ca6a2d7b-a98d-457b-a78d-e39a64d4ce70 tempest-VolumesTestJSON-225754658 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:09:57 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-ca6a2d7b-a98d-457b-a78d-e39a64d4ce70 tempest-VolumesTestJSON-225754658 None] Deleted volume successfully. Aug 29 01:09:57 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-ca6a2d7b-a98d-457b-a78d-e39a64d4ce70 tempest-VolumesTestJSON-225754658 None] Lock "cinder-64c2ce59-1b96-40ad-865f-c077fe703e1e-delete_volume" released by "delete_volume" :: held 4.141s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:09:58 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-338b5020-06c4-4b16-9f7e-1f061f08c106 tempest-VolumesTestJSON-225754658 None] Acquiring lock "cinder-519e4bcc-9c1c-49b5-833e-e57f1ee608ee-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:09:58 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-338b5020-06c4-4b16-9f7e-1f061f08c106 tempest-VolumesTestJSON-225754658 None] Lock "cinder-519e4bcc-9c1c-49b5-833e-e57f1ee608ee-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:09:58 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-338b5020-06c4-4b16-9f7e-1f061f08c106 tempest-VolumesTestJSON-225754658 None] Acquiring lock "cinder-quobyte-519e4bcc-9c1c-49b5-833e-e57f1ee608ee" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:09:58 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-338b5020-06c4-4b16-9f7e-1f061f08c106 tempest-VolumesTestJSON-225754658 None] Lock "cinder-quobyte-519e4bcc-9c1c-49b5-833e-e57f1ee608ee" acquired by "delete_volume" :: waited 0.043s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:09:58 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[f12c46ee-39a4-4e13-a1e3-135c7f4ef741]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:09:58 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-338b5020-06c4-4b16-9f7e-1f061f08c106 tempest-VolumesTestJSON-225754658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-519e4bcc-9c1c-49b5-833e-e57f1ee608ee {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:09:58 devstack sudo[87618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-519e4bcc-9c1c-49b5-833e-e57f1ee608ee Aug 29 01:09:58 devstack sudo[87618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:09:59 devstack sudo[87618]: pam_unix(sudo:session): session closed for user root Aug 29 01:09:59 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-338b5020-06c4-4b16-9f7e-1f061f08c106 tempest-VolumesTestJSON-225754658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-519e4bcc-9c1c-49b5-833e-e57f1ee608ee" returned: 0 in 0.787s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:09:59 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-338b5020-06c4-4b16-9f7e-1f061f08c106 tempest-VolumesTestJSON-225754658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-519e4bcc-9c1c-49b5-833e-e57f1ee608ee {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:09:59 devstack sudo[87683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-519e4bcc-9c1c-49b5-833e-e57f1ee608ee Aug 29 01:09:59 devstack sudo[87683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:09:59 devstack sudo[87683]: pam_unix(sudo:session): session closed for user root Aug 29 01:09:59 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-338b5020-06c4-4b16-9f7e-1f061f08c106 tempest-VolumesTestJSON-225754658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-519e4bcc-9c1c-49b5-833e-e57f1ee608ee" returned: 0 in 0.319s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:09:59 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-338b5020-06c4-4b16-9f7e-1f061f08c106 tempest-VolumesTestJSON-225754658 None] Lock "cinder-quobyte-519e4bcc-9c1c-49b5-833e-e57f1ee608ee" released by "delete_volume" :: held 1.185s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:09:59 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-338b5020-06c4-4b16-9f7e-1f061f08c106 tempest-VolumesTestJSON-225754658 None] Created reservations ['09a7b462-212d-449b-b6f2-66be86610a75', '94bf7ea3-4476-4a3e-b29a-e57c9d492ef8', '4eaa0c41-2a74-4a2c-8b7f-8e7d9916ff7d', '9f1ede50-2e31-49e2-87eb-a4579317cec8'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:09:59 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-338b5020-06c4-4b16-9f7e-1f061f08c106 tempest-VolumesTestJSON-225754658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:09:59 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-338b5020-06c4-4b16-9f7e-1f061f08c106 tempest-VolumesTestJSON-225754658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:09:59 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-338b5020-06c4-4b16-9f7e-1f061f08c106 tempest-VolumesTestJSON-225754658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:09:59 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-338b5020-06c4-4b16-9f7e-1f061f08c106 tempest-VolumesTestJSON-225754658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:09:59 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-338b5020-06c4-4b16-9f7e-1f061f08c106 tempest-VolumesTestJSON-225754658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:09:59 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-338b5020-06c4-4b16-9f7e-1f061f08c106 tempest-VolumesTestJSON-225754658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:09:59 devstack sudo[87690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:09:59 devstack sudo[87690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:09:59 devstack sudo[87690]: pam_unix(sudo:session): session closed for user root Aug 29 01:09:59 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-338b5020-06c4-4b16-9f7e-1f061f08c106 tempest-VolumesTestJSON-225754658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.273s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:09:59 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-338b5020-06c4-4b16-9f7e-1f061f08c106 tempest-VolumesTestJSON-225754658 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:09:59 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-338b5020-06c4-4b16-9f7e-1f061f08c106 tempest-VolumesTestJSON-225754658 None] Deleted volume successfully. Aug 29 01:09:59 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-338b5020-06c4-4b16-9f7e-1f061f08c106 tempest-VolumesTestJSON-225754658 None] Lock "cinder-519e4bcc-9c1c-49b5-833e-e57f1ee608ee-delete_volume" released by "delete_volume" :: held 1.772s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:10:00 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-bc367639-b951-4be9-ad33-c452969af6de tempest-VolumesTestJSON-225754658 None] Acquiring lock "cinder-01871fa1-c462-4528-adfd-bdb5ff6114d6-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:10:00 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-bc367639-b951-4be9-ad33-c452969af6de tempest-VolumesTestJSON-225754658 None] Lock "cinder-01871fa1-c462-4528-adfd-bdb5ff6114d6-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:10:00 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-bc367639-b951-4be9-ad33-c452969af6de tempest-VolumesTestJSON-225754658 None] Acquiring lock "cinder-quobyte-01871fa1-c462-4528-adfd-bdb5ff6114d6" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:10:00 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-bc367639-b951-4be9-ad33-c452969af6de tempest-VolumesTestJSON-225754658 None] Lock "cinder-quobyte-01871fa1-c462-4528-adfd-bdb5ff6114d6" acquired by "delete_volume" :: waited 0.019s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:10:00 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[75a6a6d2-8baa-4164-a102-06e297da6a54]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:10:00 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-bc367639-b951-4be9-ad33-c452969af6de tempest-VolumesTestJSON-225754658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-01871fa1-c462-4528-adfd-bdb5ff6114d6 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:10:01 devstack sudo[87696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-01871fa1-c462-4528-adfd-bdb5ff6114d6 Aug 29 01:10:01 devstack sudo[87696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:10:01 devstack cinder-volume[86111]: INFO cinder.volume.manager [req-0f309ba1-0e0e-430d-a51b-d061899467cc req-bd252fd1-0920-47b7-9be7-098713aaec31 tempest-DeleteServersTestJSON-1077080811 None] Terminate volume connection completed successfully. Aug 29 01:10:01 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [req-0f309ba1-0e0e-430d-a51b-d061899467cc req-bd252fd1-0920-47b7-9be7-098713aaec31 tempest-DeleteServersTestJSON-1077080811 None] Deleting attachment e04c63a9-138f-48ef-bfe9-92c16ed705e5. {{(pid=86111) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 29 01:10:01 devstack sudo[87696]: pam_unix(sudo:session): session closed for user root Aug 29 01:10:01 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-bc367639-b951-4be9-ad33-c452969af6de tempest-VolumesTestJSON-225754658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-01871fa1-c462-4528-adfd-bdb5ff6114d6" returned: 0 in 0.498s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:10:01 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-bc367639-b951-4be9-ad33-c452969af6de tempest-VolumesTestJSON-225754658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-01871fa1-c462-4528-adfd-bdb5ff6114d6 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:10:01 devstack sudo[87705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-01871fa1-c462-4528-adfd-bdb5ff6114d6 Aug 29 01:10:01 devstack sudo[87705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:10:01 devstack sudo[87705]: pam_unix(sudo:session): session closed for user root Aug 29 01:10:01 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-bc367639-b951-4be9-ad33-c452969af6de tempest-VolumesTestJSON-225754658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-01871fa1-c462-4528-adfd-bdb5ff6114d6" returned: 0 in 0.405s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:10:01 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-bc367639-b951-4be9-ad33-c452969af6de tempest-VolumesTestJSON-225754658 None] Lock "cinder-quobyte-01871fa1-c462-4528-adfd-bdb5ff6114d6" released by "delete_volume" :: held 0.981s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:10:02 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-bc367639-b951-4be9-ad33-c452969af6de tempest-VolumesTestJSON-225754658 None] Created reservations ['bd43e357-4419-45e4-ab6e-b465397de4bd', '1b0c2118-6026-463a-b4cb-ba932320321f', 'd0504bf6-dfb0-4a9d-9a0f-447fb9009b8e', 'df0777a5-c408-43c9-8252-30cbba185fef'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:10:02 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-bc367639-b951-4be9-ad33-c452969af6de tempest-VolumesTestJSON-225754658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:10:02 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-bc367639-b951-4be9-ad33-c452969af6de tempest-VolumesTestJSON-225754658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:10:02 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-bc367639-b951-4be9-ad33-c452969af6de tempest-VolumesTestJSON-225754658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:10:02 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-bc367639-b951-4be9-ad33-c452969af6de tempest-VolumesTestJSON-225754658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:10:02 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-bc367639-b951-4be9-ad33-c452969af6de tempest-VolumesTestJSON-225754658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:10:02 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-bc367639-b951-4be9-ad33-c452969af6de tempest-VolumesTestJSON-225754658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:10:02 devstack sudo[87710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:10:02 devstack sudo[87710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:10:02 devstack sudo[87710]: pam_unix(sudo:session): session closed for user root Aug 29 01:10:02 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-5382ab20-7116-4704-9544-5f01ac56e915 tempest-DeleteServersTestJSON-1077080811 None] Acquiring lock "cinder-a4edb1d3-95d6-42f6-968e-7be209624c1a-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:10:02 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-bc367639-b951-4be9-ad33-c452969af6de tempest-VolumesTestJSON-225754658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.298s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:10:02 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-bc367639-b951-4be9-ad33-c452969af6de tempest-VolumesTestJSON-225754658 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:10:02 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-bc367639-b951-4be9-ad33-c452969af6de tempest-VolumesTestJSON-225754658 None] Deleted volume successfully. Aug 29 01:10:02 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-5382ab20-7116-4704-9544-5f01ac56e915 tempest-DeleteServersTestJSON-1077080811 None] Lock "cinder-a4edb1d3-95d6-42f6-968e-7be209624c1a-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:10:02 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-bc367639-b951-4be9-ad33-c452969af6de tempest-VolumesTestJSON-225754658 None] Lock "cinder-01871fa1-c462-4528-adfd-bdb5ff6114d6-delete_volume" released by "delete_volume" :: held 1.625s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:10:02 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-5382ab20-7116-4704-9544-5f01ac56e915 tempest-DeleteServersTestJSON-1077080811 None] Acquiring lock "cinder-quobyte-a4edb1d3-95d6-42f6-968e-7be209624c1a" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:10:02 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-5382ab20-7116-4704-9544-5f01ac56e915 tempest-DeleteServersTestJSON-1077080811 None] Lock "cinder-quobyte-a4edb1d3-95d6-42f6-968e-7be209624c1a" acquired by "delete_volume" :: waited 0.017s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:10:02 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ff43221-63c0-4b2d-850f-5740bcbcef67]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:10:02 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-5382ab20-7116-4704-9544-5f01ac56e915 tempest-DeleteServersTestJSON-1077080811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a4edb1d3-95d6-42f6-968e-7be209624c1a {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:10:02 devstack sudo[87715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a4edb1d3-95d6-42f6-968e-7be209624c1a Aug 29 01:10:02 devstack sudo[87715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:10:02 devstack sudo[87715]: pam_unix(sudo:session): session closed for user root Aug 29 01:10:02 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-5382ab20-7116-4704-9544-5f01ac56e915 tempest-DeleteServersTestJSON-1077080811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a4edb1d3-95d6-42f6-968e-7be209624c1a" returned: 0 in 0.434s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:10:02 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-5382ab20-7116-4704-9544-5f01ac56e915 tempest-DeleteServersTestJSON-1077080811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a4edb1d3-95d6-42f6-968e-7be209624c1a {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:10:02 devstack sudo[87721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a4edb1d3-95d6-42f6-968e-7be209624c1a Aug 29 01:10:02 devstack sudo[87721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:10:03 devstack sudo[87721]: pam_unix(sudo:session): session closed for user root Aug 29 01:10:03 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-5382ab20-7116-4704-9544-5f01ac56e915 tempest-DeleteServersTestJSON-1077080811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a4edb1d3-95d6-42f6-968e-7be209624c1a" returned: 0 in 0.269s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:10:03 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-5382ab20-7116-4704-9544-5f01ac56e915 tempest-DeleteServersTestJSON-1077080811 None] Lock "cinder-quobyte-a4edb1d3-95d6-42f6-968e-7be209624c1a" released by "delete_volume" :: held 0.755s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:10:03 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-5382ab20-7116-4704-9544-5f01ac56e915 tempest-DeleteServersTestJSON-1077080811 None] Created reservations ['aa128e51-f30f-42bc-a1c2-5cd1ffd0925d', 'de875575-932f-46a5-8e25-5defa12cce26', '6b5e872a-3199-48a4-b481-a0ef54e1aa8e', '9a92daef-4ace-44ec-afcb-5fab5e0d3020'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:10:03 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-5382ab20-7116-4704-9544-5f01ac56e915 tempest-DeleteServersTestJSON-1077080811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:10:03 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-5382ab20-7116-4704-9544-5f01ac56e915 tempest-DeleteServersTestJSON-1077080811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:10:03 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-5382ab20-7116-4704-9544-5f01ac56e915 tempest-DeleteServersTestJSON-1077080811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:10:03 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-5382ab20-7116-4704-9544-5f01ac56e915 tempest-DeleteServersTestJSON-1077080811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:10:03 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-5382ab20-7116-4704-9544-5f01ac56e915 tempest-DeleteServersTestJSON-1077080811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:10:03 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-5382ab20-7116-4704-9544-5f01ac56e915 tempest-DeleteServersTestJSON-1077080811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:10:03 devstack sudo[87724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:10:03 devstack sudo[87724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:10:03 devstack sudo[87724]: pam_unix(sudo:session): session closed for user root Aug 29 01:10:03 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-5382ab20-7116-4704-9544-5f01ac56e915 tempest-DeleteServersTestJSON-1077080811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.393s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:10:03 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-5382ab20-7116-4704-9544-5f01ac56e915 tempest-DeleteServersTestJSON-1077080811 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:10:03 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-5382ab20-7116-4704-9544-5f01ac56e915 tempest-DeleteServersTestJSON-1077080811 None] Deleted volume successfully. Aug 29 01:10:03 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-5382ab20-7116-4704-9544-5f01ac56e915 tempest-DeleteServersTestJSON-1077080811 None] Lock "cinder-a4edb1d3-95d6-42f6-968e-7be209624c1a-delete_volume" released by "delete_volume" :: held 1.409s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:10:11 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-8ac9159d-7077-40a9-9f52-7b17794cdfc6 tempest-BackendsCapabilitiesAdminTestsJSON-1505237734 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.433609008789, 'free_capacity_gb': 1774.433609008789, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86111) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Aug 29 01:10:11 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-a9028010-6aaa-4467-9710-d76e1239a708 tempest-BackendsCapabilitiesAdminTestsJSON-1505237734 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.433609008789, 'free_capacity_gb': 1774.433609008789, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86111) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Aug 29 01:10:13 devstack cinder-volume[86111]: DEBUG dbcounter [-] [86111] Writing DB stats cinder:SELECT=37,cinder:UPDATE=57,cinder:DELETE=4,cinder:INSERT=17 {{(pid=86111) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 29 01:10:13 devstack cinder-volume[86111]: DEBUG dbcounter [-] [86111] Writing DB stats cinder:SELECT=48,cinder:UPDATE=56,cinder:INSERT=8,cinder:DELETE=6 {{(pid=86111) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 29 01:10:18 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-71933ead-562e-40e0-b5ba-bdb041999ab4 tempest-GroupSnapshotsTest-379341379 None] Group tempest-GroupSnapshotsTest-Group-364244531: creating Aug 29 01:10:18 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-71933ead-562e-40e0-b5ba-bdb041999ab4 tempest-GroupSnapshotsTest-379341379 None] Group tempest-GroupSnapshotsTest-Group-364244531: created successfully Aug 29 01:10:18 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-71933ead-562e-40e0-b5ba-bdb041999ab4 tempest-GroupSnapshotsTest-379341379 None] Create group completed successfully. Aug 29 01:10:20 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d7d9a97-0a80-4b75-8536-726397c81a29 tempest-GroupSnapshotsTest-379341379 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:10:20 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-9d7d9a97-0a80-4b75-8536-726397c81a29 tempest-GroupSnapshotsTest-379341379 None] Flow 'volume_create_manager' (b9ad7cea-7681-49f4-b65c-8dd250f78149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:10:20 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-9d7d9a97-0a80-4b75-8536-726397c81a29 tempest-GroupSnapshotsTest-379341379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24e4901b-99f0-4b6b-a10e-c628a6c8c4e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:10:20 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-9d7d9a97-0a80-4b75-8536-726397c81a29 tempest-GroupSnapshotsTest-379341379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24e4901b-99f0-4b6b-a10e-c628a6c8c4e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:10:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1719424387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a50e60a8-6f90-4a98-bf1f-2739dd1463d3,host='devstack@QuobyteHD#QuobyteHD',id=874c7050-c7a8-4720-935f-d14db2f4b4eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50787aacf8064212b410d4f97d55d629',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:10:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:10:21Z,use_quota=True,user_id='2c6852d5bcec4367a445767ca79915fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be66b9b5-fcc9-4dc5-a641-dddffed66872),volume_type_id=be66b9b5-fcc9-4dc5-a641-dddffed66872)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:10:20 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-9d7d9a97-0a80-4b75-8536-726397c81a29 tempest-GroupSnapshotsTest-379341379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a32ed68-34de-455f-b196-963acfeeb6b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:10:20 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-9d7d9a97-0a80-4b75-8536-726397c81a29 tempest-GroupSnapshotsTest-379341379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a32ed68-34de-455f-b196-963acfeeb6b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:10:20 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-9d7d9a97-0a80-4b75-8536-726397c81a29 tempest-GroupSnapshotsTest-379341379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3496c671-f28c-441d-92f8-2ba1f120b7d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:10:20 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-9d7d9a97-0a80-4b75-8536-726397c81a29 tempest-GroupSnapshotsTest-379341379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3496c671-f28c-441d-92f8-2ba1f120b7d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '874c7050-c7a8-4720-935f-d14db2f4b4eb', 'volume_name': 'volume-874c7050-c7a8-4720-935f-d14db2f4b4eb', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:10:20 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-9d7d9a97-0a80-4b75-8536-726397c81a29 tempest-GroupSnapshotsTest-379341379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bb8f918-8f12-4715-b748-fa22246f8312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:10:20 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-9d7d9a97-0a80-4b75-8536-726397c81a29 tempest-GroupSnapshotsTest-379341379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bb8f918-8f12-4715-b748-fa22246f8312) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:10:20 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-9d7d9a97-0a80-4b75-8536-726397c81a29 tempest-GroupSnapshotsTest-379341379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3eae6539-7ca7-40ad-ab73-0f8e1e065721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:10:20 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-9d7d9a97-0a80-4b75-8536-726397c81a29 tempest-GroupSnapshotsTest-379341379 None] Volume 874c7050-c7a8-4720-935f-d14db2f4b4eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-874c7050-c7a8-4720-935f-d14db2f4b4eb', 'volume_size': 1} Aug 29 01:10:20 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-9d7d9a97-0a80-4b75-8536-726397c81a29 tempest-GroupSnapshotsTest-379341379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:10:20 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-9d7d9a97-0a80-4b75-8536-726397c81a29 tempest-GroupSnapshotsTest-379341379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:10:20 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-9d7d9a97-0a80-4b75-8536-726397c81a29 tempest-GroupSnapshotsTest-379341379 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a50e60a8-6f90-4a98-bf1f-2739dd1463d3,created_at=2026-08-28T23:10:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1719424387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a50e60a8-6f90-4a98-bf1f-2739dd1463d3,host='devstack@QuobyteHD#QuobyteHD',id=874c7050-c7a8-4720-935f-d14db2f4b4eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50787aacf8064212b410d4f97d55d629',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:10:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:10:21Z,use_quota=True,user_id='2c6852d5bcec4367a445767ca79915fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be66b9b5-fcc9-4dc5-a641-dddffed66872),volume_type_id=be66b9b5-fcc9-4dc5-a641-dddffed66872)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:10:20 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-9d7d9a97-0a80-4b75-8536-726397c81a29 tempest-GroupSnapshotsTest-379341379 None] Creating volume 874c7050-c7a8-4720-935f-d14db2f4b4eb {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:10:20 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-9d7d9a97-0a80-4b75-8536-726397c81a29 tempest-GroupSnapshotsTest-379341379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:10:20 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-9d7d9a97-0a80-4b75-8536-726397c81a29 tempest-GroupSnapshotsTest-379341379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:10:20 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-9d7d9a97-0a80-4b75-8536-726397c81a29 tempest-GroupSnapshotsTest-379341379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:10:20 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-9d7d9a97-0a80-4b75-8536-726397c81a29 tempest-GroupSnapshotsTest-379341379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:10:20 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-9d7d9a97-0a80-4b75-8536-726397c81a29 tempest-GroupSnapshotsTest-379341379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:10:20 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-9d7d9a97-0a80-4b75-8536-726397c81a29 tempest-GroupSnapshotsTest-379341379 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:10:20 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-9d7d9a97-0a80-4b75-8536-726397c81a29 tempest-GroupSnapshotsTest-379341379 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:10:20 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-9d7d9a97-0a80-4b75-8536-726397c81a29 tempest-GroupSnapshotsTest-379341379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-874c7050-c7a8-4720-935f-d14db2f4b4eb 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:10:20 devstack sudo[87783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-874c7050-c7a8-4720-935f-d14db2f4b4eb 1073741824 Aug 29 01:10:20 devstack sudo[87783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:10:21 devstack sudo[87783]: pam_unix(sudo:session): session closed for user root Aug 29 01:10:21 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-9d7d9a97-0a80-4b75-8536-726397c81a29 tempest-GroupSnapshotsTest-379341379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-874c7050-c7a8-4720-935f-d14db2f4b4eb 1073741824" returned: 0 in 0.514s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:10:21 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-9d7d9a97-0a80-4b75-8536-726397c81a29 tempest-GroupSnapshotsTest-379341379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-874c7050-c7a8-4720-935f-d14db2f4b4eb {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:10:21 devstack sudo[87789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-874c7050-c7a8-4720-935f-d14db2f4b4eb Aug 29 01:10:21 devstack sudo[87789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:10:21 devstack sudo[87789]: pam_unix(sudo:session): session closed for user root Aug 29 01:10:21 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-9d7d9a97-0a80-4b75-8536-726397c81a29 tempest-GroupSnapshotsTest-379341379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-874c7050-c7a8-4720-935f-d14db2f4b4eb" returned: 0 in 0.242s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:10:21 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-9d7d9a97-0a80-4b75-8536-726397c81a29 tempest-GroupSnapshotsTest-379341379 None] <== create_volume: return (804ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:10:21 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-9d7d9a97-0a80-4b75-8536-726397c81a29 tempest-GroupSnapshotsTest-379341379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.807s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:10:21 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-9d7d9a97-0a80-4b75-8536-726397c81a29 tempest-GroupSnapshotsTest-379341379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3eae6539-7ca7-40ad-ab73-0f8e1e065721) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-874c7050-c7a8-4720-935f-d14db2f4b4eb', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:10:21 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-9d7d9a97-0a80-4b75-8536-726397c81a29 tempest-GroupSnapshotsTest-379341379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (164b90fd-2e87-4684-9ea1-f8176bd7ac6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:10:21 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-9d7d9a97-0a80-4b75-8536-726397c81a29 tempest-GroupSnapshotsTest-379341379 None] Volume volume-874c7050-c7a8-4720-935f-d14db2f4b4eb (874c7050-c7a8-4720-935f-d14db2f4b4eb): created successfully Aug 29 01:10:21 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-9d7d9a97-0a80-4b75-8536-726397c81a29 tempest-GroupSnapshotsTest-379341379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (164b90fd-2e87-4684-9ea1-f8176bd7ac6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:10:21 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-9d7d9a97-0a80-4b75-8536-726397c81a29 tempest-GroupSnapshotsTest-379341379 None] Flow 'volume_create_manager' (b9ad7cea-7681-49f4-b65c-8dd250f78149) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:10:21 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-9d7d9a97-0a80-4b75-8536-726397c81a29 tempest-GroupSnapshotsTest-379341379 None] Created volume successfully. Aug 29 01:10:22 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-2d8b083f-ae59-4e2f-831a-6fc3c8d405ed tempest-GroupSnapshotsTest-379341379 None] GroupSnapshot c8f77ff9-55e6-4598-8d29-4552ebf446fc: creating. Aug 29 01:10:22 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-2d8b083f-ae59-4e2f-831a-6fc3c8d405ed tempest-GroupSnapshotsTest-379341379 None] Group snapshot c8f77ff9-55e6-4598-8d29-4552ebf446fc: creating. {{(pid=86111) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Aug 29 01:10:22 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-2d8b083f-ae59-4e2f-831a-6fc3c8d405ed tempest-GroupSnapshotsTest-379341379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:10:22 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-2d8b083f-ae59-4e2f-831a-6fc3c8d405ed tempest-GroupSnapshotsTest-379341379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:10:22 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-2d8b083f-ae59-4e2f-831a-6fc3c8d405ed tempest-GroupSnapshotsTest-379341379 None] Creating offline snapshot ccee00b2-db87-458b-bbc2-818544b48220 of volume 874c7050-c7a8-4720-935f-d14db2f4b4eb {{(pid=86111) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 29 01:10:22 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[44349ef1-9880-426e-9ecf-219882b5a6a6]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:10:22 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-2d8b083f-ae59-4e2f-831a-6fc3c8d405ed tempest-GroupSnapshotsTest-379341379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-874c7050-c7a8-4720-935f-d14db2f4b4eb {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:10:22 devstack sudo[87793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-874c7050-c7a8-4720-935f-d14db2f4b4eb Aug 29 01:10:22 devstack sudo[87793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:10:22 devstack sudo[87793]: pam_unix(sudo:session): session closed for user root Aug 29 01:10:22 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-2d8b083f-ae59-4e2f-831a-6fc3c8d405ed tempest-GroupSnapshotsTest-379341379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-874c7050-c7a8-4720-935f-d14db2f4b4eb" returned: 0 in 0.428s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:10:22 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-2d8b083f-ae59-4e2f-831a-6fc3c8d405ed tempest-GroupSnapshotsTest-379341379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-874c7050-c7a8-4720-935f-d14db2f4b4eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-874c7050-c7a8-4720-935f-d14db2f4b4eb.ccee00b2-db87-458b-bbc2-818544b48220 1G {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:10:22 devstack sudo[87799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-874c7050-c7a8-4720-935f-d14db2f4b4eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-874c7050-c7a8-4720-935f-d14db2f4b4eb.ccee00b2-db87-458b-bbc2-818544b48220 1G Aug 29 01:10:22 devstack sudo[87799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:10:23 devstack sudo[87799]: pam_unix(sudo:session): session closed for user root Aug 29 01:10:23 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-2d8b083f-ae59-4e2f-831a-6fc3c8d405ed tempest-GroupSnapshotsTest-379341379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-874c7050-c7a8-4720-935f-d14db2f4b4eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-874c7050-c7a8-4720-935f-d14db2f4b4eb.ccee00b2-db87-458b-bbc2-818544b48220 1G" returned: 0 in 0.521s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:10:23 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-2d8b083f-ae59-4e2f-831a-6fc3c8d405ed tempest-GroupSnapshotsTest-379341379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-874c7050-c7a8-4720-935f-d14db2f4b4eb -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-874c7050-c7a8-4720-935f-d14db2f4b4eb.ccee00b2-db87-458b-bbc2-818544b48220 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:10:23 devstack sudo[87805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-874c7050-c7a8-4720-935f-d14db2f4b4eb -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-874c7050-c7a8-4720-935f-d14db2f4b4eb.ccee00b2-db87-458b-bbc2-818544b48220 Aug 29 01:10:23 devstack sudo[87805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:10:23 devstack sudo[87805]: pam_unix(sudo:session): session closed for user root Aug 29 01:10:23 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-2d8b083f-ae59-4e2f-831a-6fc3c8d405ed tempest-GroupSnapshotsTest-379341379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-874c7050-c7a8-4720-935f-d14db2f4b4eb -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-874c7050-c7a8-4720-935f-d14db2f4b4eb.ccee00b2-db87-458b-bbc2-818544b48220" returned: 0 in 0.341s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:10:23 devstack cinder-volume[86111]: WARNING cinder.volume.drivers.remotefs [None req-2d8b083f-ae59-4e2f-831a-6fc3c8d405ed tempest-GroupSnapshotsTest-379341379 None] /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-874c7050-c7a8-4720-935f-d14db2f4b4eb.ccee00b2-db87-458b-bbc2-818544b48220 is being set with open permissions: ugo+rw: NotImplementedError Aug 29 01:10:23 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-2d8b083f-ae59-4e2f-831a-6fc3c8d405ed tempest-GroupSnapshotsTest-379341379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-874c7050-c7a8-4720-935f-d14db2f4b4eb.ccee00b2-db87-458b-bbc2-818544b48220 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:10:23 devstack sudo[87810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-874c7050-c7a8-4720-935f-d14db2f4b4eb.ccee00b2-db87-458b-bbc2-818544b48220 Aug 29 01:10:23 devstack sudo[87810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:10:24 devstack sudo[87810]: pam_unix(sudo:session): session closed for user root Aug 29 01:10:24 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-2d8b083f-ae59-4e2f-831a-6fc3c8d405ed tempest-GroupSnapshotsTest-379341379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-874c7050-c7a8-4720-935f-d14db2f4b4eb.ccee00b2-db87-458b-bbc2-818544b48220" returned: 0 in 0.282s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:10:24 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-2d8b083f-ae59-4e2f-831a-6fc3c8d405ed tempest-GroupSnapshotsTest-379341379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-874c7050-c7a8-4720-935f-d14db2f4b4eb.info {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:10:24 devstack sudo[87815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-874c7050-c7a8-4720-935f-d14db2f4b4eb.info Aug 29 01:10:24 devstack sudo[87815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:10:24 devstack sudo[87815]: pam_unix(sudo:session): session closed for user root Aug 29 01:10:24 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-2d8b083f-ae59-4e2f-831a-6fc3c8d405ed tempest-GroupSnapshotsTest-379341379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-874c7050-c7a8-4720-935f-d14db2f4b4eb.info" returned: 0 in 0.269s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:10:24 devstack cinder-volume[86111]: WARNING cinder.volume.drivers.remotefs [None req-2d8b083f-ae59-4e2f-831a-6fc3c8d405ed tempest-GroupSnapshotsTest-379341379 None] /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-874c7050-c7a8-4720-935f-d14db2f4b4eb.info is being set with open permissions: ugo+rw: NotImplementedError Aug 29 01:10:24 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-2d8b083f-ae59-4e2f-831a-6fc3c8d405ed tempest-GroupSnapshotsTest-379341379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-874c7050-c7a8-4720-935f-d14db2f4b4eb.info {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:10:24 devstack sudo[87818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-874c7050-c7a8-4720-935f-d14db2f4b4eb.info Aug 29 01:10:24 devstack sudo[87818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:10:24 devstack sudo[87818]: pam_unix(sudo:session): session closed for user root Aug 29 01:10:24 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-2d8b083f-ae59-4e2f-831a-6fc3c8d405ed tempest-GroupSnapshotsTest-379341379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-874c7050-c7a8-4720-935f-d14db2f4b4eb.info" returned: 0 in 0.299s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:10:24 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-2d8b083f-ae59-4e2f-831a-6fc3c8d405ed tempest-GroupSnapshotsTest-379341379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.234s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:10:24 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-2d8b083f-ae59-4e2f-831a-6fc3c8d405ed tempest-GroupSnapshotsTest-379341379 None] group_snapshot c8f77ff9-55e6-4598-8d29-4552ebf446fc: created successfully Aug 29 01:10:26 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-10a08600-43d1-4088-b369-d019f7238007 tempest-GroupSnapshotsTest-379341379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:10:26 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-10a08600-43d1-4088-b369-d019f7238007 tempest-GroupSnapshotsTest-379341379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:10:26 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-10a08600-43d1-4088-b369-d019f7238007 tempest-GroupSnapshotsTest-379341379 None] Acquiring lock "cinder-quobyte-ccee00b2-db87-458b-bbc2-818544b48220-78c42d9d-c843-417b-bed8-fd5df3d6524f" by "_create_volume_from_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:10:26 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-10a08600-43d1-4088-b369-d019f7238007 tempest-GroupSnapshotsTest-379341379 None] Lock "cinder-quobyte-ccee00b2-db87-458b-bbc2-818544b48220-78c42d9d-c843-417b-bed8-fd5df3d6524f" acquired by "_create_volume_from_snapshot" :: waited 0.032s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:10:26 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-10a08600-43d1-4088-b369-d019f7238007 tempest-GroupSnapshotsTest-379341379 None] Creating volume 78c42d9d-c843-417b-bed8-fd5df3d6524f from snapshot ccee00b2-db87-458b-bbc2-818544b48220 {{(pid=86111) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Aug 29 01:10:26 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-10a08600-43d1-4088-b369-d019f7238007 tempest-GroupSnapshotsTest-379341379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:10:26 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-10a08600-43d1-4088-b369-d019f7238007 tempest-GroupSnapshotsTest-379341379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:10:26 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-10a08600-43d1-4088-b369-d019f7238007 tempest-GroupSnapshotsTest-379341379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:10:26 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-10a08600-43d1-4088-b369-d019f7238007 tempest-GroupSnapshotsTest-379341379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:10:26 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-10a08600-43d1-4088-b369-d019f7238007 tempest-GroupSnapshotsTest-379341379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:10:26 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-10a08600-43d1-4088-b369-d019f7238007 tempest-GroupSnapshotsTest-379341379 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:10:26 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-10a08600-43d1-4088-b369-d019f7238007 tempest-GroupSnapshotsTest-379341379 None] Acquiring lock "cinder-quobyte-78c42d9d-c843-417b-bed8-fd5df3d6524f" by "_copy_volume_from_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:10:26 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-10a08600-43d1-4088-b369-d019f7238007 tempest-GroupSnapshotsTest-379341379 None] Lock "cinder-quobyte-78c42d9d-c843-417b-bed8-fd5df3d6524f" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:10:26 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-10a08600-43d1-4088-b369-d019f7238007 tempest-GroupSnapshotsTest-379341379 None] snapshot: ccee00b2-db87-458b-bbc2-818544b48220, volume: 78c42d9d-c843-417b-bed8-fd5df3d6524f, {{(pid=86111) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 29 01:10:26 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-10a08600-43d1-4088-b369-d019f7238007 tempest-GroupSnapshotsTest-379341379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:10:26 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-10a08600-43d1-4088-b369-d019f7238007 tempest-GroupSnapshotsTest-379341379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:10:26 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-10a08600-43d1-4088-b369-d019f7238007 tempest-GroupSnapshotsTest-379341379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:10:26 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-10a08600-43d1-4088-b369-d019f7238007 tempest-GroupSnapshotsTest-379341379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:10:26 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-10a08600-43d1-4088-b369-d019f7238007 tempest-GroupSnapshotsTest-379341379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:10:26 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[2188da07-43b0-4169-a6ae-8f3991ce9416]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:10:26 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-10a08600-43d1-4088-b369-d019f7238007 tempest-GroupSnapshotsTest-379341379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-874c7050-c7a8-4720-935f-d14db2f4b4eb.ccee00b2-db87-458b-bbc2-818544b48220 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:10:26 devstack sudo[87821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-874c7050-c7a8-4720-935f-d14db2f4b4eb.ccee00b2-db87-458b-bbc2-818544b48220 Aug 29 01:10:26 devstack sudo[87821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:10:27 devstack sudo[87821]: pam_unix(sudo:session): session closed for user root Aug 29 01:10:27 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-10a08600-43d1-4088-b369-d019f7238007 tempest-GroupSnapshotsTest-379341379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-874c7050-c7a8-4720-935f-d14db2f4b4eb.ccee00b2-db87-458b-bbc2-818544b48220" returned: 0 in 0.470s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:10:27 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-10a08600-43d1-4088-b369-d019f7238007 tempest-GroupSnapshotsTest-379341379 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-874c7050-c7a8-4720-935f-d14db2f4b4eb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 29 01:10:27 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebd52c50-0219-46be-8f31-ee59f70e0cdd]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:10:27 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-10a08600-43d1-4088-b369-d019f7238007 tempest-GroupSnapshotsTest-379341379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-874c7050-c7a8-4720-935f-d14db2f4b4eb {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:10:27 devstack sudo[87826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-874c7050-c7a8-4720-935f-d14db2f4b4eb Aug 29 01:10:27 devstack sudo[87826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:10:27 devstack sudo[87826]: pam_unix(sudo:session): session closed for user root Aug 29 01:10:27 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-10a08600-43d1-4088-b369-d019f7238007 tempest-GroupSnapshotsTest-379341379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-874c7050-c7a8-4720-935f-d14db2f4b4eb" returned: 0 in 0.553s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:10:27 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-10a08600-43d1-4088-b369-d019f7238007 tempest-GroupSnapshotsTest-379341379 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-874c7050-c7a8-4720-935f-d14db2f4b4eb {{(pid=86111) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 29 01:10:27 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-10a08600-43d1-4088-b369-d019f7238007 tempest-GroupSnapshotsTest-379341379 None] Creating direct copy from snapshot {{(pid=86111) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 29 01:10:27 devstack cinder-volume[86111]: DEBUG cinder.utils [None req-10a08600-43d1-4088-b369-d019f7238007 tempest-GroupSnapshotsTest-379341379 None] Path /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-78c42d9d-c843-417b-bed8-fd5df3d6524f not found in is_blk_device check {{(pid=86111) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 29 01:10:27 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-10a08600-43d1-4088-b369-d019f7238007 tempest-GroupSnapshotsTest-379341379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-874c7050-c7a8-4720-935f-d14db2f4b4eb /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-78c42d9d-c843-417b-bed8-fd5df3d6524f {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:10:27 devstack sudo[87831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-874c7050-c7a8-4720-935f-d14db2f4b4eb /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-78c42d9d-c843-417b-bed8-fd5df3d6524f Aug 29 01:10:27 devstack sudo[87831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:10:34 devstack sudo[87831]: pam_unix(sudo:session): session closed for user root Aug 29 01:10:34 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-10a08600-43d1-4088-b369-d019f7238007 tempest-GroupSnapshotsTest-379341379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-874c7050-c7a8-4720-935f-d14db2f4b4eb /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-78c42d9d-c843-417b-bed8-fd5df3d6524f" returned: 0 in 6.656s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:10:34 devstack cinder-volume[86111]: DEBUG cinder.image.image_utils [None req-10a08600-43d1-4088-b369-d019f7238007 tempest-GroupSnapshotsTest-379341379 None] Image conversion details: src /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-874c7050-c7a8-4720-935f-d14db2f4b4eb, size 1024.00 MB, duration 6.66 sec, destination /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-78c42d9d-c843-417b-bed8-fd5df3d6524f {{(pid=86111) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 29 01:10:34 devstack cinder-volume[86111]: INFO cinder.image.image_utils [None req-10a08600-43d1-4088-b369-d019f7238007 tempest-GroupSnapshotsTest-379341379 None] Converted 1024.00 MB image at 153.79 MB/s Aug 29 01:10:34 devstack cinder-volume[86111]: WARNING cinder.volume.drivers.remotefs [None req-10a08600-43d1-4088-b369-d019f7238007 tempest-GroupSnapshotsTest-379341379 None] /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-78c42d9d-c843-417b-bed8-fd5df3d6524f is being set with open permissions: ugo+rw: NotImplementedError Aug 29 01:10:34 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-10a08600-43d1-4088-b369-d019f7238007 tempest-GroupSnapshotsTest-379341379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-78c42d9d-c843-417b-bed8-fd5df3d6524f {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:10:34 devstack sudo[87859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-78c42d9d-c843-417b-bed8-fd5df3d6524f Aug 29 01:10:34 devstack sudo[87859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:10:34 devstack sudo[87859]: pam_unix(sudo:session): session closed for user root Aug 29 01:10:34 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-10a08600-43d1-4088-b369-d019f7238007 tempest-GroupSnapshotsTest-379341379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-78c42d9d-c843-417b-bed8-fd5df3d6524f" returned: 0 in 0.310s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:10:34 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-10a08600-43d1-4088-b369-d019f7238007 tempest-GroupSnapshotsTest-379341379 None] Lock "cinder-quobyte-78c42d9d-c843-417b-bed8-fd5df3d6524f" released by "_copy_volume_from_snapshot" :: held 8.091s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:10:34 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-10a08600-43d1-4088-b369-d019f7238007 tempest-GroupSnapshotsTest-379341379 None] Lock "cinder-quobyte-ccee00b2-db87-458b-bbc2-818544b48220-78c42d9d-c843-417b-bed8-fd5df3d6524f" released by "_create_volume_from_snapshot" :: held 8.186s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:10:34 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-10a08600-43d1-4088-b369-d019f7238007 tempest-GroupSnapshotsTest-379341379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.219s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:10:35 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-10a08600-43d1-4088-b369-d019f7238007 tempest-GroupSnapshotsTest-379341379 None] Create group from source-snapshot-c8f77ff9-55e6-4598-8d29-4552ebf446fc completed successfully. Aug 29 01:10:35 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-68963c76-0f52-49a9-8c4c-a0126cb184fd tempest-GroupSnapshotsTest-379341379 None] Acquiring lock "cinder-quobyte-78c42d9d-c843-417b-bed8-fd5df3d6524f" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:10:35 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-68963c76-0f52-49a9-8c4c-a0126cb184fd tempest-GroupSnapshotsTest-379341379 None] Lock "cinder-quobyte-78c42d9d-c843-417b-bed8-fd5df3d6524f" acquired by "delete_volume" :: waited 0.013s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:10:35 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b3b1037-e8ab-4132-ad1e-f01c58edb375]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:10:35 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-68963c76-0f52-49a9-8c4c-a0126cb184fd tempest-GroupSnapshotsTest-379341379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-78c42d9d-c843-417b-bed8-fd5df3d6524f {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:10:36 devstack sudo[87862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-78c42d9d-c843-417b-bed8-fd5df3d6524f Aug 29 01:10:36 devstack sudo[87862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:10:36 devstack sudo[87862]: pam_unix(sudo:session): session closed for user root Aug 29 01:10:36 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-68963c76-0f52-49a9-8c4c-a0126cb184fd tempest-GroupSnapshotsTest-379341379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-78c42d9d-c843-417b-bed8-fd5df3d6524f" returned: 0 in 0.451s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:10:36 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-68963c76-0f52-49a9-8c4c-a0126cb184fd tempest-GroupSnapshotsTest-379341379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-78c42d9d-c843-417b-bed8-fd5df3d6524f {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:10:36 devstack sudo[87867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-78c42d9d-c843-417b-bed8-fd5df3d6524f Aug 29 01:10:36 devstack sudo[87867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:10:36 devstack sudo[87867]: pam_unix(sudo:session): session closed for user root Aug 29 01:10:36 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-68963c76-0f52-49a9-8c4c-a0126cb184fd tempest-GroupSnapshotsTest-379341379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-78c42d9d-c843-417b-bed8-fd5df3d6524f" returned: 0 in 0.282s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:10:36 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-68963c76-0f52-49a9-8c4c-a0126cb184fd tempest-GroupSnapshotsTest-379341379 None] Lock "cinder-quobyte-78c42d9d-c843-417b-bed8-fd5df3d6524f" released by "delete_volume" :: held 0.791s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:10:36 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-68963c76-0f52-49a9-8c4c-a0126cb184fd tempest-GroupSnapshotsTest-379341379 None] Created reservations ['ae49935f-4412-4f34-bd29-4d26045c065f'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:10:36 devstack cinder-volume[86111]: WARNING cinder.quota [None req-68963c76-0f52-49a9-8c4c-a0126cb184fd tempest-GroupSnapshotsTest-379341379 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-710428203 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-710428203, it is now deprecated. Please use the default quota class for default quota. Aug 29 01:10:36 devstack cinder-volume[86111]: WARNING cinder.quota [None req-68963c76-0f52-49a9-8c4c-a0126cb184fd tempest-GroupSnapshotsTest-379341379 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-710428203 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-710428203, it is now deprecated. Please use the default quota class for default quota. Aug 29 01:10:36 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-68963c76-0f52-49a9-8c4c-a0126cb184fd tempest-GroupSnapshotsTest-379341379 None] Created reservations ['a565a1b1-7407-4e4d-9edf-e17245e9eb61', '677eee66-e6e1-463b-a124-877556c52893', 'ed9e3181-6377-4b4c-aeda-c9f95fa97042', 'cf0bf39b-2095-44b4-b331-bd836d718e97'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:10:36 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-68963c76-0f52-49a9-8c4c-a0126cb184fd tempest-GroupSnapshotsTest-379341379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:10:36 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-68963c76-0f52-49a9-8c4c-a0126cb184fd tempest-GroupSnapshotsTest-379341379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:10:36 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-68963c76-0f52-49a9-8c4c-a0126cb184fd tempest-GroupSnapshotsTest-379341379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:10:36 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-68963c76-0f52-49a9-8c4c-a0126cb184fd tempest-GroupSnapshotsTest-379341379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:10:36 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-68963c76-0f52-49a9-8c4c-a0126cb184fd tempest-GroupSnapshotsTest-379341379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:10:36 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-68963c76-0f52-49a9-8c4c-a0126cb184fd tempest-GroupSnapshotsTest-379341379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:10:36 devstack sudo[87872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:10:36 devstack sudo[87872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:10:37 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-11f26343-545b-45f8-90e5-6018904c3208 tempest-GroupSnapshotsTest-379341379 None] group_snapshot c8f77ff9-55e6-4598-8d29-4552ebf446fc: deleting Aug 29 01:10:37 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-11f26343-545b-45f8-90e5-6018904c3208 tempest-GroupSnapshotsTest-379341379 None] group_snapshot c8f77ff9-55e6-4598-8d29-4552ebf446fc: deleting {{(pid=86111) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Aug 29 01:10:37 devstack sudo[87872]: pam_unix(sudo:session): session closed for user root Aug 29 01:10:37 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-68963c76-0f52-49a9-8c4c-a0126cb184fd tempest-GroupSnapshotsTest-379341379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.348s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:10:37 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-68963c76-0f52-49a9-8c4c-a0126cb184fd tempest-GroupSnapshotsTest-379341379 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:10:37 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-11f26343-545b-45f8-90e5-6018904c3208 tempest-GroupSnapshotsTest-379341379 None] Acquiring lock "cinder-quobyte-874c7050-c7a8-4720-935f-d14db2f4b4eb" by "delete_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:10:37 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-68963c76-0f52-49a9-8c4c-a0126cb184fd tempest-GroupSnapshotsTest-379341379 None] Delete group completed successfully. Aug 29 01:10:37 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-11f26343-545b-45f8-90e5-6018904c3208 tempest-GroupSnapshotsTest-379341379 None] Lock "cinder-quobyte-874c7050-c7a8-4720-935f-d14db2f4b4eb" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:10:37 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-11f26343-545b-45f8-90e5-6018904c3208 tempest-GroupSnapshotsTest-379341379 None] Acquiring lock "cinder-quobyte-ccee00b2-db87-458b-bbc2-818544b48220" by "_delete_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:10:37 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-11f26343-545b-45f8-90e5-6018904c3208 tempest-GroupSnapshotsTest-379341379 None] Lock "cinder-quobyte-ccee00b2-db87-458b-bbc2-818544b48220" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:10:37 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-11f26343-545b-45f8-90e5-6018904c3208 tempest-GroupSnapshotsTest-379341379 None] Deleting offline snapshot ccee00b2-db87-458b-bbc2-818544b48220 of volume 874c7050-c7a8-4720-935f-d14db2f4b4eb {{(pid=86111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 29 01:10:37 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-11f26343-545b-45f8-90e5-6018904c3208 tempest-GroupSnapshotsTest-379341379 None] snapshot_file for this snap is: volume-874c7050-c7a8-4720-935f-d14db2f4b4eb.ccee00b2-db87-458b-bbc2-818544b48220 {{(pid=86111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 29 01:10:37 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e1bb0ae-7d8d-44df-b019-90d311997e09]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:10:37 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-11f26343-545b-45f8-90e5-6018904c3208 tempest-GroupSnapshotsTest-379341379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-874c7050-c7a8-4720-935f-d14db2f4b4eb.ccee00b2-db87-458b-bbc2-818544b48220 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:10:37 devstack sudo[87875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-874c7050-c7a8-4720-935f-d14db2f4b4eb.ccee00b2-db87-458b-bbc2-818544b48220 Aug 29 01:10:37 devstack sudo[87875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:10:37 devstack sudo[87875]: pam_unix(sudo:session): session closed for user root Aug 29 01:10:37 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-11f26343-545b-45f8-90e5-6018904c3208 tempest-GroupSnapshotsTest-379341379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-874c7050-c7a8-4720-935f-d14db2f4b4eb.ccee00b2-db87-458b-bbc2-818544b48220" returned: 0 in 0.460s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:10:37 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-11f26343-545b-45f8-90e5-6018904c3208 tempest-GroupSnapshotsTest-379341379 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-874c7050-c7a8-4720-935f-d14db2f4b4eb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 29 01:10:37 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[df2fbbab-ae0d-4ec0-bf23-20680f99ae45]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:10:37 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-11f26343-545b-45f8-90e5-6018904c3208 tempest-GroupSnapshotsTest-379341379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-874c7050-c7a8-4720-935f-d14db2f4b4eb {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:10:38 devstack sudo[87880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-874c7050-c7a8-4720-935f-d14db2f4b4eb Aug 29 01:10:38 devstack sudo[87880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:10:38 devstack sudo[87880]: pam_unix(sudo:session): session closed for user root Aug 29 01:10:38 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-11f26343-545b-45f8-90e5-6018904c3208 tempest-GroupSnapshotsTest-379341379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-874c7050-c7a8-4720-935f-d14db2f4b4eb" returned: 0 in 0.734s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:10:38 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-11f26343-545b-45f8-90e5-6018904c3208 tempest-GroupSnapshotsTest-379341379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-874c7050-c7a8-4720-935f-d14db2f4b4eb.ccee00b2-db87-458b-bbc2-818544b48220 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:10:38 devstack sudo[87888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-874c7050-c7a8-4720-935f-d14db2f4b4eb.ccee00b2-db87-458b-bbc2-818544b48220 Aug 29 01:10:38 devstack sudo[87888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:10:39 devstack sudo[87888]: pam_unix(sudo:session): session closed for user root Aug 29 01:10:39 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-11f26343-545b-45f8-90e5-6018904c3208 tempest-GroupSnapshotsTest-379341379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-874c7050-c7a8-4720-935f-d14db2f4b4eb.ccee00b2-db87-458b-bbc2-818544b48220" returned: 0 in 0.518s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:10:39 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-11f26343-545b-45f8-90e5-6018904c3208 tempest-GroupSnapshotsTest-379341379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-874c7050-c7a8-4720-935f-d14db2f4b4eb.ccee00b2-db87-458b-bbc2-818544b48220 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:10:39 devstack sudo[87899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-874c7050-c7a8-4720-935f-d14db2f4b4eb.ccee00b2-db87-458b-bbc2-818544b48220 Aug 29 01:10:39 devstack sudo[87899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:10:39 devstack sudo[87899]: pam_unix(sudo:session): session closed for user root Aug 29 01:10:39 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-11f26343-545b-45f8-90e5-6018904c3208 tempest-GroupSnapshotsTest-379341379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-874c7050-c7a8-4720-935f-d14db2f4b4eb.ccee00b2-db87-458b-bbc2-818544b48220" returned: 0 in 0.293s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:10:39 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-11f26343-545b-45f8-90e5-6018904c3208 tempest-GroupSnapshotsTest-379341379 None] Lock "cinder-quobyte-ccee00b2-db87-458b-bbc2-818544b48220" released by "_delete_snapshot" :: held 2.158s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:10:39 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-11f26343-545b-45f8-90e5-6018904c3208 tempest-GroupSnapshotsTest-379341379 None] Lock "cinder-quobyte-874c7050-c7a8-4720-935f-d14db2f4b4eb" released by "delete_snapshot" :: held 2.204s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:10:39 devstack cinder-volume[86111]: WARNING cinder.quota [None req-11f26343-545b-45f8-90e5-6018904c3208 tempest-GroupSnapshotsTest-379341379 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-710428203 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-710428203, it is now deprecated. Please use the default quota class for default quota. Aug 29 01:10:39 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-11f26343-545b-45f8-90e5-6018904c3208 tempest-GroupSnapshotsTest-379341379 None] Created reservations ['6081f1c4-e3ab-436d-acbf-5714d3bde1f2', 'b5824a53-369f-4ae1-add8-fadfa5ee6a5a', 'ba261b13-ec27-4a96-b7fe-af9a6a8fbd00', 'f833acea-86b3-472f-9a0f-9164ea80ff83'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:10:39 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-11f26343-545b-45f8-90e5-6018904c3208 tempest-GroupSnapshotsTest-379341379 None] group_snapshot c8f77ff9-55e6-4598-8d29-4552ebf446fc: deleted successfully Aug 29 01:10:41 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-dcbcc20c-642f-4911-874a-c3a57cd0a632 tempest-GroupSnapshotsTest-379341379 None] Acquiring lock "cinder-quobyte-874c7050-c7a8-4720-935f-d14db2f4b4eb" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:10:41 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-dcbcc20c-642f-4911-874a-c3a57cd0a632 tempest-GroupSnapshotsTest-379341379 None] Lock "cinder-quobyte-874c7050-c7a8-4720-935f-d14db2f4b4eb" acquired by "delete_volume" :: waited 0.033s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:10:41 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[43ff0b60-cf2d-4e5e-8086-1cac4ebe587f]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:10:41 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-dcbcc20c-642f-4911-874a-c3a57cd0a632 tempest-GroupSnapshotsTest-379341379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-874c7050-c7a8-4720-935f-d14db2f4b4eb {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:10:41 devstack sudo[87907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-874c7050-c7a8-4720-935f-d14db2f4b4eb Aug 29 01:10:41 devstack sudo[87907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:10:41 devstack sudo[87907]: pam_unix(sudo:session): session closed for user root Aug 29 01:10:41 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-dcbcc20c-642f-4911-874a-c3a57cd0a632 tempest-GroupSnapshotsTest-379341379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-874c7050-c7a8-4720-935f-d14db2f4b4eb" returned: 0 in 0.503s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:10:41 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-dcbcc20c-642f-4911-874a-c3a57cd0a632 tempest-GroupSnapshotsTest-379341379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-874c7050-c7a8-4720-935f-d14db2f4b4eb {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:10:41 devstack sudo[87923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-874c7050-c7a8-4720-935f-d14db2f4b4eb Aug 29 01:10:41 devstack sudo[87923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:10:42 devstack sudo[87923]: pam_unix(sudo:session): session closed for user root Aug 29 01:10:42 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-dcbcc20c-642f-4911-874a-c3a57cd0a632 tempest-GroupSnapshotsTest-379341379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-874c7050-c7a8-4720-935f-d14db2f4b4eb" returned: 0 in 0.333s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:10:42 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-dcbcc20c-642f-4911-874a-c3a57cd0a632 tempest-GroupSnapshotsTest-379341379 None] Lock "cinder-quobyte-874c7050-c7a8-4720-935f-d14db2f4b4eb" released by "delete_volume" :: held 0.935s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:10:42 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-dcbcc20c-642f-4911-874a-c3a57cd0a632 tempest-GroupSnapshotsTest-379341379 None] Created reservations ['b43fa740-9099-4628-bb45-08420d031df8'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:10:42 devstack cinder-volume[86111]: WARNING cinder.db.api [None req-dcbcc20c-642f-4911-874a-c3a57cd0a632 tempest-GroupSnapshotsTest-379341379 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-710428203'] Aug 29 01:10:42 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-dcbcc20c-642f-4911-874a-c3a57cd0a632 tempest-GroupSnapshotsTest-379341379 None] Created reservations ['334904c0-712e-4336-8ffd-0a059f245973', '06c5c27f-1002-4f40-a1ec-5a23df9b985e', 'a69dde70-c946-4260-8c38-857e6b0c80a0', '26291475-785e-4e30-a0ae-cbd0cdd347c1'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:10:42 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-dcbcc20c-642f-4911-874a-c3a57cd0a632 tempest-GroupSnapshotsTest-379341379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:10:42 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-dcbcc20c-642f-4911-874a-c3a57cd0a632 tempest-GroupSnapshotsTest-379341379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:10:42 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-dcbcc20c-642f-4911-874a-c3a57cd0a632 tempest-GroupSnapshotsTest-379341379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:10:42 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-dcbcc20c-642f-4911-874a-c3a57cd0a632 tempest-GroupSnapshotsTest-379341379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:10:42 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-dcbcc20c-642f-4911-874a-c3a57cd0a632 tempest-GroupSnapshotsTest-379341379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:10:42 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-dcbcc20c-642f-4911-874a-c3a57cd0a632 tempest-GroupSnapshotsTest-379341379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:10:42 devstack sudo[87932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:10:42 devstack sudo[87932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:10:42 devstack sudo[87932]: pam_unix(sudo:session): session closed for user root Aug 29 01:10:42 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-dcbcc20c-642f-4911-874a-c3a57cd0a632 tempest-GroupSnapshotsTest-379341379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.389s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:10:42 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-dcbcc20c-642f-4911-874a-c3a57cd0a632 tempest-GroupSnapshotsTest-379341379 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:10:42 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-dcbcc20c-642f-4911-874a-c3a57cd0a632 tempest-GroupSnapshotsTest-379341379 None] Delete group completed successfully. Aug 29 01:10:43 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-08246204-17f5-4a39-b620-d59a7d132166 tempest-GroupSnapshotsTest-379341379 None] Group tempest-GroupSnapshotsTest-Group-1633044731: creating Aug 29 01:10:43 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-08246204-17f5-4a39-b620-d59a7d132166 tempest-GroupSnapshotsTest-379341379 None] Group tempest-GroupSnapshotsTest-Group-1633044731: created successfully Aug 29 01:10:43 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-08246204-17f5-4a39-b620-d59a7d132166 tempest-GroupSnapshotsTest-379341379 None] Create group completed successfully. Aug 29 01:10:44 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-9cdce280-3156-4e5b-903d-9cf9e17df0ea tempest-GroupSnapshotsTest-379341379 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:10:44 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-9cdce280-3156-4e5b-903d-9cf9e17df0ea tempest-GroupSnapshotsTest-379341379 None] Flow 'volume_create_manager' (c671b4e1-983e-472c-9407-899321c90a70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:10:44 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-9cdce280-3156-4e5b-903d-9cf9e17df0ea tempest-GroupSnapshotsTest-379341379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4acc72d2-dcbb-450e-ac7f-f374e943b6fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:10:44 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-9cdce280-3156-4e5b-903d-9cf9e17df0ea tempest-GroupSnapshotsTest-379341379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4acc72d2-dcbb-450e-ac7f-f374e943b6fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:10:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1753049909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=31c9f2dc-f976-40bc-999c-605a65dc655f,host='devstack@QuobyteHD#QuobyteHD',id=ad333ea0-4316-48e6-a15c-96693d2fbb14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50787aacf8064212b410d4f97d55d629',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:10:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:10:45Z,use_quota=True,user_id='2c6852d5bcec4367a445767ca79915fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1426382f-16e3-4b2a-890b-81a03b8ac619),volume_type_id=1426382f-16e3-4b2a-890b-81a03b8ac619)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:10:44 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-9cdce280-3156-4e5b-903d-9cf9e17df0ea tempest-GroupSnapshotsTest-379341379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04445894-9978-4534-8c9b-5d2b0c6bc0f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:10:44 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-9cdce280-3156-4e5b-903d-9cf9e17df0ea tempest-GroupSnapshotsTest-379341379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04445894-9978-4534-8c9b-5d2b0c6bc0f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:10:44 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-9cdce280-3156-4e5b-903d-9cf9e17df0ea tempest-GroupSnapshotsTest-379341379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbb3cad2-1c07-4664-b3d4-09d4b8c8bcb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:10:44 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-9cdce280-3156-4e5b-903d-9cf9e17df0ea tempest-GroupSnapshotsTest-379341379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbb3cad2-1c07-4664-b3d4-09d4b8c8bcb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad333ea0-4316-48e6-a15c-96693d2fbb14', 'volume_name': 'volume-ad333ea0-4316-48e6-a15c-96693d2fbb14', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:10:45 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-9cdce280-3156-4e5b-903d-9cf9e17df0ea tempest-GroupSnapshotsTest-379341379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (519520a1-e96b-407c-a14f-94c9982d2e6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:10:45 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-9cdce280-3156-4e5b-903d-9cf9e17df0ea tempest-GroupSnapshotsTest-379341379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (519520a1-e96b-407c-a14f-94c9982d2e6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:10:45 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-9cdce280-3156-4e5b-903d-9cf9e17df0ea tempest-GroupSnapshotsTest-379341379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89a28105-7b7e-44a9-b17a-e2bdc9a0daf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:10:45 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-9cdce280-3156-4e5b-903d-9cf9e17df0ea tempest-GroupSnapshotsTest-379341379 None] Volume ad333ea0-4316-48e6-a15c-96693d2fbb14: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad333ea0-4316-48e6-a15c-96693d2fbb14', 'volume_size': 1} Aug 29 01:10:45 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-9cdce280-3156-4e5b-903d-9cf9e17df0ea tempest-GroupSnapshotsTest-379341379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:10:45 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-9cdce280-3156-4e5b-903d-9cf9e17df0ea tempest-GroupSnapshotsTest-379341379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:10:45 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-9cdce280-3156-4e5b-903d-9cf9e17df0ea tempest-GroupSnapshotsTest-379341379 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=31c9f2dc-f976-40bc-999c-605a65dc655f,created_at=2026-08-28T23:10:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1753049909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=31c9f2dc-f976-40bc-999c-605a65dc655f,host='devstack@QuobyteHD#QuobyteHD',id=ad333ea0-4316-48e6-a15c-96693d2fbb14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50787aacf8064212b410d4f97d55d629',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:10:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:10:45Z,use_quota=True,user_id='2c6852d5bcec4367a445767ca79915fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1426382f-16e3-4b2a-890b-81a03b8ac619),volume_type_id=1426382f-16e3-4b2a-890b-81a03b8ac619)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:10:45 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-9cdce280-3156-4e5b-903d-9cf9e17df0ea tempest-GroupSnapshotsTest-379341379 None] Creating volume ad333ea0-4316-48e6-a15c-96693d2fbb14 {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:10:45 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-9cdce280-3156-4e5b-903d-9cf9e17df0ea tempest-GroupSnapshotsTest-379341379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:10:45 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-9cdce280-3156-4e5b-903d-9cf9e17df0ea tempest-GroupSnapshotsTest-379341379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:10:45 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-9cdce280-3156-4e5b-903d-9cf9e17df0ea tempest-GroupSnapshotsTest-379341379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:10:45 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-9cdce280-3156-4e5b-903d-9cf9e17df0ea tempest-GroupSnapshotsTest-379341379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:10:45 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-9cdce280-3156-4e5b-903d-9cf9e17df0ea tempest-GroupSnapshotsTest-379341379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:10:45 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-9cdce280-3156-4e5b-903d-9cf9e17df0ea tempest-GroupSnapshotsTest-379341379 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:10:45 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-9cdce280-3156-4e5b-903d-9cf9e17df0ea tempest-GroupSnapshotsTest-379341379 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:10:45 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-9cdce280-3156-4e5b-903d-9cf9e17df0ea tempest-GroupSnapshotsTest-379341379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ad333ea0-4316-48e6-a15c-96693d2fbb14 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:10:45 devstack sudo[87935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ad333ea0-4316-48e6-a15c-96693d2fbb14 1073741824 Aug 29 01:10:45 devstack sudo[87935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:10:45 devstack sudo[87935]: pam_unix(sudo:session): session closed for user root Aug 29 01:10:45 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-9cdce280-3156-4e5b-903d-9cf9e17df0ea tempest-GroupSnapshotsTest-379341379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ad333ea0-4316-48e6-a15c-96693d2fbb14 1073741824" returned: 0 in 0.580s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:10:45 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-9cdce280-3156-4e5b-903d-9cf9e17df0ea tempest-GroupSnapshotsTest-379341379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ad333ea0-4316-48e6-a15c-96693d2fbb14 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:10:45 devstack sudo[87941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ad333ea0-4316-48e6-a15c-96693d2fbb14 Aug 29 01:10:45 devstack sudo[87941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:10:46 devstack sudo[87941]: pam_unix(sudo:session): session closed for user root Aug 29 01:10:46 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-9cdce280-3156-4e5b-903d-9cf9e17df0ea tempest-GroupSnapshotsTest-379341379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ad333ea0-4316-48e6-a15c-96693d2fbb14" returned: 0 in 0.399s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:10:46 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-9cdce280-3156-4e5b-903d-9cf9e17df0ea tempest-GroupSnapshotsTest-379341379 None] <== create_volume: return (1034ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:10:46 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-9cdce280-3156-4e5b-903d-9cf9e17df0ea tempest-GroupSnapshotsTest-379341379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.038s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:10:46 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-9cdce280-3156-4e5b-903d-9cf9e17df0ea tempest-GroupSnapshotsTest-379341379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89a28105-7b7e-44a9-b17a-e2bdc9a0daf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad333ea0-4316-48e6-a15c-96693d2fbb14', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:10:46 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-9cdce280-3156-4e5b-903d-9cf9e17df0ea tempest-GroupSnapshotsTest-379341379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4e01838-4b4d-4191-a8e5-1c29e890dac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:10:46 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-9cdce280-3156-4e5b-903d-9cf9e17df0ea tempest-GroupSnapshotsTest-379341379 None] Volume volume-ad333ea0-4316-48e6-a15c-96693d2fbb14 (ad333ea0-4316-48e6-a15c-96693d2fbb14): created successfully Aug 29 01:10:46 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-9cdce280-3156-4e5b-903d-9cf9e17df0ea tempest-GroupSnapshotsTest-379341379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4e01838-4b4d-4191-a8e5-1c29e890dac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:10:46 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-9cdce280-3156-4e5b-903d-9cf9e17df0ea tempest-GroupSnapshotsTest-379341379 None] Flow 'volume_create_manager' (c671b4e1-983e-472c-9407-899321c90a70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:10:46 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-9cdce280-3156-4e5b-903d-9cf9e17df0ea tempest-GroupSnapshotsTest-379341379 None] Created volume successfully. Aug 29 01:10:48 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-a756d029-ac4d-4c61-8ea1-9c4ca7bb0ff7 tempest-GroupSnapshotsTest-379341379 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:10:48 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-a756d029-ac4d-4c61-8ea1-9c4ca7bb0ff7 tempest-GroupSnapshotsTest-379341379 None] Flow 'volume_create_manager' (18ea8347-27ec-466a-9c63-0b16a8ed9b16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:10:48 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-a756d029-ac4d-4c61-8ea1-9c4ca7bb0ff7 tempest-GroupSnapshotsTest-379341379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df45199d-ad46-4586-8eb9-60cadec28485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:10:48 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-a756d029-ac4d-4c61-8ea1-9c4ca7bb0ff7 tempest-GroupSnapshotsTest-379341379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df45199d-ad46-4586-8eb9-60cadec28485) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:10:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-216895237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=31c9f2dc-f976-40bc-999c-605a65dc655f,host='devstack@QuobyteHD#QuobyteHD',id=57e55edd-1b12-4476-849f-ae80a77c3aca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50787aacf8064212b410d4f97d55d629',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:10:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:10:48Z,use_quota=True,user_id='2c6852d5bcec4367a445767ca79915fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1426382f-16e3-4b2a-890b-81a03b8ac619),volume_type_id=1426382f-16e3-4b2a-890b-81a03b8ac619)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:10:48 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-a756d029-ac4d-4c61-8ea1-9c4ca7bb0ff7 tempest-GroupSnapshotsTest-379341379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (431411fe-8d96-4a05-827b-9cb12c857f1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:10:48 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-a756d029-ac4d-4c61-8ea1-9c4ca7bb0ff7 tempest-GroupSnapshotsTest-379341379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (431411fe-8d96-4a05-827b-9cb12c857f1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:10:48 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-a756d029-ac4d-4c61-8ea1-9c4ca7bb0ff7 tempest-GroupSnapshotsTest-379341379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3459423e-ed36-4700-b07d-88af624ab655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:10:48 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-a756d029-ac4d-4c61-8ea1-9c4ca7bb0ff7 tempest-GroupSnapshotsTest-379341379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3459423e-ed36-4700-b07d-88af624ab655) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57e55edd-1b12-4476-849f-ae80a77c3aca', 'volume_name': 'volume-57e55edd-1b12-4476-849f-ae80a77c3aca', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:10:48 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-a756d029-ac4d-4c61-8ea1-9c4ca7bb0ff7 tempest-GroupSnapshotsTest-379341379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8cb6885-1c12-4316-8086-0b4afd5fa576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:10:48 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-a756d029-ac4d-4c61-8ea1-9c4ca7bb0ff7 tempest-GroupSnapshotsTest-379341379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8cb6885-1c12-4316-8086-0b4afd5fa576) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:10:48 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-a756d029-ac4d-4c61-8ea1-9c4ca7bb0ff7 tempest-GroupSnapshotsTest-379341379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6845168-8a01-4934-b66f-9d75ec1786c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:10:48 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-a756d029-ac4d-4c61-8ea1-9c4ca7bb0ff7 tempest-GroupSnapshotsTest-379341379 None] Volume 57e55edd-1b12-4476-849f-ae80a77c3aca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57e55edd-1b12-4476-849f-ae80a77c3aca', 'volume_size': 1} Aug 29 01:10:48 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-a756d029-ac4d-4c61-8ea1-9c4ca7bb0ff7 tempest-GroupSnapshotsTest-379341379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:10:48 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-a756d029-ac4d-4c61-8ea1-9c4ca7bb0ff7 tempest-GroupSnapshotsTest-379341379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:10:48 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-a756d029-ac4d-4c61-8ea1-9c4ca7bb0ff7 tempest-GroupSnapshotsTest-379341379 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=31c9f2dc-f976-40bc-999c-605a65dc655f,created_at=2026-08-28T23:10:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-216895237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=31c9f2dc-f976-40bc-999c-605a65dc655f,host='devstack@QuobyteHD#QuobyteHD',id=57e55edd-1b12-4476-849f-ae80a77c3aca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50787aacf8064212b410d4f97d55d629',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:10:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:10:48Z,use_quota=True,user_id='2c6852d5bcec4367a445767ca79915fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1426382f-16e3-4b2a-890b-81a03b8ac619),volume_type_id=1426382f-16e3-4b2a-890b-81a03b8ac619)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:10:48 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-a756d029-ac4d-4c61-8ea1-9c4ca7bb0ff7 tempest-GroupSnapshotsTest-379341379 None] Creating volume 57e55edd-1b12-4476-849f-ae80a77c3aca {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:10:48 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-a756d029-ac4d-4c61-8ea1-9c4ca7bb0ff7 tempest-GroupSnapshotsTest-379341379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:10:48 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-a756d029-ac4d-4c61-8ea1-9c4ca7bb0ff7 tempest-GroupSnapshotsTest-379341379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:10:48 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-a756d029-ac4d-4c61-8ea1-9c4ca7bb0ff7 tempest-GroupSnapshotsTest-379341379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:10:48 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-a756d029-ac4d-4c61-8ea1-9c4ca7bb0ff7 tempest-GroupSnapshotsTest-379341379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:10:48 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-a756d029-ac4d-4c61-8ea1-9c4ca7bb0ff7 tempest-GroupSnapshotsTest-379341379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:10:48 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-a756d029-ac4d-4c61-8ea1-9c4ca7bb0ff7 tempest-GroupSnapshotsTest-379341379 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:10:48 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-a756d029-ac4d-4c61-8ea1-9c4ca7bb0ff7 tempest-GroupSnapshotsTest-379341379 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:10:48 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-a756d029-ac4d-4c61-8ea1-9c4ca7bb0ff7 tempest-GroupSnapshotsTest-379341379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-57e55edd-1b12-4476-849f-ae80a77c3aca 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:10:48 devstack sudo[87945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-57e55edd-1b12-4476-849f-ae80a77c3aca 1073741824 Aug 29 01:10:48 devstack sudo[87945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:10:48 devstack sudo[87945]: pam_unix(sudo:session): session closed for user root Aug 29 01:10:48 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-a756d029-ac4d-4c61-8ea1-9c4ca7bb0ff7 tempest-GroupSnapshotsTest-379341379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-57e55edd-1b12-4476-849f-ae80a77c3aca 1073741824" returned: 0 in 0.660s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:10:48 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-a756d029-ac4d-4c61-8ea1-9c4ca7bb0ff7 tempest-GroupSnapshotsTest-379341379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-57e55edd-1b12-4476-849f-ae80a77c3aca {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:10:48 devstack sudo[87951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-57e55edd-1b12-4476-849f-ae80a77c3aca Aug 29 01:10:48 devstack sudo[87951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:10:49 devstack sudo[87951]: pam_unix(sudo:session): session closed for user root Aug 29 01:10:49 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-a756d029-ac4d-4c61-8ea1-9c4ca7bb0ff7 tempest-GroupSnapshotsTest-379341379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-57e55edd-1b12-4476-849f-ae80a77c3aca" returned: 0 in 0.270s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:10:49 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-a756d029-ac4d-4c61-8ea1-9c4ca7bb0ff7 tempest-GroupSnapshotsTest-379341379 None] <== create_volume: return (987ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:10:49 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-a756d029-ac4d-4c61-8ea1-9c4ca7bb0ff7 tempest-GroupSnapshotsTest-379341379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.989s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:10:49 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-a756d029-ac4d-4c61-8ea1-9c4ca7bb0ff7 tempest-GroupSnapshotsTest-379341379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6845168-8a01-4934-b66f-9d75ec1786c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57e55edd-1b12-4476-849f-ae80a77c3aca', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:10:49 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-a756d029-ac4d-4c61-8ea1-9c4ca7bb0ff7 tempest-GroupSnapshotsTest-379341379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a37cfc9f-e9bf-4566-8bfd-e99f8ec44e1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:10:49 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-a756d029-ac4d-4c61-8ea1-9c4ca7bb0ff7 tempest-GroupSnapshotsTest-379341379 None] Volume volume-57e55edd-1b12-4476-849f-ae80a77c3aca (57e55edd-1b12-4476-849f-ae80a77c3aca): created successfully Aug 29 01:10:49 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-a756d029-ac4d-4c61-8ea1-9c4ca7bb0ff7 tempest-GroupSnapshotsTest-379341379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a37cfc9f-e9bf-4566-8bfd-e99f8ec44e1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:10:49 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-a756d029-ac4d-4c61-8ea1-9c4ca7bb0ff7 tempest-GroupSnapshotsTest-379341379 None] Flow 'volume_create_manager' (18ea8347-27ec-466a-9c63-0b16a8ed9b16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:10:49 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-a756d029-ac4d-4c61-8ea1-9c4ca7bb0ff7 tempest-GroupSnapshotsTest-379341379 None] Created volume successfully. Aug 29 01:10:50 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-75ea78d4-c261-423d-a858-03a17a5ba4df tempest-GroupSnapshotsTest-379341379 None] Update group completed successfully. Aug 29 01:10:51 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-61d2cee9-08b8-4a6c-bdf2-4f86d0f2bf9a tempest-GroupSnapshotsTest-379341379 None] Update group completed successfully. Aug 29 01:10:53 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-13d5c68e-4e32-4039-af1a-09d78334a2b3 tempest-GroupSnapshotsTest-379341379 None] Update group completed successfully. Aug 29 01:10:54 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-cf079a23-0581-4a12-8aa6-df8d7d39db83 tempest-GroupSnapshotsTest-379341379 None] Update group completed successfully. Aug 29 01:10:54 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e2dcb78-89ac-4594-bd05-eedae475ccd2 tempest-TaggedAttachmentsTest-47599495 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:10:54 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-4e2dcb78-89ac-4594-bd05-eedae475ccd2 tempest-TaggedAttachmentsTest-47599495 None] Flow 'volume_create_manager' (43d7cb37-39b6-449d-afd4-80501601523f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:10:54 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-4e2dcb78-89ac-4594-bd05-eedae475ccd2 tempest-TaggedAttachmentsTest-47599495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4f01b66-8436-454d-9b3c-c67f16fbde85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:10:54 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-4e2dcb78-89ac-4594-bd05-eedae475ccd2 tempest-TaggedAttachmentsTest-47599495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4f01b66-8436-454d-9b3c-c67f16fbde85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:10:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-2070508003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49e5c531-4af8-4f61-8da2-80ee290c5445,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6adf4e4c1d814f76b34e38a017b4fc20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:10:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:10:55Z,use_quota=True,user_id='8bb20931204a4dd6a58eb323c75cb04e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:10:54 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-4e2dcb78-89ac-4594-bd05-eedae475ccd2 tempest-TaggedAttachmentsTest-47599495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a07c0a48-3faa-4cc0-a637-cad02790d46f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:10:54 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-4e2dcb78-89ac-4594-bd05-eedae475ccd2 tempest-TaggedAttachmentsTest-47599495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a07c0a48-3faa-4cc0-a637-cad02790d46f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:10:54 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-4e2dcb78-89ac-4594-bd05-eedae475ccd2 tempest-TaggedAttachmentsTest-47599495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8270fc6-bc5b-4fe6-a55f-994802795b34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:10:54 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-4e2dcb78-89ac-4594-bd05-eedae475ccd2 tempest-TaggedAttachmentsTest-47599495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8270fc6-bc5b-4fe6-a55f-994802795b34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49e5c531-4af8-4f61-8da2-80ee290c5445', 'volume_name': 'volume-49e5c531-4af8-4f61-8da2-80ee290c5445', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:10:54 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-4e2dcb78-89ac-4594-bd05-eedae475ccd2 tempest-TaggedAttachmentsTest-47599495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ef86211-c642-43ab-b3ee-e1b25b7fa620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:10:54 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-4e2dcb78-89ac-4594-bd05-eedae475ccd2 tempest-TaggedAttachmentsTest-47599495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ef86211-c642-43ab-b3ee-e1b25b7fa620) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:10:54 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-4e2dcb78-89ac-4594-bd05-eedae475ccd2 tempest-TaggedAttachmentsTest-47599495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (108d6993-ce77-4e3e-bf16-52b9374f5246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:10:54 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-4e2dcb78-89ac-4594-bd05-eedae475ccd2 tempest-TaggedAttachmentsTest-47599495 None] Volume 49e5c531-4af8-4f61-8da2-80ee290c5445: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49e5c531-4af8-4f61-8da2-80ee290c5445', 'volume_size': 1} Aug 29 01:10:54 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-4e2dcb78-89ac-4594-bd05-eedae475ccd2 tempest-TaggedAttachmentsTest-47599495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:10:54 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-4e2dcb78-89ac-4594-bd05-eedae475ccd2 tempest-TaggedAttachmentsTest-47599495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:10:54 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-4e2dcb78-89ac-4594-bd05-eedae475ccd2 tempest-TaggedAttachmentsTest-47599495 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:10:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-2070508003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49e5c531-4af8-4f61-8da2-80ee290c5445,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6adf4e4c1d814f76b34e38a017b4fc20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:10:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:10:55Z,use_quota=True,user_id='8bb20931204a4dd6a58eb323c75cb04e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:10:54 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-4e2dcb78-89ac-4594-bd05-eedae475ccd2 tempest-TaggedAttachmentsTest-47599495 None] Creating volume 49e5c531-4af8-4f61-8da2-80ee290c5445 {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:10:54 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-4e2dcb78-89ac-4594-bd05-eedae475ccd2 tempest-TaggedAttachmentsTest-47599495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:10:54 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-4e2dcb78-89ac-4594-bd05-eedae475ccd2 tempest-TaggedAttachmentsTest-47599495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:10:54 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-4e2dcb78-89ac-4594-bd05-eedae475ccd2 tempest-TaggedAttachmentsTest-47599495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:10:54 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-4e2dcb78-89ac-4594-bd05-eedae475ccd2 tempest-TaggedAttachmentsTest-47599495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:10:54 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-4e2dcb78-89ac-4594-bd05-eedae475ccd2 tempest-TaggedAttachmentsTest-47599495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:10:54 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-4e2dcb78-89ac-4594-bd05-eedae475ccd2 tempest-TaggedAttachmentsTest-47599495 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:10:54 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-4e2dcb78-89ac-4594-bd05-eedae475ccd2 tempest-TaggedAttachmentsTest-47599495 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:10:54 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-4e2dcb78-89ac-4594-bd05-eedae475ccd2 tempest-TaggedAttachmentsTest-47599495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-49e5c531-4af8-4f61-8da2-80ee290c5445 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:10:54 devstack sudo[88003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-49e5c531-4af8-4f61-8da2-80ee290c5445 1073741824 Aug 29 01:10:54 devstack sudo[88003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:10:55 devstack sudo[88003]: pam_unix(sudo:session): session closed for user root Aug 29 01:10:55 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-4e2dcb78-89ac-4594-bd05-eedae475ccd2 tempest-TaggedAttachmentsTest-47599495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-49e5c531-4af8-4f61-8da2-80ee290c5445 1073741824" returned: 0 in 0.792s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:10:55 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-4e2dcb78-89ac-4594-bd05-eedae475ccd2 tempest-TaggedAttachmentsTest-47599495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-49e5c531-4af8-4f61-8da2-80ee290c5445 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:10:55 devstack sudo[88028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-49e5c531-4af8-4f61-8da2-80ee290c5445 Aug 29 01:10:55 devstack sudo[88028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:10:56 devstack sudo[88028]: pam_unix(sudo:session): session closed for user root Aug 29 01:10:56 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-4e2dcb78-89ac-4594-bd05-eedae475ccd2 tempest-TaggedAttachmentsTest-47599495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-49e5c531-4af8-4f61-8da2-80ee290c5445" returned: 0 in 0.494s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:10:56 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-4e2dcb78-89ac-4594-bd05-eedae475ccd2 tempest-TaggedAttachmentsTest-47599495 None] <== create_volume: return (1377ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:10:56 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-4e2dcb78-89ac-4594-bd05-eedae475ccd2 tempest-TaggedAttachmentsTest-47599495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.396s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:10:56 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-4e2dcb78-89ac-4594-bd05-eedae475ccd2 tempest-TaggedAttachmentsTest-47599495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (108d6993-ce77-4e3e-bf16-52b9374f5246) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49e5c531-4af8-4f61-8da2-80ee290c5445', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:10:56 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-4e2dcb78-89ac-4594-bd05-eedae475ccd2 tempest-TaggedAttachmentsTest-47599495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0391a721-2362-490c-ae08-8685940f51ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:10:56 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-4e2dcb78-89ac-4594-bd05-eedae475ccd2 tempest-TaggedAttachmentsTest-47599495 None] Volume volume-49e5c531-4af8-4f61-8da2-80ee290c5445 (49e5c531-4af8-4f61-8da2-80ee290c5445): created successfully Aug 29 01:10:56 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-4e2dcb78-89ac-4594-bd05-eedae475ccd2 tempest-TaggedAttachmentsTest-47599495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0391a721-2362-490c-ae08-8685940f51ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:10:56 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-4e2dcb78-89ac-4594-bd05-eedae475ccd2 tempest-TaggedAttachmentsTest-47599495 None] Flow 'volume_create_manager' (43d7cb37-39b6-449d-afd4-80501601523f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:10:56 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-4e2dcb78-89ac-4594-bd05-eedae475ccd2 tempest-TaggedAttachmentsTest-47599495 None] Created volume successfully. Aug 29 01:10:56 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-d157d51a-c244-4e3e-a7ce-168fc71c6646 tempest-GroupSnapshotsTest-379341379 None] GroupSnapshot 25702d5f-b652-4977-b023-cc8c4876b2f6: creating. Aug 29 01:10:56 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-d157d51a-c244-4e3e-a7ce-168fc71c6646 tempest-GroupSnapshotsTest-379341379 None] Group snapshot 25702d5f-b652-4977-b023-cc8c4876b2f6: creating. {{(pid=86111) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Aug 29 01:10:56 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-d157d51a-c244-4e3e-a7ce-168fc71c6646 tempest-GroupSnapshotsTest-379341379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:10:56 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-d157d51a-c244-4e3e-a7ce-168fc71c6646 tempest-GroupSnapshotsTest-379341379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:10:56 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-d157d51a-c244-4e3e-a7ce-168fc71c6646 tempest-GroupSnapshotsTest-379341379 None] Creating offline snapshot a19d9d2a-4017-40ee-9973-d555b870689d of volume ad333ea0-4316-48e6-a15c-96693d2fbb14 {{(pid=86111) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 29 01:10:56 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[421c8296-b5e2-4f69-82ed-68968402f7d3]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:10:56 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d157d51a-c244-4e3e-a7ce-168fc71c6646 tempest-GroupSnapshotsTest-379341379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ad333ea0-4316-48e6-a15c-96693d2fbb14 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:10:56 devstack sudo[88035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ad333ea0-4316-48e6-a15c-96693d2fbb14 Aug 29 01:10:56 devstack sudo[88035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:10:57 devstack sudo[88035]: pam_unix(sudo:session): session closed for user root Aug 29 01:10:57 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d157d51a-c244-4e3e-a7ce-168fc71c6646 tempest-GroupSnapshotsTest-379341379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ad333ea0-4316-48e6-a15c-96693d2fbb14" returned: 0 in 0.687s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:10:57 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d157d51a-c244-4e3e-a7ce-168fc71c6646 tempest-GroupSnapshotsTest-379341379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ad333ea0-4316-48e6-a15c-96693d2fbb14,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ad333ea0-4316-48e6-a15c-96693d2fbb14.a19d9d2a-4017-40ee-9973-d555b870689d 1G {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:10:57 devstack sudo[88045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ad333ea0-4316-48e6-a15c-96693d2fbb14,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ad333ea0-4316-48e6-a15c-96693d2fbb14.a19d9d2a-4017-40ee-9973-d555b870689d 1G Aug 29 01:10:57 devstack sudo[88045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:10:58 devstack sudo[88045]: pam_unix(sudo:session): session closed for user root Aug 29 01:10:58 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d157d51a-c244-4e3e-a7ce-168fc71c6646 tempest-GroupSnapshotsTest-379341379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ad333ea0-4316-48e6-a15c-96693d2fbb14,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ad333ea0-4316-48e6-a15c-96693d2fbb14.a19d9d2a-4017-40ee-9973-d555b870689d 1G" returned: 0 in 1.090s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:10:58 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d157d51a-c244-4e3e-a7ce-168fc71c6646 tempest-GroupSnapshotsTest-379341379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad333ea0-4316-48e6-a15c-96693d2fbb14 -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ad333ea0-4316-48e6-a15c-96693d2fbb14.a19d9d2a-4017-40ee-9973-d555b870689d {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:10:58 devstack sudo[88056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad333ea0-4316-48e6-a15c-96693d2fbb14 -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ad333ea0-4316-48e6-a15c-96693d2fbb14.a19d9d2a-4017-40ee-9973-d555b870689d Aug 29 01:10:58 devstack sudo[88056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:10:58 devstack sudo[88056]: pam_unix(sudo:session): session closed for user root Aug 29 01:10:58 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d157d51a-c244-4e3e-a7ce-168fc71c6646 tempest-GroupSnapshotsTest-379341379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad333ea0-4316-48e6-a15c-96693d2fbb14 -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ad333ea0-4316-48e6-a15c-96693d2fbb14.a19d9d2a-4017-40ee-9973-d555b870689d" returned: 0 in 0.523s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:10:58 devstack cinder-volume[86111]: WARNING cinder.volume.drivers.remotefs [None req-d157d51a-c244-4e3e-a7ce-168fc71c6646 tempest-GroupSnapshotsTest-379341379 None] /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ad333ea0-4316-48e6-a15c-96693d2fbb14.a19d9d2a-4017-40ee-9973-d555b870689d is being set with open permissions: ugo+rw: NotImplementedError Aug 29 01:10:58 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d157d51a-c244-4e3e-a7ce-168fc71c6646 tempest-GroupSnapshotsTest-379341379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ad333ea0-4316-48e6-a15c-96693d2fbb14.a19d9d2a-4017-40ee-9973-d555b870689d {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:10:58 devstack sudo[88062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ad333ea0-4316-48e6-a15c-96693d2fbb14.a19d9d2a-4017-40ee-9973-d555b870689d Aug 29 01:10:58 devstack sudo[88062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:10:59 devstack sudo[88062]: pam_unix(sudo:session): session closed for user root Aug 29 01:10:59 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d157d51a-c244-4e3e-a7ce-168fc71c6646 tempest-GroupSnapshotsTest-379341379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ad333ea0-4316-48e6-a15c-96693d2fbb14.a19d9d2a-4017-40ee-9973-d555b870689d" returned: 0 in 0.451s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:10:59 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d157d51a-c244-4e3e-a7ce-168fc71c6646 tempest-GroupSnapshotsTest-379341379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ad333ea0-4316-48e6-a15c-96693d2fbb14.info {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:10:59 devstack sudo[88067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ad333ea0-4316-48e6-a15c-96693d2fbb14.info Aug 29 01:10:59 devstack sudo[88067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:10:59 devstack sudo[88067]: pam_unix(sudo:session): session closed for user root Aug 29 01:10:59 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d157d51a-c244-4e3e-a7ce-168fc71c6646 tempest-GroupSnapshotsTest-379341379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ad333ea0-4316-48e6-a15c-96693d2fbb14.info" returned: 0 in 0.481s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:10:59 devstack cinder-volume[86111]: WARNING cinder.volume.drivers.remotefs [None req-d157d51a-c244-4e3e-a7ce-168fc71c6646 tempest-GroupSnapshotsTest-379341379 None] /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ad333ea0-4316-48e6-a15c-96693d2fbb14.info is being set with open permissions: ugo+rw: NotImplementedError Aug 29 01:10:59 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d157d51a-c244-4e3e-a7ce-168fc71c6646 tempest-GroupSnapshotsTest-379341379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ad333ea0-4316-48e6-a15c-96693d2fbb14.info {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:10:59 devstack sudo[88081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ad333ea0-4316-48e6-a15c-96693d2fbb14.info Aug 29 01:10:59 devstack sudo[88081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:11:00 devstack sudo[88081]: pam_unix(sudo:session): session closed for user root Aug 29 01:11:00 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d157d51a-c244-4e3e-a7ce-168fc71c6646 tempest-GroupSnapshotsTest-379341379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ad333ea0-4316-48e6-a15c-96693d2fbb14.info" returned: 0 in 0.390s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:11:00 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-d157d51a-c244-4e3e-a7ce-168fc71c6646 tempest-GroupSnapshotsTest-379341379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.790s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:11:00 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-d157d51a-c244-4e3e-a7ce-168fc71c6646 tempest-GroupSnapshotsTest-379341379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:11:00 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-d157d51a-c244-4e3e-a7ce-168fc71c6646 tempest-GroupSnapshotsTest-379341379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:11:00 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-d157d51a-c244-4e3e-a7ce-168fc71c6646 tempest-GroupSnapshotsTest-379341379 None] Creating offline snapshot d09f2ac8-b23a-4bf7-9300-6eefc6da5088 of volume 57e55edd-1b12-4476-849f-ae80a77c3aca {{(pid=86111) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 29 01:11:00 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[39390bf2-07df-48d0-84e2-d7ac4d596b05]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:11:00 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d157d51a-c244-4e3e-a7ce-168fc71c6646 tempest-GroupSnapshotsTest-379341379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-57e55edd-1b12-4476-849f-ae80a77c3aca {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:11:00 devstack sudo[88091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-57e55edd-1b12-4476-849f-ae80a77c3aca Aug 29 01:11:00 devstack sudo[88091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:11:00 devstack sudo[88091]: pam_unix(sudo:session): session closed for user root Aug 29 01:11:00 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d157d51a-c244-4e3e-a7ce-168fc71c6646 tempest-GroupSnapshotsTest-379341379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-57e55edd-1b12-4476-849f-ae80a77c3aca" returned: 0 in 0.614s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:11:00 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d157d51a-c244-4e3e-a7ce-168fc71c6646 tempest-GroupSnapshotsTest-379341379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-57e55edd-1b12-4476-849f-ae80a77c3aca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-57e55edd-1b12-4476-849f-ae80a77c3aca.d09f2ac8-b23a-4bf7-9300-6eefc6da5088 1G {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:11:00 devstack sudo[88098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-57e55edd-1b12-4476-849f-ae80a77c3aca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-57e55edd-1b12-4476-849f-ae80a77c3aca.d09f2ac8-b23a-4bf7-9300-6eefc6da5088 1G Aug 29 01:11:00 devstack sudo[88098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:11:01 devstack sudo[88098]: pam_unix(sudo:session): session closed for user root Aug 29 01:11:01 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d157d51a-c244-4e3e-a7ce-168fc71c6646 tempest-GroupSnapshotsTest-379341379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-57e55edd-1b12-4476-849f-ae80a77c3aca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-57e55edd-1b12-4476-849f-ae80a77c3aca.d09f2ac8-b23a-4bf7-9300-6eefc6da5088 1G" returned: 0 in 0.906s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:11:01 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d157d51a-c244-4e3e-a7ce-168fc71c6646 tempest-GroupSnapshotsTest-379341379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57e55edd-1b12-4476-849f-ae80a77c3aca -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-57e55edd-1b12-4476-849f-ae80a77c3aca.d09f2ac8-b23a-4bf7-9300-6eefc6da5088 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:11:01 devstack sudo[88107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57e55edd-1b12-4476-849f-ae80a77c3aca -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-57e55edd-1b12-4476-849f-ae80a77c3aca.d09f2ac8-b23a-4bf7-9300-6eefc6da5088 Aug 29 01:11:01 devstack sudo[88107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:11:02 devstack sudo[88107]: pam_unix(sudo:session): session closed for user root Aug 29 01:11:02 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d157d51a-c244-4e3e-a7ce-168fc71c6646 tempest-GroupSnapshotsTest-379341379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57e55edd-1b12-4476-849f-ae80a77c3aca -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-57e55edd-1b12-4476-849f-ae80a77c3aca.d09f2ac8-b23a-4bf7-9300-6eefc6da5088" returned: 0 in 0.690s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:11:02 devstack cinder-volume[86111]: WARNING cinder.volume.drivers.remotefs [None req-d157d51a-c244-4e3e-a7ce-168fc71c6646 tempest-GroupSnapshotsTest-379341379 None] /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-57e55edd-1b12-4476-849f-ae80a77c3aca.d09f2ac8-b23a-4bf7-9300-6eefc6da5088 is being set with open permissions: ugo+rw: NotImplementedError Aug 29 01:11:02 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d157d51a-c244-4e3e-a7ce-168fc71c6646 tempest-GroupSnapshotsTest-379341379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-57e55edd-1b12-4476-849f-ae80a77c3aca.d09f2ac8-b23a-4bf7-9300-6eefc6da5088 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:11:02 devstack sudo[88114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-57e55edd-1b12-4476-849f-ae80a77c3aca.d09f2ac8-b23a-4bf7-9300-6eefc6da5088 Aug 29 01:11:02 devstack sudo[88114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:11:02 devstack sudo[88114]: pam_unix(sudo:session): session closed for user root Aug 29 01:11:02 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d157d51a-c244-4e3e-a7ce-168fc71c6646 tempest-GroupSnapshotsTest-379341379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-57e55edd-1b12-4476-849f-ae80a77c3aca.d09f2ac8-b23a-4bf7-9300-6eefc6da5088" returned: 0 in 0.452s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:11:03 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d157d51a-c244-4e3e-a7ce-168fc71c6646 tempest-GroupSnapshotsTest-379341379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-57e55edd-1b12-4476-849f-ae80a77c3aca.info {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:11:03 devstack sudo[88121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-57e55edd-1b12-4476-849f-ae80a77c3aca.info Aug 29 01:11:03 devstack sudo[88121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:11:03 devstack sudo[88121]: pam_unix(sudo:session): session closed for user root Aug 29 01:11:03 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d157d51a-c244-4e3e-a7ce-168fc71c6646 tempest-GroupSnapshotsTest-379341379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-57e55edd-1b12-4476-849f-ae80a77c3aca.info" returned: 0 in 0.481s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:11:03 devstack cinder-volume[86111]: WARNING cinder.volume.drivers.remotefs [None req-d157d51a-c244-4e3e-a7ce-168fc71c6646 tempest-GroupSnapshotsTest-379341379 None] /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-57e55edd-1b12-4476-849f-ae80a77c3aca.info is being set with open permissions: ugo+rw: NotImplementedError Aug 29 01:11:03 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d157d51a-c244-4e3e-a7ce-168fc71c6646 tempest-GroupSnapshotsTest-379341379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-57e55edd-1b12-4476-849f-ae80a77c3aca.info {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:11:03 devstack sudo[88124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-57e55edd-1b12-4476-849f-ae80a77c3aca.info Aug 29 01:11:03 devstack sudo[88124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:11:04 devstack sudo[88124]: pam_unix(sudo:session): session closed for user root Aug 29 01:11:04 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d157d51a-c244-4e3e-a7ce-168fc71c6646 tempest-GroupSnapshotsTest-379341379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-57e55edd-1b12-4476-849f-ae80a77c3aca.info" returned: 0 in 0.529s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:11:04 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-d157d51a-c244-4e3e-a7ce-168fc71c6646 tempest-GroupSnapshotsTest-379341379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.879s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:11:04 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-d157d51a-c244-4e3e-a7ce-168fc71c6646 tempest-GroupSnapshotsTest-379341379 None] group_snapshot 25702d5f-b652-4977-b023-cc8c4876b2f6: created successfully Aug 29 01:11:05 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-fde01a54-8829-4438-9584-e8c2071ceed4 tempest-GroupSnapshotsTest-379341379 None] group_snapshot 25702d5f-b652-4977-b023-cc8c4876b2f6: deleting Aug 29 01:11:05 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-fde01a54-8829-4438-9584-e8c2071ceed4 tempest-GroupSnapshotsTest-379341379 None] group_snapshot 25702d5f-b652-4977-b023-cc8c4876b2f6: deleting {{(pid=86111) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Aug 29 01:11:05 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-fde01a54-8829-4438-9584-e8c2071ceed4 tempest-GroupSnapshotsTest-379341379 None] Acquiring lock "cinder-quobyte-ad333ea0-4316-48e6-a15c-96693d2fbb14" by "delete_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:11:05 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-fde01a54-8829-4438-9584-e8c2071ceed4 tempest-GroupSnapshotsTest-379341379 None] Lock "cinder-quobyte-ad333ea0-4316-48e6-a15c-96693d2fbb14" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:11:05 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-fde01a54-8829-4438-9584-e8c2071ceed4 tempest-GroupSnapshotsTest-379341379 None] Acquiring lock "cinder-quobyte-a19d9d2a-4017-40ee-9973-d555b870689d" by "_delete_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:11:05 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-fde01a54-8829-4438-9584-e8c2071ceed4 tempest-GroupSnapshotsTest-379341379 None] Lock "cinder-quobyte-a19d9d2a-4017-40ee-9973-d555b870689d" acquired by "_delete_snapshot" :: waited 0.063s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:11:05 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-fde01a54-8829-4438-9584-e8c2071ceed4 tempest-GroupSnapshotsTest-379341379 None] Deleting offline snapshot a19d9d2a-4017-40ee-9973-d555b870689d of volume ad333ea0-4316-48e6-a15c-96693d2fbb14 {{(pid=86111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 29 01:11:05 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-fde01a54-8829-4438-9584-e8c2071ceed4 tempest-GroupSnapshotsTest-379341379 None] snapshot_file for this snap is: volume-ad333ea0-4316-48e6-a15c-96693d2fbb14.a19d9d2a-4017-40ee-9973-d555b870689d {{(pid=86111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 29 01:11:05 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[93dc2dda-e062-44c6-9c95-1b5c0caca9b2]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:11:05 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-fde01a54-8829-4438-9584-e8c2071ceed4 tempest-GroupSnapshotsTest-379341379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ad333ea0-4316-48e6-a15c-96693d2fbb14.a19d9d2a-4017-40ee-9973-d555b870689d {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:11:06 devstack sudo[88149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ad333ea0-4316-48e6-a15c-96693d2fbb14.a19d9d2a-4017-40ee-9973-d555b870689d Aug 29 01:11:06 devstack sudo[88149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:11:06 devstack sudo[88149]: pam_unix(sudo:session): session closed for user root Aug 29 01:11:06 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-fde01a54-8829-4438-9584-e8c2071ceed4 tempest-GroupSnapshotsTest-379341379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ad333ea0-4316-48e6-a15c-96693d2fbb14.a19d9d2a-4017-40ee-9973-d555b870689d" returned: 0 in 1.189s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:11:06 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-fde01a54-8829-4438-9584-e8c2071ceed4 tempest-GroupSnapshotsTest-379341379 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ad333ea0-4316-48e6-a15c-96693d2fbb14(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 29 01:11:07 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[657adc94-f61c-4a92-82f1-1ad17cc1c95c]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:11:07 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-fde01a54-8829-4438-9584-e8c2071ceed4 tempest-GroupSnapshotsTest-379341379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ad333ea0-4316-48e6-a15c-96693d2fbb14 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:11:07 devstack sudo[88214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ad333ea0-4316-48e6-a15c-96693d2fbb14 Aug 29 01:11:07 devstack sudo[88214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:11:07 devstack sudo[88214]: pam_unix(sudo:session): session closed for user root Aug 29 01:11:07 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-fde01a54-8829-4438-9584-e8c2071ceed4 tempest-GroupSnapshotsTest-379341379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ad333ea0-4316-48e6-a15c-96693d2fbb14" returned: 0 in 0.958s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:11:07 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-fde01a54-8829-4438-9584-e8c2071ceed4 tempest-GroupSnapshotsTest-379341379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ad333ea0-4316-48e6-a15c-96693d2fbb14.a19d9d2a-4017-40ee-9973-d555b870689d {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:11:08 devstack sudo[88238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ad333ea0-4316-48e6-a15c-96693d2fbb14.a19d9d2a-4017-40ee-9973-d555b870689d Aug 29 01:11:08 devstack sudo[88238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:11:08 devstack sudo[88238]: pam_unix(sudo:session): session closed for user root Aug 29 01:11:08 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-fde01a54-8829-4438-9584-e8c2071ceed4 tempest-GroupSnapshotsTest-379341379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ad333ea0-4316-48e6-a15c-96693d2fbb14.a19d9d2a-4017-40ee-9973-d555b870689d" returned: 0 in 0.997s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:11:08 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-fde01a54-8829-4438-9584-e8c2071ceed4 tempest-GroupSnapshotsTest-379341379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ad333ea0-4316-48e6-a15c-96693d2fbb14.a19d9d2a-4017-40ee-9973-d555b870689d {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:11:09 devstack sudo[88250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ad333ea0-4316-48e6-a15c-96693d2fbb14.a19d9d2a-4017-40ee-9973-d555b870689d Aug 29 01:11:09 devstack sudo[88250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:11:09 devstack sudo[88250]: pam_unix(sudo:session): session closed for user root Aug 29 01:11:09 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-fde01a54-8829-4438-9584-e8c2071ceed4 tempest-GroupSnapshotsTest-379341379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ad333ea0-4316-48e6-a15c-96693d2fbb14.a19d9d2a-4017-40ee-9973-d555b870689d" returned: 0 in 0.569s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:11:09 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-fde01a54-8829-4438-9584-e8c2071ceed4 tempest-GroupSnapshotsTest-379341379 None] Lock "cinder-quobyte-a19d9d2a-4017-40ee-9973-d555b870689d" released by "_delete_snapshot" :: held 4.034s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:11:09 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-fde01a54-8829-4438-9584-e8c2071ceed4 tempest-GroupSnapshotsTest-379341379 None] Lock "cinder-quobyte-ad333ea0-4316-48e6-a15c-96693d2fbb14" released by "delete_snapshot" :: held 4.119s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:11:09 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-fde01a54-8829-4438-9584-e8c2071ceed4 tempest-GroupSnapshotsTest-379341379 None] Acquiring lock "cinder-quobyte-57e55edd-1b12-4476-849f-ae80a77c3aca" by "delete_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:11:09 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-fde01a54-8829-4438-9584-e8c2071ceed4 tempest-GroupSnapshotsTest-379341379 None] Lock "cinder-quobyte-57e55edd-1b12-4476-849f-ae80a77c3aca" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:11:09 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-fde01a54-8829-4438-9584-e8c2071ceed4 tempest-GroupSnapshotsTest-379341379 None] Acquiring lock "cinder-quobyte-d09f2ac8-b23a-4bf7-9300-6eefc6da5088" by "_delete_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:11:09 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-fde01a54-8829-4438-9584-e8c2071ceed4 tempest-GroupSnapshotsTest-379341379 None] Lock "cinder-quobyte-d09f2ac8-b23a-4bf7-9300-6eefc6da5088" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:11:09 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-fde01a54-8829-4438-9584-e8c2071ceed4 tempest-GroupSnapshotsTest-379341379 None] Deleting offline snapshot d09f2ac8-b23a-4bf7-9300-6eefc6da5088 of volume 57e55edd-1b12-4476-849f-ae80a77c3aca {{(pid=86111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 29 01:11:09 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-fde01a54-8829-4438-9584-e8c2071ceed4 tempest-GroupSnapshotsTest-379341379 None] snapshot_file for this snap is: volume-57e55edd-1b12-4476-849f-ae80a77c3aca.d09f2ac8-b23a-4bf7-9300-6eefc6da5088 {{(pid=86111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 29 01:11:09 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[1822793e-e63e-48be-8cb8-2d6a4f87d9ca]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:11:09 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-fde01a54-8829-4438-9584-e8c2071ceed4 tempest-GroupSnapshotsTest-379341379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-57e55edd-1b12-4476-849f-ae80a77c3aca.d09f2ac8-b23a-4bf7-9300-6eefc6da5088 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:11:10 devstack sudo[88290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-57e55edd-1b12-4476-849f-ae80a77c3aca.d09f2ac8-b23a-4bf7-9300-6eefc6da5088 Aug 29 01:11:10 devstack sudo[88290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:11:10 devstack sudo[88290]: pam_unix(sudo:session): session closed for user root Aug 29 01:11:10 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-fde01a54-8829-4438-9584-e8c2071ceed4 tempest-GroupSnapshotsTest-379341379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-57e55edd-1b12-4476-849f-ae80a77c3aca.d09f2ac8-b23a-4bf7-9300-6eefc6da5088" returned: 0 in 0.609s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:11:10 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-fde01a54-8829-4438-9584-e8c2071ceed4 tempest-GroupSnapshotsTest-379341379 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-57e55edd-1b12-4476-849f-ae80a77c3aca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 29 01:11:10 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[76dcbdbb-c2ef-4cef-aa71-f42eccea4764]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:11:10 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-fde01a54-8829-4438-9584-e8c2071ceed4 tempest-GroupSnapshotsTest-379341379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-57e55edd-1b12-4476-849f-ae80a77c3aca {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:11:10 devstack sudo[88299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-57e55edd-1b12-4476-849f-ae80a77c3aca Aug 29 01:11:10 devstack sudo[88299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:11:11 devstack sudo[88299]: pam_unix(sudo:session): session closed for user root Aug 29 01:11:11 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-fde01a54-8829-4438-9584-e8c2071ceed4 tempest-GroupSnapshotsTest-379341379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-57e55edd-1b12-4476-849f-ae80a77c3aca" returned: 0 in 0.525s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:11:11 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-fde01a54-8829-4438-9584-e8c2071ceed4 tempest-GroupSnapshotsTest-379341379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-57e55edd-1b12-4476-849f-ae80a77c3aca.d09f2ac8-b23a-4bf7-9300-6eefc6da5088 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:11:11 devstack sudo[88304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-57e55edd-1b12-4476-849f-ae80a77c3aca.d09f2ac8-b23a-4bf7-9300-6eefc6da5088 Aug 29 01:11:11 devstack sudo[88304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:11:11 devstack sudo[88304]: pam_unix(sudo:session): session closed for user root Aug 29 01:11:11 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-fde01a54-8829-4438-9584-e8c2071ceed4 tempest-GroupSnapshotsTest-379341379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-57e55edd-1b12-4476-849f-ae80a77c3aca.d09f2ac8-b23a-4bf7-9300-6eefc6da5088" returned: 0 in 0.850s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:11:11 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-fde01a54-8829-4438-9584-e8c2071ceed4 tempest-GroupSnapshotsTest-379341379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-57e55edd-1b12-4476-849f-ae80a77c3aca.d09f2ac8-b23a-4bf7-9300-6eefc6da5088 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:11:11 devstack sudo[88338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-57e55edd-1b12-4476-849f-ae80a77c3aca.d09f2ac8-b23a-4bf7-9300-6eefc6da5088 Aug 29 01:11:11 devstack sudo[88338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:11:12 devstack sudo[88338]: pam_unix(sudo:session): session closed for user root Aug 29 01:11:12 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-fde01a54-8829-4438-9584-e8c2071ceed4 tempest-GroupSnapshotsTest-379341379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-57e55edd-1b12-4476-849f-ae80a77c3aca.d09f2ac8-b23a-4bf7-9300-6eefc6da5088" returned: 0 in 0.428s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:11:12 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-fde01a54-8829-4438-9584-e8c2071ceed4 tempest-GroupSnapshotsTest-379341379 None] Lock "cinder-quobyte-d09f2ac8-b23a-4bf7-9300-6eefc6da5088" released by "_delete_snapshot" :: held 2.620s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:11:12 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-fde01a54-8829-4438-9584-e8c2071ceed4 tempest-GroupSnapshotsTest-379341379 None] Lock "cinder-quobyte-57e55edd-1b12-4476-849f-ae80a77c3aca" released by "delete_snapshot" :: held 2.658s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:11:12 devstack cinder-volume[86111]: WARNING cinder.quota [None req-fde01a54-8829-4438-9584-e8c2071ceed4 tempest-GroupSnapshotsTest-379341379 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1936490741 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1936490741, it is now deprecated. Please use the default quota class for default quota. Aug 29 01:11:12 devstack cinder-volume[86111]: WARNING cinder.quota [None req-fde01a54-8829-4438-9584-e8c2071ceed4 tempest-GroupSnapshotsTest-379341379 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1936490741 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1936490741, it is now deprecated. Please use the default quota class for default quota. Aug 29 01:11:12 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-fde01a54-8829-4438-9584-e8c2071ceed4 tempest-GroupSnapshotsTest-379341379 None] Created reservations ['b36cf8b7-23f6-4bc2-94ef-8b16a5597286', 'db72acfa-6b92-4914-b550-941c5dd83343', '5784b2d3-3c2e-451c-8975-373a1977c5d0', 'a2fe8dfc-4a10-459e-a058-9953d99a1a6f'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:11:12 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-fde01a54-8829-4438-9584-e8c2071ceed4 tempest-GroupSnapshotsTest-379341379 None] Created reservations ['4487a3a3-4847-4e73-998f-7773b3e81948', '0494a3f2-5227-457c-830d-39a3bbb0770c', 'df3eae0b-2a68-424f-838c-9f13fb62bd0c', '3b852ad5-92a1-4279-a522-87408b81c686'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:11:13 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-fde01a54-8829-4438-9584-e8c2071ceed4 tempest-GroupSnapshotsTest-379341379 None] group_snapshot 25702d5f-b652-4977-b023-cc8c4876b2f6: deleted successfully Aug 29 01:11:14 devstack cinder-volume[86111]: DEBUG dbcounter [-] [86111] Writing DB stats cinder:SELECT=76,cinder:UPDATE=65,cinder:INSERT=14,cinder:DELETE=2 {{(pid=86111) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 29 01:11:14 devstack cinder-volume[86111]: DEBUG dbcounter [-] [86111] Writing DB stats cinder:SELECT=75,cinder:UPDATE=67,cinder:DELETE=2,cinder:INSERT=16 {{(pid=86111) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 29 01:11:14 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-07c7f94a-7872-4a6d-b4c1-8b98aa9853a4 tempest-GroupSnapshotsTest-379341379 None] Acquiring lock "cinder-quobyte-57e55edd-1b12-4476-849f-ae80a77c3aca" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:11:15 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-07c7f94a-7872-4a6d-b4c1-8b98aa9853a4 tempest-GroupSnapshotsTest-379341379 None] Lock "cinder-quobyte-57e55edd-1b12-4476-849f-ae80a77c3aca" acquired by "delete_volume" :: waited 0.048s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:11:15 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8f95f98-4915-4c36-a33d-72d9ed37bfbc]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:11:15 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-07c7f94a-7872-4a6d-b4c1-8b98aa9853a4 tempest-GroupSnapshotsTest-379341379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-57e55edd-1b12-4476-849f-ae80a77c3aca {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:11:15 devstack sudo[88406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-57e55edd-1b12-4476-849f-ae80a77c3aca Aug 29 01:11:15 devstack sudo[88406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:11:15 devstack sudo[88406]: pam_unix(sudo:session): session closed for user root Aug 29 01:11:15 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-07c7f94a-7872-4a6d-b4c1-8b98aa9853a4 tempest-GroupSnapshotsTest-379341379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-57e55edd-1b12-4476-849f-ae80a77c3aca" returned: 0 in 0.814s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:11:15 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-07c7f94a-7872-4a6d-b4c1-8b98aa9853a4 tempest-GroupSnapshotsTest-379341379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-57e55edd-1b12-4476-849f-ae80a77c3aca {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:11:15 devstack sudo[88412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-57e55edd-1b12-4476-849f-ae80a77c3aca Aug 29 01:11:15 devstack sudo[88412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:11:16 devstack sudo[88412]: pam_unix(sudo:session): session closed for user root Aug 29 01:11:16 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-07c7f94a-7872-4a6d-b4c1-8b98aa9853a4 tempest-GroupSnapshotsTest-379341379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-57e55edd-1b12-4476-849f-ae80a77c3aca" returned: 0 in 0.453s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:11:16 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-07c7f94a-7872-4a6d-b4c1-8b98aa9853a4 tempest-GroupSnapshotsTest-379341379 None] Lock "cinder-quobyte-57e55edd-1b12-4476-849f-ae80a77c3aca" released by "delete_volume" :: held 1.374s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:11:16 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-07c7f94a-7872-4a6d-b4c1-8b98aa9853a4 tempest-GroupSnapshotsTest-379341379 None] Acquiring lock "cinder-quobyte-ad333ea0-4316-48e6-a15c-96693d2fbb14" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:11:16 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-07c7f94a-7872-4a6d-b4c1-8b98aa9853a4 tempest-GroupSnapshotsTest-379341379 None] Lock "cinder-quobyte-ad333ea0-4316-48e6-a15c-96693d2fbb14" acquired by "delete_volume" :: waited 0.046s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:11:16 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[57aecb31-759c-4fe9-a11f-4f0aa8e01fb2]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:11:16 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-07c7f94a-7872-4a6d-b4c1-8b98aa9853a4 tempest-GroupSnapshotsTest-379341379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ad333ea0-4316-48e6-a15c-96693d2fbb14 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:11:16 devstack sudo[88426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ad333ea0-4316-48e6-a15c-96693d2fbb14 Aug 29 01:11:16 devstack sudo[88426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:11:17 devstack sudo[88426]: pam_unix(sudo:session): session closed for user root Aug 29 01:11:17 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-07c7f94a-7872-4a6d-b4c1-8b98aa9853a4 tempest-GroupSnapshotsTest-379341379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ad333ea0-4316-48e6-a15c-96693d2fbb14" returned: 0 in 1.128s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:11:17 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-07c7f94a-7872-4a6d-b4c1-8b98aa9853a4 tempest-GroupSnapshotsTest-379341379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ad333ea0-4316-48e6-a15c-96693d2fbb14 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:11:17 devstack sudo[88444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ad333ea0-4316-48e6-a15c-96693d2fbb14 Aug 29 01:11:17 devstack sudo[88444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:11:18 devstack sudo[88444]: pam_unix(sudo:session): session closed for user root Aug 29 01:11:18 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-07c7f94a-7872-4a6d-b4c1-8b98aa9853a4 tempest-GroupSnapshotsTest-379341379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ad333ea0-4316-48e6-a15c-96693d2fbb14" returned: 0 in 0.729s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:11:18 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-07c7f94a-7872-4a6d-b4c1-8b98aa9853a4 tempest-GroupSnapshotsTest-379341379 None] Lock "cinder-quobyte-ad333ea0-4316-48e6-a15c-96693d2fbb14" released by "delete_volume" :: held 2.022s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:11:18 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-07c7f94a-7872-4a6d-b4c1-8b98aa9853a4 tempest-GroupSnapshotsTest-379341379 None] Created reservations ['9586fa07-65ae-438f-a3ec-bd21b100adf2'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:11:18 devstack cinder-volume[86111]: WARNING cinder.quota [None req-07c7f94a-7872-4a6d-b4c1-8b98aa9853a4 tempest-GroupSnapshotsTest-379341379 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1936490741 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1936490741, it is now deprecated. Please use the default quota class for default quota. Aug 29 01:11:18 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-07c7f94a-7872-4a6d-b4c1-8b98aa9853a4 tempest-GroupSnapshotsTest-379341379 None] Created reservations ['15df37b1-8f8d-4494-b0c6-d225a7f5bae4', '9a1f48e1-ed74-408e-a8cd-54c6281b2c4a', 'c7ad5341-5416-4da6-94b0-9adb193262f0', 'ffd44e53-560d-48d2-9c2b-78b0e50cc6c2'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:11:19 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-07c7f94a-7872-4a6d-b4c1-8b98aa9853a4 tempest-GroupSnapshotsTest-379341379 None] Created reservations ['738a4ff7-2563-43de-bd93-81122c36857d', '269c589f-9834-46ab-afdf-c35a8d9b543e', 'acf25697-1968-4437-bc1a-3ebb40953419', '989afb62-e2ba-452a-8afd-c77389acd6e5'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:11:19 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-07c7f94a-7872-4a6d-b4c1-8b98aa9853a4 tempest-GroupSnapshotsTest-379341379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:11:19 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-07c7f94a-7872-4a6d-b4c1-8b98aa9853a4 tempest-GroupSnapshotsTest-379341379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:11:19 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-07c7f94a-7872-4a6d-b4c1-8b98aa9853a4 tempest-GroupSnapshotsTest-379341379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:11:19 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-07c7f94a-7872-4a6d-b4c1-8b98aa9853a4 tempest-GroupSnapshotsTest-379341379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:11:19 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-07c7f94a-7872-4a6d-b4c1-8b98aa9853a4 tempest-GroupSnapshotsTest-379341379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:11:19 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-07c7f94a-7872-4a6d-b4c1-8b98aa9853a4 tempest-GroupSnapshotsTest-379341379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:11:19 devstack sudo[88486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:11:19 devstack sudo[88486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:11:20 devstack sudo[88486]: pam_unix(sudo:session): session closed for user root Aug 29 01:11:20 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-07c7f94a-7872-4a6d-b4c1-8b98aa9853a4 tempest-GroupSnapshotsTest-379341379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.666s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:11:20 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-07c7f94a-7872-4a6d-b4c1-8b98aa9853a4 tempest-GroupSnapshotsTest-379341379 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:11:20 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-07c7f94a-7872-4a6d-b4c1-8b98aa9853a4 tempest-GroupSnapshotsTest-379341379 None] Delete group completed successfully. Aug 29 01:11:20 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-638b6fa9-432c-4ebe-83c6-c8d1977e66af tempest-GroupSnapshotsTest-379341379 None] Group tempest-GroupSnapshotsTest-Group-1564517606: creating Aug 29 01:11:20 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-638b6fa9-432c-4ebe-83c6-c8d1977e66af tempest-GroupSnapshotsTest-379341379 None] Group tempest-GroupSnapshotsTest-Group-1564517606: created successfully Aug 29 01:11:20 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-638b6fa9-432c-4ebe-83c6-c8d1977e66af tempest-GroupSnapshotsTest-379341379 None] Create group completed successfully. Aug 29 01:11:22 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae3ab26b-72cd-427b-b79f-e31d54d54534 tempest-ServerActionsTestOtherA-1708480225 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:11:22 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-ae3ab26b-72cd-427b-b79f-e31d54d54534 tempest-ServerActionsTestOtherA-1708480225 None] Flow 'volume_create_manager' (ad63b9f1-81da-4d28-8c01-7343a5bc3e92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:11:22 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-ae3ab26b-72cd-427b-b79f-e31d54d54534 tempest-ServerActionsTestOtherA-1708480225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d668592-1223-4d05-ab2d-571101252ee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:11:22 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-ae3ab26b-72cd-427b-b79f-e31d54d54534 tempest-ServerActionsTestOtherA-1708480225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d668592-1223-4d05-ab2d-571101252ee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:11:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1361646438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9af8977b-2315-4371-8d6a-87bcad5bc11f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5c62dca20b44d5eb68bd411b8d7a2d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:11:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:11:22Z,use_quota=True,user_id='a2b7d8b4c5c2425a8a08eb9ce1f14da6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:11:22 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-ae3ab26b-72cd-427b-b79f-e31d54d54534 tempest-ServerActionsTestOtherA-1708480225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7b4d609-ec25-4daa-a374-92c4ad0097dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:11:22 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-ae3ab26b-72cd-427b-b79f-e31d54d54534 tempest-ServerActionsTestOtherA-1708480225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7b4d609-ec25-4daa-a374-92c4ad0097dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:11:22 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-ae3ab26b-72cd-427b-b79f-e31d54d54534 tempest-ServerActionsTestOtherA-1708480225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0471f26e-5f2a-4889-994d-30140481c98c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:11:22 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-ae3ab26b-72cd-427b-b79f-e31d54d54534 tempest-ServerActionsTestOtherA-1708480225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0471f26e-5f2a-4889-994d-30140481c98c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9af8977b-2315-4371-8d6a-87bcad5bc11f', 'volume_name': 'volume-9af8977b-2315-4371-8d6a-87bcad5bc11f', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:11:22 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-ae3ab26b-72cd-427b-b79f-e31d54d54534 tempest-ServerActionsTestOtherA-1708480225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2860c0d-0619-4c2c-a246-0b161431b4b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:11:22 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-ae3ab26b-72cd-427b-b79f-e31d54d54534 tempest-ServerActionsTestOtherA-1708480225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2860c0d-0619-4c2c-a246-0b161431b4b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:11:22 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-ae3ab26b-72cd-427b-b79f-e31d54d54534 tempest-ServerActionsTestOtherA-1708480225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c880dc2-eddd-447b-bdbe-171fc871f8e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:11:22 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-ae3ab26b-72cd-427b-b79f-e31d54d54534 tempest-ServerActionsTestOtherA-1708480225 None] Volume 9af8977b-2315-4371-8d6a-87bcad5bc11f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9af8977b-2315-4371-8d6a-87bcad5bc11f', 'volume_size': 1} Aug 29 01:11:22 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-ae3ab26b-72cd-427b-b79f-e31d54d54534 tempest-ServerActionsTestOtherA-1708480225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:11:22 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-ae3ab26b-72cd-427b-b79f-e31d54d54534 tempest-ServerActionsTestOtherA-1708480225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:11:22 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-ae3ab26b-72cd-427b-b79f-e31d54d54534 tempest-ServerActionsTestOtherA-1708480225 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:11:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1361646438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9af8977b-2315-4371-8d6a-87bcad5bc11f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5c62dca20b44d5eb68bd411b8d7a2d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:11:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:11:22Z,use_quota=True,user_id='a2b7d8b4c5c2425a8a08eb9ce1f14da6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:11:22 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-ae3ab26b-72cd-427b-b79f-e31d54d54534 tempest-ServerActionsTestOtherA-1708480225 None] Creating volume 9af8977b-2315-4371-8d6a-87bcad5bc11f {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:11:22 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-ae3ab26b-72cd-427b-b79f-e31d54d54534 tempest-ServerActionsTestOtherA-1708480225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:11:22 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-ae3ab26b-72cd-427b-b79f-e31d54d54534 tempest-ServerActionsTestOtherA-1708480225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:11:22 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-ae3ab26b-72cd-427b-b79f-e31d54d54534 tempest-ServerActionsTestOtherA-1708480225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:11:22 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-ae3ab26b-72cd-427b-b79f-e31d54d54534 tempest-ServerActionsTestOtherA-1708480225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:11:22 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-ae3ab26b-72cd-427b-b79f-e31d54d54534 tempest-ServerActionsTestOtherA-1708480225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:11:22 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-ae3ab26b-72cd-427b-b79f-e31d54d54534 tempest-ServerActionsTestOtherA-1708480225 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:11:22 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-ae3ab26b-72cd-427b-b79f-e31d54d54534 tempest-ServerActionsTestOtherA-1708480225 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:11:22 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-ae3ab26b-72cd-427b-b79f-e31d54d54534 tempest-ServerActionsTestOtherA-1708480225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-9af8977b-2315-4371-8d6a-87bcad5bc11f 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:11:22 devstack sudo[88534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-9af8977b-2315-4371-8d6a-87bcad5bc11f 1073741824 Aug 29 01:11:22 devstack sudo[88534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:11:23 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b778bc1-c51a-4dcd-9790-b2062f589d58 tempest-GroupSnapshotsTest-379341379 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:11:23 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-7b778bc1-c51a-4dcd-9790-b2062f589d58 tempest-GroupSnapshotsTest-379341379 None] Flow 'volume_create_manager' (7c5a8591-d631-4d5f-85ca-5c82d6be391f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:11:23 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-7b778bc1-c51a-4dcd-9790-b2062f589d58 tempest-GroupSnapshotsTest-379341379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87a15690-0516-4a9e-b246-214bc81ff5b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:11:23 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-7b778bc1-c51a-4dcd-9790-b2062f589d58 tempest-GroupSnapshotsTest-379341379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87a15690-0516-4a9e-b246-214bc81ff5b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:11:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1169345034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7496c351-8853-49f2-b687-77153aa68b66,host='devstack@QuobyteHD#QuobyteHD',id=941ae6ef-fb47-477b-b800-9f8fdd4ee826,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50787aacf8064212b410d4f97d55d629',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:11:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:11:23Z,use_quota=True,user_id='2c6852d5bcec4367a445767ca79915fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01bc6684-46f3-4311-916f-c36669af52dc),volume_type_id=01bc6684-46f3-4311-916f-c36669af52dc)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:11:23 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-7b778bc1-c51a-4dcd-9790-b2062f589d58 tempest-GroupSnapshotsTest-379341379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71063a79-481d-4502-b08d-174080dc2b81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:11:23 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-7b778bc1-c51a-4dcd-9790-b2062f589d58 tempest-GroupSnapshotsTest-379341379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71063a79-481d-4502-b08d-174080dc2b81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:11:23 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-7b778bc1-c51a-4dcd-9790-b2062f589d58 tempest-GroupSnapshotsTest-379341379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58569393-f617-4952-86ac-7747c3bf89ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:11:23 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-7b778bc1-c51a-4dcd-9790-b2062f589d58 tempest-GroupSnapshotsTest-379341379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58569393-f617-4952-86ac-7747c3bf89ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '941ae6ef-fb47-477b-b800-9f8fdd4ee826', 'volume_name': 'volume-941ae6ef-fb47-477b-b800-9f8fdd4ee826', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:11:23 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-7b778bc1-c51a-4dcd-9790-b2062f589d58 tempest-GroupSnapshotsTest-379341379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cb99dcc-1aef-4da2-8cdc-247163076ee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:11:23 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-7b778bc1-c51a-4dcd-9790-b2062f589d58 tempest-GroupSnapshotsTest-379341379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cb99dcc-1aef-4da2-8cdc-247163076ee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:11:23 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-7b778bc1-c51a-4dcd-9790-b2062f589d58 tempest-GroupSnapshotsTest-379341379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (231c19f6-f170-4c24-a56a-8f88bad06fa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:11:23 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-7b778bc1-c51a-4dcd-9790-b2062f589d58 tempest-GroupSnapshotsTest-379341379 None] Volume 941ae6ef-fb47-477b-b800-9f8fdd4ee826: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-941ae6ef-fb47-477b-b800-9f8fdd4ee826', 'volume_size': 1} Aug 29 01:11:23 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-7b778bc1-c51a-4dcd-9790-b2062f589d58 tempest-GroupSnapshotsTest-379341379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:11:24 devstack sudo[88534]: pam_unix(sudo:session): session closed for user root Aug 29 01:11:24 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-ae3ab26b-72cd-427b-b79f-e31d54d54534 tempest-ServerActionsTestOtherA-1708480225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-9af8977b-2315-4371-8d6a-87bcad5bc11f 1073741824" returned: 0 in 1.428s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:11:24 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-ae3ab26b-72cd-427b-b79f-e31d54d54534 tempest-ServerActionsTestOtherA-1708480225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-9af8977b-2315-4371-8d6a-87bcad5bc11f {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:11:24 devstack sudo[88543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-9af8977b-2315-4371-8d6a-87bcad5bc11f Aug 29 01:11:24 devstack sudo[88543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:11:24 devstack sudo[88543]: pam_unix(sudo:session): session closed for user root Aug 29 01:11:24 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-ae3ab26b-72cd-427b-b79f-e31d54d54534 tempest-ServerActionsTestOtherA-1708480225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-9af8977b-2315-4371-8d6a-87bcad5bc11f" returned: 0 in 0.461s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:11:24 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-ae3ab26b-72cd-427b-b79f-e31d54d54534 tempest-ServerActionsTestOtherA-1708480225 None] <== create_volume: return (2004ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:11:24 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-ae3ab26b-72cd-427b-b79f-e31d54d54534 tempest-ServerActionsTestOtherA-1708480225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.007s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:11:24 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-7b778bc1-c51a-4dcd-9790-b2062f589d58 tempest-GroupSnapshotsTest-379341379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.912s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:11:24 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-7b778bc1-c51a-4dcd-9790-b2062f589d58 tempest-GroupSnapshotsTest-379341379 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7496c351-8853-49f2-b687-77153aa68b66,created_at=2026-08-28T23:11:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1169345034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7496c351-8853-49f2-b687-77153aa68b66,host='devstack@QuobyteHD#QuobyteHD',id=941ae6ef-fb47-477b-b800-9f8fdd4ee826,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50787aacf8064212b410d4f97d55d629',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:11:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:11:23Z,use_quota=True,user_id='2c6852d5bcec4367a445767ca79915fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01bc6684-46f3-4311-916f-c36669af52dc),volume_type_id=01bc6684-46f3-4311-916f-c36669af52dc)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:11:24 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-7b778bc1-c51a-4dcd-9790-b2062f589d58 tempest-GroupSnapshotsTest-379341379 None] Creating volume 941ae6ef-fb47-477b-b800-9f8fdd4ee826 {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:11:24 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-7b778bc1-c51a-4dcd-9790-b2062f589d58 tempest-GroupSnapshotsTest-379341379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:11:24 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-7b778bc1-c51a-4dcd-9790-b2062f589d58 tempest-GroupSnapshotsTest-379341379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:11:24 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-7b778bc1-c51a-4dcd-9790-b2062f589d58 tempest-GroupSnapshotsTest-379341379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:11:24 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-7b778bc1-c51a-4dcd-9790-b2062f589d58 tempest-GroupSnapshotsTest-379341379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:11:24 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-7b778bc1-c51a-4dcd-9790-b2062f589d58 tempest-GroupSnapshotsTest-379341379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:11:24 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-7b778bc1-c51a-4dcd-9790-b2062f589d58 tempest-GroupSnapshotsTest-379341379 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:11:24 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-7b778bc1-c51a-4dcd-9790-b2062f589d58 tempest-GroupSnapshotsTest-379341379 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:11:24 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-7b778bc1-c51a-4dcd-9790-b2062f589d58 tempest-GroupSnapshotsTest-379341379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-941ae6ef-fb47-477b-b800-9f8fdd4ee826 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:11:24 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-ae3ab26b-72cd-427b-b79f-e31d54d54534 tempest-ServerActionsTestOtherA-1708480225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c880dc2-eddd-447b-bdbe-171fc871f8e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9af8977b-2315-4371-8d6a-87bcad5bc11f', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:11:24 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-ae3ab26b-72cd-427b-b79f-e31d54d54534 tempest-ServerActionsTestOtherA-1708480225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3136d6d-ef10-444f-8129-e1ffd52d846c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:11:24 devstack sudo[88562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-941ae6ef-fb47-477b-b800-9f8fdd4ee826 1073741824 Aug 29 01:11:24 devstack sudo[88562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:11:24 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-ae3ab26b-72cd-427b-b79f-e31d54d54534 tempest-ServerActionsTestOtherA-1708480225 None] Volume volume-9af8977b-2315-4371-8d6a-87bcad5bc11f (9af8977b-2315-4371-8d6a-87bcad5bc11f): created successfully Aug 29 01:11:24 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-ae3ab26b-72cd-427b-b79f-e31d54d54534 tempest-ServerActionsTestOtherA-1708480225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3136d6d-ef10-444f-8129-e1ffd52d846c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:11:24 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-ae3ab26b-72cd-427b-b79f-e31d54d54534 tempest-ServerActionsTestOtherA-1708480225 None] Flow 'volume_create_manager' (ad63b9f1-81da-4d28-8c01-7343a5bc3e92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:11:24 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-ae3ab26b-72cd-427b-b79f-e31d54d54534 tempest-ServerActionsTestOtherA-1708480225 None] Created volume successfully. Aug 29 01:11:25 devstack sudo[88562]: pam_unix(sudo:session): session closed for user root Aug 29 01:11:25 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-7b778bc1-c51a-4dcd-9790-b2062f589d58 tempest-GroupSnapshotsTest-379341379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-941ae6ef-fb47-477b-b800-9f8fdd4ee826 1073741824" returned: 0 in 0.964s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:11:25 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-7b778bc1-c51a-4dcd-9790-b2062f589d58 tempest-GroupSnapshotsTest-379341379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-941ae6ef-fb47-477b-b800-9f8fdd4ee826 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:11:25 devstack sudo[88571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-941ae6ef-fb47-477b-b800-9f8fdd4ee826 Aug 29 01:11:25 devstack sudo[88571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:11:26 devstack sudo[88571]: pam_unix(sudo:session): session closed for user root Aug 29 01:11:26 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-7b778bc1-c51a-4dcd-9790-b2062f589d58 tempest-GroupSnapshotsTest-379341379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-941ae6ef-fb47-477b-b800-9f8fdd4ee826" returned: 0 in 0.544s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:11:26 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-7b778bc1-c51a-4dcd-9790-b2062f589d58 tempest-GroupSnapshotsTest-379341379 None] <== create_volume: return (1602ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:11:26 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-7b778bc1-c51a-4dcd-9790-b2062f589d58 tempest-GroupSnapshotsTest-379341379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.619s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:11:26 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-7b778bc1-c51a-4dcd-9790-b2062f589d58 tempest-GroupSnapshotsTest-379341379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (231c19f6-f170-4c24-a56a-8f88bad06fa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-941ae6ef-fb47-477b-b800-9f8fdd4ee826', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:11:26 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-7b778bc1-c51a-4dcd-9790-b2062f589d58 tempest-GroupSnapshotsTest-379341379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60224454-a09f-4811-9f24-4cd5dd5736c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:11:26 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-7b778bc1-c51a-4dcd-9790-b2062f589d58 tempest-GroupSnapshotsTest-379341379 None] Volume volume-941ae6ef-fb47-477b-b800-9f8fdd4ee826 (941ae6ef-fb47-477b-b800-9f8fdd4ee826): created successfully Aug 29 01:11:26 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-7b778bc1-c51a-4dcd-9790-b2062f589d58 tempest-GroupSnapshotsTest-379341379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60224454-a09f-4811-9f24-4cd5dd5736c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:11:26 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-7b778bc1-c51a-4dcd-9790-b2062f589d58 tempest-GroupSnapshotsTest-379341379 None] Flow 'volume_create_manager' (7c5a8591-d631-4d5f-85ca-5c82d6be391f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:11:26 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-7b778bc1-c51a-4dcd-9790-b2062f589d58 tempest-GroupSnapshotsTest-379341379 None] Created volume successfully. Aug 29 01:11:27 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-d24942d9-4717-48ad-ac74-44f5f20c0779 tempest-GroupSnapshotsTest-379341379 None] GroupSnapshot 5ba61ddd-132a-48f8-ae6b-200d9b392d12: creating. Aug 29 01:11:28 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-d24942d9-4717-48ad-ac74-44f5f20c0779 tempest-GroupSnapshotsTest-379341379 None] Group snapshot 5ba61ddd-132a-48f8-ae6b-200d9b392d12: creating. {{(pid=86111) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Aug 29 01:11:28 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-d24942d9-4717-48ad-ac74-44f5f20c0779 tempest-GroupSnapshotsTest-379341379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:11:28 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-d24942d9-4717-48ad-ac74-44f5f20c0779 tempest-GroupSnapshotsTest-379341379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:11:28 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-d24942d9-4717-48ad-ac74-44f5f20c0779 tempest-GroupSnapshotsTest-379341379 None] Creating offline snapshot 971bdc60-e7e7-4020-acb3-485b671b03b1 of volume 941ae6ef-fb47-477b-b800-9f8fdd4ee826 {{(pid=86111) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 29 01:11:28 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[64a567bf-30de-4cf6-9543-642100d40213]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:11:28 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d24942d9-4717-48ad-ac74-44f5f20c0779 tempest-GroupSnapshotsTest-379341379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-941ae6ef-fb47-477b-b800-9f8fdd4ee826 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:11:28 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b55d659-3520-48e3-a08e-321f6622a37e tempest-ServerRescueNegativeTestJSON-570759507 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:11:28 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-1b55d659-3520-48e3-a08e-321f6622a37e tempest-ServerRescueNegativeTestJSON-570759507 None] Flow 'volume_create_manager' (5d852ba7-47f4-487f-87a4-6713363c2e80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:11:28 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-1b55d659-3520-48e3-a08e-321f6622a37e tempest-ServerRescueNegativeTestJSON-570759507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94b2bea5-fa4b-4dc4-819b-f844167c28fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:11:28 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-1b55d659-3520-48e3-a08e-321f6622a37e tempest-ServerRescueNegativeTestJSON-570759507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94b2bea5-fa4b-4dc4-819b-f844167c28fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:11:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-373911614',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c833ebd-5f59-4d53-bc44-4c196f047d7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8988960a7dbe492ebba563e2d4a2cf1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:11:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:11:28Z,use_quota=True,user_id='e25c7d1c039e4fdc9b650ca355d38d22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:11:28 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-1b55d659-3520-48e3-a08e-321f6622a37e tempest-ServerRescueNegativeTestJSON-570759507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a8335e5-b309-46bd-8a88-f3ac2797831b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:11:28 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-1b55d659-3520-48e3-a08e-321f6622a37e tempest-ServerRescueNegativeTestJSON-570759507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a8335e5-b309-46bd-8a88-f3ac2797831b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:11:28 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-1b55d659-3520-48e3-a08e-321f6622a37e tempest-ServerRescueNegativeTestJSON-570759507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16b32c95-16c7-425c-a0f1-6c5332ab7302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:11:28 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-1b55d659-3520-48e3-a08e-321f6622a37e tempest-ServerRescueNegativeTestJSON-570759507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16b32c95-16c7-425c-a0f1-6c5332ab7302) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c833ebd-5f59-4d53-bc44-4c196f047d7a', 'volume_name': 'volume-9c833ebd-5f59-4d53-bc44-4c196f047d7a', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:11:28 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-1b55d659-3520-48e3-a08e-321f6622a37e tempest-ServerRescueNegativeTestJSON-570759507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88ef8848-1c88-4af5-8c49-7988705c23f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:11:28 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-1b55d659-3520-48e3-a08e-321f6622a37e tempest-ServerRescueNegativeTestJSON-570759507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88ef8848-1c88-4af5-8c49-7988705c23f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:11:28 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-1b55d659-3520-48e3-a08e-321f6622a37e tempest-ServerRescueNegativeTestJSON-570759507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39311479-0f86-4ceb-aa81-63e5e126dc4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:11:28 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-1b55d659-3520-48e3-a08e-321f6622a37e tempest-ServerRescueNegativeTestJSON-570759507 None] Volume 9c833ebd-5f59-4d53-bc44-4c196f047d7a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c833ebd-5f59-4d53-bc44-4c196f047d7a', 'volume_size': 1} Aug 29 01:11:28 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-1b55d659-3520-48e3-a08e-321f6622a37e tempest-ServerRescueNegativeTestJSON-570759507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:11:28 devstack sudo[88575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-941ae6ef-fb47-477b-b800-9f8fdd4ee826 Aug 29 01:11:28 devstack sudo[88575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:11:28 devstack sudo[88575]: pam_unix(sudo:session): session closed for user root Aug 29 01:11:28 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d24942d9-4717-48ad-ac74-44f5f20c0779 tempest-GroupSnapshotsTest-379341379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-941ae6ef-fb47-477b-b800-9f8fdd4ee826" returned: 0 in 0.621s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:11:28 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d24942d9-4717-48ad-ac74-44f5f20c0779 tempest-GroupSnapshotsTest-379341379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-941ae6ef-fb47-477b-b800-9f8fdd4ee826,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-941ae6ef-fb47-477b-b800-9f8fdd4ee826.971bdc60-e7e7-4020-acb3-485b671b03b1 1G {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:11:28 devstack sudo[88583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-941ae6ef-fb47-477b-b800-9f8fdd4ee826,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-941ae6ef-fb47-477b-b800-9f8fdd4ee826.971bdc60-e7e7-4020-acb3-485b671b03b1 1G Aug 29 01:11:28 devstack sudo[88583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:11:29 devstack sudo[88583]: pam_unix(sudo:session): session closed for user root Aug 29 01:11:29 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d24942d9-4717-48ad-ac74-44f5f20c0779 tempest-GroupSnapshotsTest-379341379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-941ae6ef-fb47-477b-b800-9f8fdd4ee826,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-941ae6ef-fb47-477b-b800-9f8fdd4ee826.971bdc60-e7e7-4020-acb3-485b671b03b1 1G" returned: 0 in 0.525s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:11:29 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d24942d9-4717-48ad-ac74-44f5f20c0779 tempest-GroupSnapshotsTest-379341379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-941ae6ef-fb47-477b-b800-9f8fdd4ee826 -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-941ae6ef-fb47-477b-b800-9f8fdd4ee826.971bdc60-e7e7-4020-acb3-485b671b03b1 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:11:29 devstack sudo[88588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-941ae6ef-fb47-477b-b800-9f8fdd4ee826 -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-941ae6ef-fb47-477b-b800-9f8fdd4ee826.971bdc60-e7e7-4020-acb3-485b671b03b1 Aug 29 01:11:29 devstack sudo[88588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:11:29 devstack sudo[88588]: pam_unix(sudo:session): session closed for user root Aug 29 01:11:29 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d24942d9-4717-48ad-ac74-44f5f20c0779 tempest-GroupSnapshotsTest-379341379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-941ae6ef-fb47-477b-b800-9f8fdd4ee826 -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-941ae6ef-fb47-477b-b800-9f8fdd4ee826.971bdc60-e7e7-4020-acb3-485b671b03b1" returned: 0 in 0.427s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:11:29 devstack cinder-volume[86111]: WARNING cinder.volume.drivers.remotefs [None req-d24942d9-4717-48ad-ac74-44f5f20c0779 tempest-GroupSnapshotsTest-379341379 None] /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-941ae6ef-fb47-477b-b800-9f8fdd4ee826.971bdc60-e7e7-4020-acb3-485b671b03b1 is being set with open permissions: ugo+rw: NotImplementedError Aug 29 01:11:29 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d24942d9-4717-48ad-ac74-44f5f20c0779 tempest-GroupSnapshotsTest-379341379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-941ae6ef-fb47-477b-b800-9f8fdd4ee826.971bdc60-e7e7-4020-acb3-485b671b03b1 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:11:29 devstack sudo[88595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-941ae6ef-fb47-477b-b800-9f8fdd4ee826.971bdc60-e7e7-4020-acb3-485b671b03b1 Aug 29 01:11:29 devstack sudo[88595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:11:30 devstack sudo[88595]: pam_unix(sudo:session): session closed for user root Aug 29 01:11:30 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d24942d9-4717-48ad-ac74-44f5f20c0779 tempest-GroupSnapshotsTest-379341379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-941ae6ef-fb47-477b-b800-9f8fdd4ee826.971bdc60-e7e7-4020-acb3-485b671b03b1" returned: 0 in 0.420s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:11:30 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d24942d9-4717-48ad-ac74-44f5f20c0779 tempest-GroupSnapshotsTest-379341379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-941ae6ef-fb47-477b-b800-9f8fdd4ee826.info {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:11:30 devstack sudo[88598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-941ae6ef-fb47-477b-b800-9f8fdd4ee826.info Aug 29 01:11:30 devstack sudo[88598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:11:30 devstack sudo[88598]: pam_unix(sudo:session): session closed for user root Aug 29 01:11:30 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d24942d9-4717-48ad-ac74-44f5f20c0779 tempest-GroupSnapshotsTest-379341379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-941ae6ef-fb47-477b-b800-9f8fdd4ee826.info" returned: 0 in 0.503s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:11:30 devstack cinder-volume[86111]: WARNING cinder.volume.drivers.remotefs [None req-d24942d9-4717-48ad-ac74-44f5f20c0779 tempest-GroupSnapshotsTest-379341379 None] /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-941ae6ef-fb47-477b-b800-9f8fdd4ee826.info is being set with open permissions: ugo+rw: NotImplementedError Aug 29 01:11:30 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d24942d9-4717-48ad-ac74-44f5f20c0779 tempest-GroupSnapshotsTest-379341379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-941ae6ef-fb47-477b-b800-9f8fdd4ee826.info {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:11:30 devstack sudo[88602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-941ae6ef-fb47-477b-b800-9f8fdd4ee826.info Aug 29 01:11:30 devstack sudo[88602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:11:31 devstack sudo[88602]: pam_unix(sudo:session): session closed for user root Aug 29 01:11:31 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d24942d9-4717-48ad-ac74-44f5f20c0779 tempest-GroupSnapshotsTest-379341379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-941ae6ef-fb47-477b-b800-9f8fdd4ee826.info" returned: 0 in 0.409s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:11:31 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-d24942d9-4717-48ad-ac74-44f5f20c0779 tempest-GroupSnapshotsTest-379341379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.129s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:11:31 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-1b55d659-3520-48e3-a08e-321f6622a37e tempest-ServerRescueNegativeTestJSON-570759507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.905s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:11:31 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-1b55d659-3520-48e3-a08e-321f6622a37e tempest-ServerRescueNegativeTestJSON-570759507 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:11:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-373911614',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c833ebd-5f59-4d53-bc44-4c196f047d7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8988960a7dbe492ebba563e2d4a2cf1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:11:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:11:28Z,use_quota=True,user_id='e25c7d1c039e4fdc9b650ca355d38d22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:11:31 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-1b55d659-3520-48e3-a08e-321f6622a37e tempest-ServerRescueNegativeTestJSON-570759507 None] Creating volume 9c833ebd-5f59-4d53-bc44-4c196f047d7a {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:11:31 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-1b55d659-3520-48e3-a08e-321f6622a37e tempest-ServerRescueNegativeTestJSON-570759507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:11:31 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-1b55d659-3520-48e3-a08e-321f6622a37e tempest-ServerRescueNegativeTestJSON-570759507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:11:31 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-1b55d659-3520-48e3-a08e-321f6622a37e tempest-ServerRescueNegativeTestJSON-570759507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:11:31 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-1b55d659-3520-48e3-a08e-321f6622a37e tempest-ServerRescueNegativeTestJSON-570759507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:11:31 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-1b55d659-3520-48e3-a08e-321f6622a37e tempest-ServerRescueNegativeTestJSON-570759507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.046s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:11:31 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-1b55d659-3520-48e3-a08e-321f6622a37e tempest-ServerRescueNegativeTestJSON-570759507 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:11:31 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-1b55d659-3520-48e3-a08e-321f6622a37e tempest-ServerRescueNegativeTestJSON-570759507 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:11:31 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-1b55d659-3520-48e3-a08e-321f6622a37e tempest-ServerRescueNegativeTestJSON-570759507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-9c833ebd-5f59-4d53-bc44-4c196f047d7a 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:11:31 devstack sudo[88608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-9c833ebd-5f59-4d53-bc44-4c196f047d7a 1073741824 Aug 29 01:11:31 devstack sudo[88608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:11:31 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-d24942d9-4717-48ad-ac74-44f5f20c0779 tempest-GroupSnapshotsTest-379341379 None] group_snapshot 5ba61ddd-132a-48f8-ae6b-200d9b392d12: created successfully Aug 29 01:11:32 devstack sudo[88608]: pam_unix(sudo:session): session closed for user root Aug 29 01:11:32 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-1b55d659-3520-48e3-a08e-321f6622a37e tempest-ServerRescueNegativeTestJSON-570759507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-9c833ebd-5f59-4d53-bc44-4c196f047d7a 1073741824" returned: 0 in 1.346s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:11:32 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-1b55d659-3520-48e3-a08e-321f6622a37e tempest-ServerRescueNegativeTestJSON-570759507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-9c833ebd-5f59-4d53-bc44-4c196f047d7a {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:11:32 devstack sudo[88628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-9c833ebd-5f59-4d53-bc44-4c196f047d7a Aug 29 01:11:32 devstack sudo[88628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:11:33 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-d4840a85-7de7-4015-8983-d212cbb9b86d tempest-GroupSnapshotsTest-379341379 None] group_snapshot 5ba61ddd-132a-48f8-ae6b-200d9b392d12: deleting Aug 29 01:11:33 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-d4840a85-7de7-4015-8983-d212cbb9b86d tempest-GroupSnapshotsTest-379341379 None] group_snapshot 5ba61ddd-132a-48f8-ae6b-200d9b392d12: deleting {{(pid=86111) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Aug 29 01:11:33 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-d4840a85-7de7-4015-8983-d212cbb9b86d tempest-GroupSnapshotsTest-379341379 None] Acquiring lock "cinder-quobyte-941ae6ef-fb47-477b-b800-9f8fdd4ee826" by "delete_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:11:33 devstack sudo[88628]: pam_unix(sudo:session): session closed for user root Aug 29 01:11:33 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-1b55d659-3520-48e3-a08e-321f6622a37e tempest-ServerRescueNegativeTestJSON-570759507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-9c833ebd-5f59-4d53-bc44-4c196f047d7a" returned: 0 in 0.629s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:11:33 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-1b55d659-3520-48e3-a08e-321f6622a37e tempest-ServerRescueNegativeTestJSON-570759507 None] <== create_volume: return (2114ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:11:33 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-1b55d659-3520-48e3-a08e-321f6622a37e tempest-ServerRescueNegativeTestJSON-570759507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.125s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:11:33 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-d4840a85-7de7-4015-8983-d212cbb9b86d tempest-GroupSnapshotsTest-379341379 None] Lock "cinder-quobyte-941ae6ef-fb47-477b-b800-9f8fdd4ee826" acquired by "delete_snapshot" :: waited 0.051s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:11:33 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-d4840a85-7de7-4015-8983-d212cbb9b86d tempest-GroupSnapshotsTest-379341379 None] Acquiring lock "cinder-quobyte-971bdc60-e7e7-4020-acb3-485b671b03b1" by "_delete_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:11:33 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-1b55d659-3520-48e3-a08e-321f6622a37e tempest-ServerRescueNegativeTestJSON-570759507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39311479-0f86-4ceb-aa81-63e5e126dc4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c833ebd-5f59-4d53-bc44-4c196f047d7a', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:11:33 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-1b55d659-3520-48e3-a08e-321f6622a37e tempest-ServerRescueNegativeTestJSON-570759507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae42b061-a9ea-48c2-b46e-7345ba649ea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:11:33 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-1b55d659-3520-48e3-a08e-321f6622a37e tempest-ServerRescueNegativeTestJSON-570759507 None] Volume volume-9c833ebd-5f59-4d53-bc44-4c196f047d7a (9c833ebd-5f59-4d53-bc44-4c196f047d7a): created successfully Aug 29 01:11:33 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-1b55d659-3520-48e3-a08e-321f6622a37e tempest-ServerRescueNegativeTestJSON-570759507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae42b061-a9ea-48c2-b46e-7345ba649ea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:11:33 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-1b55d659-3520-48e3-a08e-321f6622a37e tempest-ServerRescueNegativeTestJSON-570759507 None] Flow 'volume_create_manager' (5d852ba7-47f4-487f-87a4-6713363c2e80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:11:33 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-d4840a85-7de7-4015-8983-d212cbb9b86d tempest-GroupSnapshotsTest-379341379 None] Lock "cinder-quobyte-971bdc60-e7e7-4020-acb3-485b671b03b1" acquired by "_delete_snapshot" :: waited 0.126s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:11:33 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-d4840a85-7de7-4015-8983-d212cbb9b86d tempest-GroupSnapshotsTest-379341379 None] Deleting offline snapshot 971bdc60-e7e7-4020-acb3-485b671b03b1 of volume 941ae6ef-fb47-477b-b800-9f8fdd4ee826 {{(pid=86111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 29 01:11:33 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-d4840a85-7de7-4015-8983-d212cbb9b86d tempest-GroupSnapshotsTest-379341379 None] snapshot_file for this snap is: volume-941ae6ef-fb47-477b-b800-9f8fdd4ee826.971bdc60-e7e7-4020-acb3-485b671b03b1 {{(pid=86111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 29 01:11:33 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-1b55d659-3520-48e3-a08e-321f6622a37e tempest-ServerRescueNegativeTestJSON-570759507 None] Created volume successfully. Aug 29 01:11:33 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b4d3ab5-7168-46b6-9040-b6e64e78d5d0]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:11:33 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d4840a85-7de7-4015-8983-d212cbb9b86d tempest-GroupSnapshotsTest-379341379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-941ae6ef-fb47-477b-b800-9f8fdd4ee826.971bdc60-e7e7-4020-acb3-485b671b03b1 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:11:33 devstack sudo[88631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-941ae6ef-fb47-477b-b800-9f8fdd4ee826.971bdc60-e7e7-4020-acb3-485b671b03b1 Aug 29 01:11:33 devstack sudo[88631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:11:34 devstack sudo[88631]: pam_unix(sudo:session): session closed for user root Aug 29 01:11:34 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d4840a85-7de7-4015-8983-d212cbb9b86d tempest-GroupSnapshotsTest-379341379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-941ae6ef-fb47-477b-b800-9f8fdd4ee826.971bdc60-e7e7-4020-acb3-485b671b03b1" returned: 0 in 1.017s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:11:34 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-d4840a85-7de7-4015-8983-d212cbb9b86d tempest-GroupSnapshotsTest-379341379 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-941ae6ef-fb47-477b-b800-9f8fdd4ee826(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 29 01:11:34 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9f43513-e438-45ad-ab88-618bee10e392]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:11:34 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d4840a85-7de7-4015-8983-d212cbb9b86d tempest-GroupSnapshotsTest-379341379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-941ae6ef-fb47-477b-b800-9f8fdd4ee826 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:11:34 devstack sudo[88637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-941ae6ef-fb47-477b-b800-9f8fdd4ee826 Aug 29 01:11:34 devstack sudo[88637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:11:35 devstack sudo[88637]: pam_unix(sudo:session): session closed for user root Aug 29 01:11:35 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d4840a85-7de7-4015-8983-d212cbb9b86d tempest-GroupSnapshotsTest-379341379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-941ae6ef-fb47-477b-b800-9f8fdd4ee826" returned: 0 in 0.922s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:11:35 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d4840a85-7de7-4015-8983-d212cbb9b86d tempest-GroupSnapshotsTest-379341379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-941ae6ef-fb47-477b-b800-9f8fdd4ee826.971bdc60-e7e7-4020-acb3-485b671b03b1 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:11:35 devstack sudo[88643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-941ae6ef-fb47-477b-b800-9f8fdd4ee826.971bdc60-e7e7-4020-acb3-485b671b03b1 Aug 29 01:11:35 devstack sudo[88643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:11:36 devstack sudo[88643]: pam_unix(sudo:session): session closed for user root Aug 29 01:11:36 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d4840a85-7de7-4015-8983-d212cbb9b86d tempest-GroupSnapshotsTest-379341379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-941ae6ef-fb47-477b-b800-9f8fdd4ee826.971bdc60-e7e7-4020-acb3-485b671b03b1" returned: 0 in 0.775s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:11:36 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d4840a85-7de7-4015-8983-d212cbb9b86d tempest-GroupSnapshotsTest-379341379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-941ae6ef-fb47-477b-b800-9f8fdd4ee826.971bdc60-e7e7-4020-acb3-485b671b03b1 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:11:36 devstack sudo[88653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-941ae6ef-fb47-477b-b800-9f8fdd4ee826.971bdc60-e7e7-4020-acb3-485b671b03b1 Aug 29 01:11:36 devstack sudo[88653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:11:36 devstack sudo[88653]: pam_unix(sudo:session): session closed for user root Aug 29 01:11:36 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d4840a85-7de7-4015-8983-d212cbb9b86d tempest-GroupSnapshotsTest-379341379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-941ae6ef-fb47-477b-b800-9f8fdd4ee826.971bdc60-e7e7-4020-acb3-485b671b03b1" returned: 0 in 0.659s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:11:37 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-d4840a85-7de7-4015-8983-d212cbb9b86d tempest-GroupSnapshotsTest-379341379 None] Lock "cinder-quobyte-971bdc60-e7e7-4020-acb3-485b671b03b1" released by "_delete_snapshot" :: held 3.645s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:11:37 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-d4840a85-7de7-4015-8983-d212cbb9b86d tempest-GroupSnapshotsTest-379341379 None] Lock "cinder-quobyte-941ae6ef-fb47-477b-b800-9f8fdd4ee826" released by "delete_snapshot" :: held 3.813s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:11:37 devstack cinder-volume[86111]: WARNING cinder.quota [None req-d4840a85-7de7-4015-8983-d212cbb9b86d tempest-GroupSnapshotsTest-379341379 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1180020302 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1180020302, it is now deprecated. Please use the default quota class for default quota. Aug 29 01:11:37 devstack cinder-volume[86111]: WARNING cinder.quota [None req-d4840a85-7de7-4015-8983-d212cbb9b86d tempest-GroupSnapshotsTest-379341379 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1180020302 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1180020302, it is now deprecated. Please use the default quota class for default quota. Aug 29 01:11:37 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-d4840a85-7de7-4015-8983-d212cbb9b86d tempest-GroupSnapshotsTest-379341379 None] Created reservations ['5da3fa19-3d46-4400-bd40-07c157bfc976', '60907e46-0f41-41ee-ac25-484a57ebd7ae', '0e1eaa78-1caf-4ddb-ae72-5d60fe94aaaf', 'c55cb2cf-9343-4ced-a0d5-06466e5da497'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:11:37 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-d4840a85-7de7-4015-8983-d212cbb9b86d tempest-GroupSnapshotsTest-379341379 None] group_snapshot 5ba61ddd-132a-48f8-ae6b-200d9b392d12: deleted successfully Aug 29 01:11:39 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-dee272b2-515f-4e66-93a8-9c08097694d7 tempest-GroupSnapshotsTest-379341379 None] Acquiring lock "cinder-quobyte-941ae6ef-fb47-477b-b800-9f8fdd4ee826" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:11:39 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-dee272b2-515f-4e66-93a8-9c08097694d7 tempest-GroupSnapshotsTest-379341379 None] Lock "cinder-quobyte-941ae6ef-fb47-477b-b800-9f8fdd4ee826" acquired by "delete_volume" :: waited 0.032s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:11:39 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[d70c34b8-235c-4a7a-8af8-8eac3c88c412]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:11:39 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-dee272b2-515f-4e66-93a8-9c08097694d7 tempest-GroupSnapshotsTest-379341379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-941ae6ef-fb47-477b-b800-9f8fdd4ee826 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:11:39 devstack sudo[88770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-941ae6ef-fb47-477b-b800-9f8fdd4ee826 Aug 29 01:11:39 devstack sudo[88770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:11:40 devstack sudo[88770]: pam_unix(sudo:session): session closed for user root Aug 29 01:11:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-dee272b2-515f-4e66-93a8-9c08097694d7 tempest-GroupSnapshotsTest-379341379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-941ae6ef-fb47-477b-b800-9f8fdd4ee826" returned: 0 in 0.897s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:11:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-dee272b2-515f-4e66-93a8-9c08097694d7 tempest-GroupSnapshotsTest-379341379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-941ae6ef-fb47-477b-b800-9f8fdd4ee826 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:11:40 devstack sudo[88809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-941ae6ef-fb47-477b-b800-9f8fdd4ee826 Aug 29 01:11:40 devstack sudo[88809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:11:40 devstack cinder-volume[86111]: DEBUG oslo_service.periodic_task [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86111) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 29 01:11:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:11:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:11:40 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:11:40 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:11:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:11:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:11:40 devstack sudo[88816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:11:40 devstack sudo[88816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:11:40 devstack sudo[88809]: pam_unix(sudo:session): session closed for user root Aug 29 01:11:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-dee272b2-515f-4e66-93a8-9c08097694d7 tempest-GroupSnapshotsTest-379341379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-941ae6ef-fb47-477b-b800-9f8fdd4ee826" returned: 0 in 0.489s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:11:41 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-dee272b2-515f-4e66-93a8-9c08097694d7 tempest-GroupSnapshotsTest-379341379 None] Lock "cinder-quobyte-941ae6ef-fb47-477b-b800-9f8fdd4ee826" released by "delete_volume" :: held 1.622s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:11:41 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-dee272b2-515f-4e66-93a8-9c08097694d7 tempest-GroupSnapshotsTest-379341379 None] Created reservations ['87a39dc6-fd87-4b45-9763-4c0700b58174'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:11:41 devstack cinder-volume[86111]: WARNING cinder.quota [None req-dee272b2-515f-4e66-93a8-9c08097694d7 tempest-GroupSnapshotsTest-379341379 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1180020302 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1180020302, it is now deprecated. Please use the default quota class for default quota. Aug 29 01:11:41 devstack sudo[88816]: pam_unix(sudo:session): session closed for user root Aug 29 01:11:41 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-de752545-d617-440e-8362-d04fae0901a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.766s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:11:41 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:11:41 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-dee272b2-515f-4e66-93a8-9c08097694d7 tempest-GroupSnapshotsTest-379341379 None] Created reservations ['3e1fef49-d380-4a8e-b415-0ef140c923f6', '9d6cc19b-bc44-4032-9942-a3da01d710c0', '14b17efc-8a84-4a56-a87f-8ed1127d1673', '9f74ae1a-8685-46e7-9260-860493ffdfd4'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:11:41 devstack cinder-volume[86111]: DEBUG oslo_service.periodic_task [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Running periodic task VolumeManager._thread_info {{(pid=86111) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 29 01:11:41 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-de752545-d617-440e-8362-d04fae0901a5 None None] thread count: 8 {{(pid=86111) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 29 01:11:41 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-de752545-d617-440e-8362-d04fae0901a5 None None] thread info: [<_MainThread(MainThread, started 129173440548992)>, , , , , , , ] {{(pid=86111) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 29 01:11:41 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-dee272b2-515f-4e66-93a8-9c08097694d7 tempest-GroupSnapshotsTest-379341379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:11:41 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-dee272b2-515f-4e66-93a8-9c08097694d7 tempest-GroupSnapshotsTest-379341379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:11:41 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-dee272b2-515f-4e66-93a8-9c08097694d7 tempest-GroupSnapshotsTest-379341379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:11:41 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-dee272b2-515f-4e66-93a8-9c08097694d7 tempest-GroupSnapshotsTest-379341379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:11:41 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-dee272b2-515f-4e66-93a8-9c08097694d7 tempest-GroupSnapshotsTest-379341379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:11:41 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-dee272b2-515f-4e66-93a8-9c08097694d7 tempest-GroupSnapshotsTest-379341379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:11:41 devstack sudo[88833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:11:41 devstack sudo[88833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:11:42 devstack sudo[88833]: pam_unix(sudo:session): session closed for user root Aug 29 01:11:42 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-dee272b2-515f-4e66-93a8-9c08097694d7 tempest-GroupSnapshotsTest-379341379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.332s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:11:42 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-dee272b2-515f-4e66-93a8-9c08097694d7 tempest-GroupSnapshotsTest-379341379 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:11:42 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-dee272b2-515f-4e66-93a8-9c08097694d7 tempest-GroupSnapshotsTest-379341379 None] Delete group completed successfully. Aug 29 01:11:48 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-8770fbd6-2229-4032-aef1-632306f46ba3 tempest-ServerRescueNegativeTestJSON-570759507 None] Acquiring lock "cinder-9c833ebd-5f59-4d53-bc44-4c196f047d7a-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:11:48 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-8770fbd6-2229-4032-aef1-632306f46ba3 tempest-ServerRescueNegativeTestJSON-570759507 None] Lock "cinder-9c833ebd-5f59-4d53-bc44-4c196f047d7a-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:11:48 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-8770fbd6-2229-4032-aef1-632306f46ba3 tempest-ServerRescueNegativeTestJSON-570759507 None] Acquiring lock "cinder-quobyte-9c833ebd-5f59-4d53-bc44-4c196f047d7a" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:11:48 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-8770fbd6-2229-4032-aef1-632306f46ba3 tempest-ServerRescueNegativeTestJSON-570759507 None] Lock "cinder-quobyte-9c833ebd-5f59-4d53-bc44-4c196f047d7a" acquired by "delete_volume" :: waited 0.025s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:11:48 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[2693b2a7-8606-49de-9162-49f9b71df948]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:11:48 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8770fbd6-2229-4032-aef1-632306f46ba3 tempest-ServerRescueNegativeTestJSON-570759507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-9c833ebd-5f59-4d53-bc44-4c196f047d7a {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:11:48 devstack sudo[88887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-9c833ebd-5f59-4d53-bc44-4c196f047d7a Aug 29 01:11:48 devstack sudo[88887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:11:49 devstack sudo[88887]: pam_unix(sudo:session): session closed for user root Aug 29 01:11:49 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8770fbd6-2229-4032-aef1-632306f46ba3 tempest-ServerRescueNegativeTestJSON-570759507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-9c833ebd-5f59-4d53-bc44-4c196f047d7a" returned: 0 in 0.777s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:11:49 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8770fbd6-2229-4032-aef1-632306f46ba3 tempest-ServerRescueNegativeTestJSON-570759507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-9c833ebd-5f59-4d53-bc44-4c196f047d7a {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:11:49 devstack sudo[88892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-9c833ebd-5f59-4d53-bc44-4c196f047d7a Aug 29 01:11:49 devstack sudo[88892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:11:50 devstack sudo[88892]: pam_unix(sudo:session): session closed for user root Aug 29 01:11:50 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8770fbd6-2229-4032-aef1-632306f46ba3 tempest-ServerRescueNegativeTestJSON-570759507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-9c833ebd-5f59-4d53-bc44-4c196f047d7a" returned: 0 in 0.638s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:11:50 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-8770fbd6-2229-4032-aef1-632306f46ba3 tempest-ServerRescueNegativeTestJSON-570759507 None] Lock "cinder-quobyte-9c833ebd-5f59-4d53-bc44-4c196f047d7a" released by "delete_volume" :: held 1.537s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:11:50 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-8770fbd6-2229-4032-aef1-632306f46ba3 tempest-ServerRescueNegativeTestJSON-570759507 None] Created reservations ['f51fcc1f-9644-4815-abb6-5a190da80143', '91e05917-e61f-48d3-a69d-844a2bc5c53a', '501833ca-a2d4-4166-8911-53c39c39f46d', '1387f799-ae3f-4123-892e-0658cedd1717'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:11:50 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-8770fbd6-2229-4032-aef1-632306f46ba3 tempest-ServerRescueNegativeTestJSON-570759507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:11:50 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-8770fbd6-2229-4032-aef1-632306f46ba3 tempest-ServerRescueNegativeTestJSON-570759507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:11:50 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-8770fbd6-2229-4032-aef1-632306f46ba3 tempest-ServerRescueNegativeTestJSON-570759507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:11:50 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-8770fbd6-2229-4032-aef1-632306f46ba3 tempest-ServerRescueNegativeTestJSON-570759507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:11:50 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-8770fbd6-2229-4032-aef1-632306f46ba3 tempest-ServerRescueNegativeTestJSON-570759507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:11:50 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8770fbd6-2229-4032-aef1-632306f46ba3 tempest-ServerRescueNegativeTestJSON-570759507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:11:50 devstack sudo[88895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:11:50 devstack sudo[88895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:11:51 devstack sudo[88895]: pam_unix(sudo:session): session closed for user root Aug 29 01:11:51 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8770fbd6-2229-4032-aef1-632306f46ba3 tempest-ServerRescueNegativeTestJSON-570759507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.558s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:11:51 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-8770fbd6-2229-4032-aef1-632306f46ba3 tempest-ServerRescueNegativeTestJSON-570759507 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:11:51 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-8770fbd6-2229-4032-aef1-632306f46ba3 tempest-ServerRescueNegativeTestJSON-570759507 None] Deleted volume successfully. Aug 29 01:11:51 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-8770fbd6-2229-4032-aef1-632306f46ba3 tempest-ServerRescueNegativeTestJSON-570759507 None] Lock "cinder-9c833ebd-5f59-4d53-bc44-4c196f047d7a-delete_volume" released by "delete_volume" :: held 2.589s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:11:56 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-db629fc7-7e90-486e-a8ab-1d604862b9d8 tempest-GroupsV320Test-115566200 None] Group tempest-GroupsV320Test-Group-176084662: creating Aug 29 01:11:56 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-db629fc7-7e90-486e-a8ab-1d604862b9d8 tempest-GroupsV320Test-115566200 None] Group tempest-GroupsV320Test-Group-176084662: created successfully Aug 29 01:11:56 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-db629fc7-7e90-486e-a8ab-1d604862b9d8 tempest-GroupsV320Test-115566200 None] Create group completed successfully. Aug 29 01:11:56 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [req-0eee2b21-0174-4270-b494-45cd9075a3d3 req-62e65773-c3b9-42ff-b4e7-98a55813019f tempest-TaggedAttachmentsTest-47599495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:11:56 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [req-0eee2b21-0174-4270-b494-45cd9075a3d3 req-62e65773-c3b9-42ff-b4e7-98a55813019f tempest-TaggedAttachmentsTest-47599495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:11:56 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [req-0eee2b21-0174-4270-b494-45cd9075a3d3 req-62e65773-c3b9-42ff-b4e7-98a55813019f tempest-TaggedAttachmentsTest-47599495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:11:56 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [req-0eee2b21-0174-4270-b494-45cd9075a3d3 req-62e65773-c3b9-42ff-b4e7-98a55813019f tempest-TaggedAttachmentsTest-47599495 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630', 'name': 'volume-49e5c531-4af8-4f61-8da2-80ee290c5445', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a744452c-5af6-48aa-8098-b6271dcad940', 'enforce_multipath': True} {{(pid=86111) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 29 01:11:56 devstack cinder-volume[86111]: INFO cinder.volume.manager [req-0eee2b21-0174-4270-b494-45cd9075a3d3 req-62e65773-c3b9-42ff-b4e7-98a55813019f tempest-TaggedAttachmentsTest-47599495 None] attachment_update completed successfully. Aug 29 01:11:58 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-8a19492f-ad7f-4987-9b8d-42a8d7f93081 tempest-GroupsV320Test-115566200 None] Created reservations ['3dfcc3a2-d92d-44b1-a051-87916e2b4fcf'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:11:58 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-8a19492f-ad7f-4987-9b8d-42a8d7f93081 tempest-GroupsV320Test-115566200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:11:58 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-8a19492f-ad7f-4987-9b8d-42a8d7f93081 tempest-GroupsV320Test-115566200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:11:58 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-8a19492f-ad7f-4987-9b8d-42a8d7f93081 tempest-GroupsV320Test-115566200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:11:58 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-8a19492f-ad7f-4987-9b8d-42a8d7f93081 tempest-GroupsV320Test-115566200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:11:58 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-8a19492f-ad7f-4987-9b8d-42a8d7f93081 tempest-GroupsV320Test-115566200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:11:58 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8a19492f-ad7f-4987-9b8d-42a8d7f93081 tempest-GroupsV320Test-115566200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:11:58 devstack sudo[89430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:11:58 devstack sudo[89430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:11:58 devstack sudo[89430]: pam_unix(sudo:session): session closed for user root Aug 29 01:11:58 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8a19492f-ad7f-4987-9b8d-42a8d7f93081 tempest-GroupsV320Test-115566200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.319s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:11:58 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-8a19492f-ad7f-4987-9b8d-42a8d7f93081 tempest-GroupsV320Test-115566200 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:11:58 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-8a19492f-ad7f-4987-9b8d-42a8d7f93081 tempest-GroupsV320Test-115566200 None] Delete group completed successfully. Aug 29 01:12:00 devstack cinder-volume[86111]: INFO cinder.volume.manager [req-8fd910a2-a744-4d77-bb15-386ca5fd5599 req-0efb5504-0d15-4c13-8165-778699a271a5 tempest-TaggedAttachmentsTest-47599495 None] Terminate volume connection completed successfully. Aug 29 01:12:00 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [req-8fd910a2-a744-4d77-bb15-386ca5fd5599 req-0efb5504-0d15-4c13-8165-778699a271a5 tempest-TaggedAttachmentsTest-47599495 None] Deleting attachment a744452c-5af6-48aa-8098-b6271dcad940. {{(pid=86111) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 29 01:12:09 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [req-3cb0e740-0774-42ec-9171-e18a48a80598 req-e392f292-854c-4822-a1f7-a0e1a4bbc845 tempest-ServerActionsTestOtherA-1708480225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:12:09 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [req-3cb0e740-0774-42ec-9171-e18a48a80598 req-e392f292-854c-4822-a1f7-a0e1a4bbc845 tempest-ServerActionsTestOtherA-1708480225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:12:09 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [req-3cb0e740-0774-42ec-9171-e18a48a80598 req-e392f292-854c-4822-a1f7-a0e1a4bbc845 tempest-ServerActionsTestOtherA-1708480225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:12:09 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [req-3cb0e740-0774-42ec-9171-e18a48a80598 req-e392f292-854c-4822-a1f7-a0e1a4bbc845 tempest-ServerActionsTestOtherA-1708480225 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630', 'name': 'volume-9af8977b-2315-4371-8d6a-87bcad5bc11f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7a37470f-1cc9-4e45-9539-83c533f2a0cc', 'enforce_multipath': True} {{(pid=86111) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 29 01:12:09 devstack cinder-volume[86111]: INFO cinder.volume.manager [req-3cb0e740-0774-42ec-9171-e18a48a80598 req-e392f292-854c-4822-a1f7-a0e1a4bbc845 tempest-ServerActionsTestOtherA-1708480225 None] attachment_update completed successfully. Aug 29 01:12:14 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-c6464877-19ab-46d1-a518-de5506f3db69 tempest-TaggedAttachmentsTest-47599495 None] Acquiring lock "cinder-49e5c531-4af8-4f61-8da2-80ee290c5445-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:12:14 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-c6464877-19ab-46d1-a518-de5506f3db69 tempest-TaggedAttachmentsTest-47599495 None] Lock "cinder-49e5c531-4af8-4f61-8da2-80ee290c5445-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:12:14 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-c6464877-19ab-46d1-a518-de5506f3db69 tempest-TaggedAttachmentsTest-47599495 None] Acquiring lock "cinder-quobyte-49e5c531-4af8-4f61-8da2-80ee290c5445" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:12:14 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-c6464877-19ab-46d1-a518-de5506f3db69 tempest-TaggedAttachmentsTest-47599495 None] Lock "cinder-quobyte-49e5c531-4af8-4f61-8da2-80ee290c5445" acquired by "delete_volume" :: waited 0.024s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:12:14 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2b57b2b-088d-4788-a015-4df766c26e7e]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:12:14 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c6464877-19ab-46d1-a518-de5506f3db69 tempest-TaggedAttachmentsTest-47599495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-49e5c531-4af8-4f61-8da2-80ee290c5445 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:12:14 devstack sudo[89932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-49e5c531-4af8-4f61-8da2-80ee290c5445 Aug 29 01:12:14 devstack sudo[89932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:12:15 devstack cinder-volume[86111]: DEBUG dbcounter [-] [86111] Writing DB stats cinder:SELECT=66,cinder:UPDATE=63,cinder:INSERT=11,cinder:DELETE=1 {{(pid=86111) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 29 01:12:15 devstack cinder-volume[86111]: INFO cinder.volume.manager [req-e329e54f-6592-42cc-8b25-d88db54b41d3 req-6a1e6a89-ba5e-437d-b3bb-510007cf8799 tempest-ServerActionsTestOtherA-1708480225 None] Terminate volume connection completed successfully. Aug 29 01:12:15 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [req-e329e54f-6592-42cc-8b25-d88db54b41d3 req-6a1e6a89-ba5e-437d-b3bb-510007cf8799 tempest-ServerActionsTestOtherA-1708480225 None] Deleting attachment 7a37470f-1cc9-4e45-9539-83c533f2a0cc. {{(pid=86111) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 29 01:12:15 devstack sudo[89932]: pam_unix(sudo:session): session closed for user root Aug 29 01:12:15 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c6464877-19ab-46d1-a518-de5506f3db69 tempest-TaggedAttachmentsTest-47599495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-49e5c531-4af8-4f61-8da2-80ee290c5445" returned: 0 in 0.515s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:12:15 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c6464877-19ab-46d1-a518-de5506f3db69 tempest-TaggedAttachmentsTest-47599495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-49e5c531-4af8-4f61-8da2-80ee290c5445 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:12:15 devstack sudo[89965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-49e5c531-4af8-4f61-8da2-80ee290c5445 Aug 29 01:12:15 devstack sudo[89965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:12:15 devstack sudo[89965]: pam_unix(sudo:session): session closed for user root Aug 29 01:12:15 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c6464877-19ab-46d1-a518-de5506f3db69 tempest-TaggedAttachmentsTest-47599495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-49e5c531-4af8-4f61-8da2-80ee290c5445" returned: 0 in 0.473s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:12:15 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-c6464877-19ab-46d1-a518-de5506f3db69 tempest-TaggedAttachmentsTest-47599495 None] Lock "cinder-quobyte-49e5c531-4af8-4f61-8da2-80ee290c5445" released by "delete_volume" :: held 1.089s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:12:15 devstack cinder-volume[86111]: DEBUG dbcounter [-] [86111] Writing DB stats cinder:UPDATE=62,cinder:SELECT=71,cinder:INSERT=16,cinder:DELETE=3 {{(pid=86111) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 29 01:12:15 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-c6464877-19ab-46d1-a518-de5506f3db69 tempest-TaggedAttachmentsTest-47599495 None] Created reservations ['660869aa-9525-4e35-b44a-3ab800952e00', 'acc5748e-a34b-42d1-b464-12ee7737e913', '6aa6037a-0d61-4bf4-81fb-4a0b39b99023', '08b1c6f2-123b-4b94-8d81-acee44426edb'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:12:15 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-c6464877-19ab-46d1-a518-de5506f3db69 tempest-TaggedAttachmentsTest-47599495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:12:15 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-c6464877-19ab-46d1-a518-de5506f3db69 tempest-TaggedAttachmentsTest-47599495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:12:15 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-c6464877-19ab-46d1-a518-de5506f3db69 tempest-TaggedAttachmentsTest-47599495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:12:15 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-c6464877-19ab-46d1-a518-de5506f3db69 tempest-TaggedAttachmentsTest-47599495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:12:15 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-c6464877-19ab-46d1-a518-de5506f3db69 tempest-TaggedAttachmentsTest-47599495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:12:15 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c6464877-19ab-46d1-a518-de5506f3db69 tempest-TaggedAttachmentsTest-47599495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:12:15 devstack sudo[89995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:12:15 devstack sudo[89995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:12:16 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [req-e329e54f-6592-42cc-8b25-d88db54b41d3 req-88397e8c-41fa-4aee-85af-b8263ac41089 tempest-ServerActionsTestOtherA-1708480225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:12:16 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [req-e329e54f-6592-42cc-8b25-d88db54b41d3 req-88397e8c-41fa-4aee-85af-b8263ac41089 tempest-ServerActionsTestOtherA-1708480225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:12:16 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [req-e329e54f-6592-42cc-8b25-d88db54b41d3 req-88397e8c-41fa-4aee-85af-b8263ac41089 tempest-ServerActionsTestOtherA-1708480225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:12:16 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [req-e329e54f-6592-42cc-8b25-d88db54b41d3 req-88397e8c-41fa-4aee-85af-b8263ac41089 tempest-ServerActionsTestOtherA-1708480225 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630', 'name': 'volume-9af8977b-2315-4371-8d6a-87bcad5bc11f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd388aa5f-28f6-452e-94bf-7a45dc019219', 'enforce_multipath': True} {{(pid=86111) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 29 01:12:16 devstack cinder-volume[86111]: INFO cinder.volume.manager [req-e329e54f-6592-42cc-8b25-d88db54b41d3 req-88397e8c-41fa-4aee-85af-b8263ac41089 tempest-ServerActionsTestOtherA-1708480225 None] attachment_update completed successfully. Aug 29 01:12:16 devstack sudo[89995]: pam_unix(sudo:session): session closed for user root Aug 29 01:12:16 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c6464877-19ab-46d1-a518-de5506f3db69 tempest-TaggedAttachmentsTest-47599495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.432s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:12:16 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-c6464877-19ab-46d1-a518-de5506f3db69 tempest-TaggedAttachmentsTest-47599495 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:12:16 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-c6464877-19ab-46d1-a518-de5506f3db69 tempest-TaggedAttachmentsTest-47599495 None] Deleted volume successfully. Aug 29 01:12:16 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-c6464877-19ab-46d1-a518-de5506f3db69 tempest-TaggedAttachmentsTest-47599495 None] Lock "cinder-49e5c531-4af8-4f61-8da2-80ee290c5445-delete_volume" released by "delete_volume" :: held 1.952s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:12:26 devstack cinder-volume[86111]: DEBUG dbcounter [-] [86111] Writing DB stats cinder:SELECT=10,cinder:INSERT=3,cinder:UPDATE=10 {{(pid=86111) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 29 01:12:26 devstack cinder-volume[86111]: DEBUG dbcounter [-] [86111] Writing DB stats cinder:INSERT=1,cinder:UPDATE=8,cinder:SELECT=10,cinder:DELETE=1 {{(pid=86111) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 29 01:12:40 devstack cinder-volume[86111]: DEBUG oslo_service.periodic_task [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86111) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 29 01:12:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:12:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:12:40 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:12:40 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:12:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:12:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:12:40 devstack sudo[90662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:12:40 devstack sudo[90662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:12:41 devstack sudo[90662]: pam_unix(sudo:session): session closed for user root Aug 29 01:12:41 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-de752545-d617-440e-8362-d04fae0901a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.383s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:12:41 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:12:43 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-ebd25edd-d8b1-4cff-8d36-539320e03e49 tempest-VolumeQuotasAdminTestJSON-343078673 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:12:43 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-ebd25edd-d8b1-4cff-8d36-539320e03e49 tempest-VolumeQuotasAdminTestJSON-343078673 None] Flow 'volume_create_manager' (0743f921-9a8e-4c8b-9cf3-fe9c65f7af42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:12:43 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-ebd25edd-d8b1-4cff-8d36-539320e03e49 tempest-VolumeQuotasAdminTestJSON-343078673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (147467e9-6639-4be1-a8c3-8efa78ef1941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:12:43 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-ebd25edd-d8b1-4cff-8d36-539320e03e49 tempest-VolumeQuotasAdminTestJSON-343078673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (147467e9-6639-4be1-a8c3-8efa78ef1941) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:12:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1192574425',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16ee04c8-2c61-4a56-bf7f-e4ede97e69ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c135caf353c4571ab7856a56131caa8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:12:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:12:43Z,use_quota=True,user_id='3bb27e3115d94d9dac52c10d5c225ed8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:12:43 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-ebd25edd-d8b1-4cff-8d36-539320e03e49 tempest-VolumeQuotasAdminTestJSON-343078673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d91eca9-841f-4b80-866c-d831db33da1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:12:43 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-ebd25edd-d8b1-4cff-8d36-539320e03e49 tempest-VolumeQuotasAdminTestJSON-343078673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d91eca9-841f-4b80-866c-d831db33da1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:12:43 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-ebd25edd-d8b1-4cff-8d36-539320e03e49 tempest-VolumeQuotasAdminTestJSON-343078673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da9c2f23-18c4-46a2-b3c8-b3333db3a696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:12:43 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-ebd25edd-d8b1-4cff-8d36-539320e03e49 tempest-VolumeQuotasAdminTestJSON-343078673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da9c2f23-18c4-46a2-b3c8-b3333db3a696) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16ee04c8-2c61-4a56-bf7f-e4ede97e69ac', 'volume_name': 'volume-16ee04c8-2c61-4a56-bf7f-e4ede97e69ac', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:12:43 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-ebd25edd-d8b1-4cff-8d36-539320e03e49 tempest-VolumeQuotasAdminTestJSON-343078673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce345087-f81e-44ae-ad60-93faa71d6de2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:12:43 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-ebd25edd-d8b1-4cff-8d36-539320e03e49 tempest-VolumeQuotasAdminTestJSON-343078673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce345087-f81e-44ae-ad60-93faa71d6de2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:12:43 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-ebd25edd-d8b1-4cff-8d36-539320e03e49 tempest-VolumeQuotasAdminTestJSON-343078673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43a958a6-523b-4c0f-ab60-9a3ca5d27ca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:12:43 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-ebd25edd-d8b1-4cff-8d36-539320e03e49 tempest-VolumeQuotasAdminTestJSON-343078673 None] Volume 16ee04c8-2c61-4a56-bf7f-e4ede97e69ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16ee04c8-2c61-4a56-bf7f-e4ede97e69ac', 'volume_size': 1} Aug 29 01:12:43 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-ebd25edd-d8b1-4cff-8d36-539320e03e49 tempest-VolumeQuotasAdminTestJSON-343078673 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:12:43 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-ebd25edd-d8b1-4cff-8d36-539320e03e49 tempest-VolumeQuotasAdminTestJSON-343078673 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:12:43 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-ebd25edd-d8b1-4cff-8d36-539320e03e49 tempest-VolumeQuotasAdminTestJSON-343078673 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:12:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1192574425',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16ee04c8-2c61-4a56-bf7f-e4ede97e69ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c135caf353c4571ab7856a56131caa8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:12:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:12:43Z,use_quota=True,user_id='3bb27e3115d94d9dac52c10d5c225ed8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:12:43 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-ebd25edd-d8b1-4cff-8d36-539320e03e49 tempest-VolumeQuotasAdminTestJSON-343078673 None] Creating volume 16ee04c8-2c61-4a56-bf7f-e4ede97e69ac {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:12:43 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-ebd25edd-d8b1-4cff-8d36-539320e03e49 tempest-VolumeQuotasAdminTestJSON-343078673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:12:43 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-ebd25edd-d8b1-4cff-8d36-539320e03e49 tempest-VolumeQuotasAdminTestJSON-343078673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:12:43 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-ebd25edd-d8b1-4cff-8d36-539320e03e49 tempest-VolumeQuotasAdminTestJSON-343078673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:12:43 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-ebd25edd-d8b1-4cff-8d36-539320e03e49 tempest-VolumeQuotasAdminTestJSON-343078673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:12:43 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-ebd25edd-d8b1-4cff-8d36-539320e03e49 tempest-VolumeQuotasAdminTestJSON-343078673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:12:43 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-ebd25edd-d8b1-4cff-8d36-539320e03e49 tempest-VolumeQuotasAdminTestJSON-343078673 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:12:43 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-ebd25edd-d8b1-4cff-8d36-539320e03e49 tempest-VolumeQuotasAdminTestJSON-343078673 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:12:43 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-ebd25edd-d8b1-4cff-8d36-539320e03e49 tempest-VolumeQuotasAdminTestJSON-343078673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-16ee04c8-2c61-4a56-bf7f-e4ede97e69ac 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:12:43 devstack sudo[90682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-16ee04c8-2c61-4a56-bf7f-e4ede97e69ac 1073741824 Aug 29 01:12:43 devstack sudo[90682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:12:44 devstack sudo[90682]: pam_unix(sudo:session): session closed for user root Aug 29 01:12:44 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-ebd25edd-d8b1-4cff-8d36-539320e03e49 tempest-VolumeQuotasAdminTestJSON-343078673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-16ee04c8-2c61-4a56-bf7f-e4ede97e69ac 1073741824" returned: 0 in 0.786s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:12:44 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-ebd25edd-d8b1-4cff-8d36-539320e03e49 tempest-VolumeQuotasAdminTestJSON-343078673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-16ee04c8-2c61-4a56-bf7f-e4ede97e69ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:12:44 devstack sudo[90692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-16ee04c8-2c61-4a56-bf7f-e4ede97e69ac Aug 29 01:12:44 devstack sudo[90692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:12:44 devstack sudo[90692]: pam_unix(sudo:session): session closed for user root Aug 29 01:12:44 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-ebd25edd-d8b1-4cff-8d36-539320e03e49 tempest-VolumeQuotasAdminTestJSON-343078673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-16ee04c8-2c61-4a56-bf7f-e4ede97e69ac" returned: 0 in 0.442s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:12:44 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-ebd25edd-d8b1-4cff-8d36-539320e03e49 tempest-VolumeQuotasAdminTestJSON-343078673 None] <== create_volume: return (1285ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:12:44 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-ebd25edd-d8b1-4cff-8d36-539320e03e49 tempest-VolumeQuotasAdminTestJSON-343078673 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.289s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:12:44 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-ebd25edd-d8b1-4cff-8d36-539320e03e49 tempest-VolumeQuotasAdminTestJSON-343078673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43a958a6-523b-4c0f-ab60-9a3ca5d27ca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16ee04c8-2c61-4a56-bf7f-e4ede97e69ac', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:12:44 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-ebd25edd-d8b1-4cff-8d36-539320e03e49 tempest-VolumeQuotasAdminTestJSON-343078673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77fdb70e-04bb-481c-85f3-650ea2baa0ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:12:44 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-ebd25edd-d8b1-4cff-8d36-539320e03e49 tempest-VolumeQuotasAdminTestJSON-343078673 None] Volume volume-16ee04c8-2c61-4a56-bf7f-e4ede97e69ac (16ee04c8-2c61-4a56-bf7f-e4ede97e69ac): created successfully Aug 29 01:12:44 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-ebd25edd-d8b1-4cff-8d36-539320e03e49 tempest-VolumeQuotasAdminTestJSON-343078673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77fdb70e-04bb-481c-85f3-650ea2baa0ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:12:44 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-ebd25edd-d8b1-4cff-8d36-539320e03e49 tempest-VolumeQuotasAdminTestJSON-343078673 None] Flow 'volume_create_manager' (0743f921-9a8e-4c8b-9cf3-fe9c65f7af42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:12:44 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-ebd25edd-d8b1-4cff-8d36-539320e03e49 tempest-VolumeQuotasAdminTestJSON-343078673 None] Created volume successfully. Aug 29 01:12:45 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-10e15159-ca84-4926-a177-279a47e03eee tempest-VolumeQuotasAdminTestJSON-343078673 None] Acquiring lock "cinder-16ee04c8-2c61-4a56-bf7f-e4ede97e69ac-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:12:45 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-10e15159-ca84-4926-a177-279a47e03eee tempest-VolumeQuotasAdminTestJSON-343078673 None] Lock "cinder-16ee04c8-2c61-4a56-bf7f-e4ede97e69ac-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:12:46 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-10e15159-ca84-4926-a177-279a47e03eee tempest-VolumeQuotasAdminTestJSON-343078673 None] Acquiring lock "cinder-quobyte-16ee04c8-2c61-4a56-bf7f-e4ede97e69ac" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:12:46 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-10e15159-ca84-4926-a177-279a47e03eee tempest-VolumeQuotasAdminTestJSON-343078673 None] Lock "cinder-quobyte-16ee04c8-2c61-4a56-bf7f-e4ede97e69ac" acquired by "delete_volume" :: waited 0.041s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:12:46 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[41b30bfa-d2ee-4ef6-960a-95d9e5ebd8f0]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:12:46 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-10e15159-ca84-4926-a177-279a47e03eee tempest-VolumeQuotasAdminTestJSON-343078673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-16ee04c8-2c61-4a56-bf7f-e4ede97e69ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:12:46 devstack sudo[90711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-16ee04c8-2c61-4a56-bf7f-e4ede97e69ac Aug 29 01:12:46 devstack sudo[90711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:12:46 devstack cinder-volume[86111]: INFO cinder.volume.manager [req-16688274-f13b-4018-9bfe-3c8c9a2e2c7e req-07469979-b886-4c69-a48b-ab209579c5dc tempest-ServerActionsTestOtherA-1708480225 None] Terminate volume connection completed successfully. Aug 29 01:12:46 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [req-16688274-f13b-4018-9bfe-3c8c9a2e2c7e req-07469979-b886-4c69-a48b-ab209579c5dc tempest-ServerActionsTestOtherA-1708480225 None] Deleting attachment d388aa5f-28f6-452e-94bf-7a45dc019219. {{(pid=86111) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 29 01:12:47 devstack sudo[90711]: pam_unix(sudo:session): session closed for user root Aug 29 01:12:47 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-10e15159-ca84-4926-a177-279a47e03eee tempest-VolumeQuotasAdminTestJSON-343078673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-16ee04c8-2c61-4a56-bf7f-e4ede97e69ac" returned: 0 in 1.218s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:12:47 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-10e15159-ca84-4926-a177-279a47e03eee tempest-VolumeQuotasAdminTestJSON-343078673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-16ee04c8-2c61-4a56-bf7f-e4ede97e69ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:12:47 devstack sudo[90743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-16ee04c8-2c61-4a56-bf7f-e4ede97e69ac Aug 29 01:12:47 devstack sudo[90743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:12:47 devstack sudo[90743]: pam_unix(sudo:session): session closed for user root Aug 29 01:12:47 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-10e15159-ca84-4926-a177-279a47e03eee tempest-VolumeQuotasAdminTestJSON-343078673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-16ee04c8-2c61-4a56-bf7f-e4ede97e69ac" returned: 0 in 0.521s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:12:47 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-10e15159-ca84-4926-a177-279a47e03eee tempest-VolumeQuotasAdminTestJSON-343078673 None] Lock "cinder-quobyte-16ee04c8-2c61-4a56-bf7f-e4ede97e69ac" released by "delete_volume" :: held 1.824s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:12:47 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-10e15159-ca84-4926-a177-279a47e03eee tempest-VolumeQuotasAdminTestJSON-343078673 None] Created reservations ['51402014-3787-449c-8306-8b3d46e0da61', '399ffe22-256b-4740-bcf1-26923e2c9220', '0963050f-902d-4933-bb20-48e375b896c4', 'e735aa59-daef-4c8a-b859-23ef410929db'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:12:48 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-10e15159-ca84-4926-a177-279a47e03eee tempest-VolumeQuotasAdminTestJSON-343078673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:12:48 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-10e15159-ca84-4926-a177-279a47e03eee tempest-VolumeQuotasAdminTestJSON-343078673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:12:48 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-10e15159-ca84-4926-a177-279a47e03eee tempest-VolumeQuotasAdminTestJSON-343078673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:12:48 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-10e15159-ca84-4926-a177-279a47e03eee tempest-VolumeQuotasAdminTestJSON-343078673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:12:48 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-10e15159-ca84-4926-a177-279a47e03eee tempest-VolumeQuotasAdminTestJSON-343078673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:12:48 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-10e15159-ca84-4926-a177-279a47e03eee tempest-VolumeQuotasAdminTestJSON-343078673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:12:48 devstack sudo[90749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:12:48 devstack sudo[90749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:12:48 devstack sudo[90749]: pam_unix(sudo:session): session closed for user root Aug 29 01:12:48 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-10e15159-ca84-4926-a177-279a47e03eee tempest-VolumeQuotasAdminTestJSON-343078673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.812s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:12:48 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-10e15159-ca84-4926-a177-279a47e03eee tempest-VolumeQuotasAdminTestJSON-343078673 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:12:48 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-10e15159-ca84-4926-a177-279a47e03eee tempest-VolumeQuotasAdminTestJSON-343078673 None] Deleted volume successfully. Aug 29 01:12:49 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-10e15159-ca84-4926-a177-279a47e03eee tempest-VolumeQuotasAdminTestJSON-343078673 None] Lock "cinder-16ee04c8-2c61-4a56-bf7f-e4ede97e69ac-delete_volume" released by "delete_volume" :: held 3.175s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:12:49 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-0abf107a-fd91-49c7-88f4-a48f029c5cf1 tempest-VolumeQuotasAdminTestJSON-343078673 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:12:50 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-0abf107a-fd91-49c7-88f4-a48f029c5cf1 tempest-VolumeQuotasAdminTestJSON-343078673 None] Flow 'volume_create_manager' (0a07177e-9d58-46cb-a21d-ee9fe620ac37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:12:50 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-0abf107a-fd91-49c7-88f4-a48f029c5cf1 tempest-VolumeQuotasAdminTestJSON-343078673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e961494-c2e7-4262-a599-b4cd2fd8df02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:12:50 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-0abf107a-fd91-49c7-88f4-a48f029c5cf1 tempest-VolumeQuotasAdminTestJSON-343078673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e961494-c2e7-4262-a599-b4cd2fd8df02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:12:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1039721132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13393889-b26c-4472-afbd-2329b26e10f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c135caf353c4571ab7856a56131caa8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:12:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:12:50Z,use_quota=True,user_id='3bb27e3115d94d9dac52c10d5c225ed8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:12:50 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-0abf107a-fd91-49c7-88f4-a48f029c5cf1 tempest-VolumeQuotasAdminTestJSON-343078673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0f2eb2e-31d1-428c-aa40-06cdf0fd6e6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:12:50 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-0abf107a-fd91-49c7-88f4-a48f029c5cf1 tempest-VolumeQuotasAdminTestJSON-343078673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0f2eb2e-31d1-428c-aa40-06cdf0fd6e6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:12:50 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-0abf107a-fd91-49c7-88f4-a48f029c5cf1 tempest-VolumeQuotasAdminTestJSON-343078673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8feb040a-1aee-4740-a4bd-26c957edc403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:12:50 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-0abf107a-fd91-49c7-88f4-a48f029c5cf1 tempest-VolumeQuotasAdminTestJSON-343078673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8feb040a-1aee-4740-a4bd-26c957edc403) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13393889-b26c-4472-afbd-2329b26e10f7', 'volume_name': 'volume-13393889-b26c-4472-afbd-2329b26e10f7', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:12:50 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-0abf107a-fd91-49c7-88f4-a48f029c5cf1 tempest-VolumeQuotasAdminTestJSON-343078673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d8a880c-8939-4c67-a368-aa0b48f2b4ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:12:50 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-0abf107a-fd91-49c7-88f4-a48f029c5cf1 tempest-VolumeQuotasAdminTestJSON-343078673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d8a880c-8939-4c67-a368-aa0b48f2b4ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:12:50 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-0abf107a-fd91-49c7-88f4-a48f029c5cf1 tempest-VolumeQuotasAdminTestJSON-343078673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b3905ca-dd76-49e4-abb1-1516a27d0797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:12:50 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-0abf107a-fd91-49c7-88f4-a48f029c5cf1 tempest-VolumeQuotasAdminTestJSON-343078673 None] Volume 13393889-b26c-4472-afbd-2329b26e10f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13393889-b26c-4472-afbd-2329b26e10f7', 'volume_size': 1} Aug 29 01:12:50 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-0abf107a-fd91-49c7-88f4-a48f029c5cf1 tempest-VolumeQuotasAdminTestJSON-343078673 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:12:50 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-0abf107a-fd91-49c7-88f4-a48f029c5cf1 tempest-VolumeQuotasAdminTestJSON-343078673 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:12:50 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-0abf107a-fd91-49c7-88f4-a48f029c5cf1 tempest-VolumeQuotasAdminTestJSON-343078673 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:12:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1039721132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13393889-b26c-4472-afbd-2329b26e10f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c135caf353c4571ab7856a56131caa8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:12:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:12:50Z,use_quota=True,user_id='3bb27e3115d94d9dac52c10d5c225ed8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:12:50 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-0abf107a-fd91-49c7-88f4-a48f029c5cf1 tempest-VolumeQuotasAdminTestJSON-343078673 None] Creating volume 13393889-b26c-4472-afbd-2329b26e10f7 {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:12:50 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-0abf107a-fd91-49c7-88f4-a48f029c5cf1 tempest-VolumeQuotasAdminTestJSON-343078673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:12:50 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-0abf107a-fd91-49c7-88f4-a48f029c5cf1 tempest-VolumeQuotasAdminTestJSON-343078673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:12:50 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-0abf107a-fd91-49c7-88f4-a48f029c5cf1 tempest-VolumeQuotasAdminTestJSON-343078673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:12:50 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-0abf107a-fd91-49c7-88f4-a48f029c5cf1 tempest-VolumeQuotasAdminTestJSON-343078673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:12:50 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-0abf107a-fd91-49c7-88f4-a48f029c5cf1 tempest-VolumeQuotasAdminTestJSON-343078673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:12:50 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-0abf107a-fd91-49c7-88f4-a48f029c5cf1 tempest-VolumeQuotasAdminTestJSON-343078673 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:12:50 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-0abf107a-fd91-49c7-88f4-a48f029c5cf1 tempest-VolumeQuotasAdminTestJSON-343078673 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:12:50 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-0abf107a-fd91-49c7-88f4-a48f029c5cf1 tempest-VolumeQuotasAdminTestJSON-343078673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-13393889-b26c-4472-afbd-2329b26e10f7 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:12:50 devstack sudo[90798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-13393889-b26c-4472-afbd-2329b26e10f7 1073741824 Aug 29 01:12:50 devstack sudo[90798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:12:50 devstack sudo[90798]: pam_unix(sudo:session): session closed for user root Aug 29 01:12:50 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-0abf107a-fd91-49c7-88f4-a48f029c5cf1 tempest-VolumeQuotasAdminTestJSON-343078673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-13393889-b26c-4472-afbd-2329b26e10f7 1073741824" returned: 0 in 0.728s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:12:50 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-0abf107a-fd91-49c7-88f4-a48f029c5cf1 tempest-VolumeQuotasAdminTestJSON-343078673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-13393889-b26c-4472-afbd-2329b26e10f7 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:12:50 devstack sudo[90805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-13393889-b26c-4472-afbd-2329b26e10f7 Aug 29 01:12:50 devstack sudo[90805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:12:51 devstack sudo[90805]: pam_unix(sudo:session): session closed for user root Aug 29 01:12:51 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-0abf107a-fd91-49c7-88f4-a48f029c5cf1 tempest-VolumeQuotasAdminTestJSON-343078673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-13393889-b26c-4472-afbd-2329b26e10f7" returned: 0 in 0.330s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:12:51 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-0abf107a-fd91-49c7-88f4-a48f029c5cf1 tempest-VolumeQuotasAdminTestJSON-343078673 None] <== create_volume: return (1128ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:12:51 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-0abf107a-fd91-49c7-88f4-a48f029c5cf1 tempest-VolumeQuotasAdminTestJSON-343078673 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.136s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:12:51 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-0abf107a-fd91-49c7-88f4-a48f029c5cf1 tempest-VolumeQuotasAdminTestJSON-343078673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b3905ca-dd76-49e4-abb1-1516a27d0797) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13393889-b26c-4472-afbd-2329b26e10f7', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:12:51 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-0abf107a-fd91-49c7-88f4-a48f029c5cf1 tempest-VolumeQuotasAdminTestJSON-343078673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ef2c7f4-5d73-4c2a-9d9f-47137e271b39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:12:51 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-0abf107a-fd91-49c7-88f4-a48f029c5cf1 tempest-VolumeQuotasAdminTestJSON-343078673 None] Volume volume-13393889-b26c-4472-afbd-2329b26e10f7 (13393889-b26c-4472-afbd-2329b26e10f7): created successfully Aug 29 01:12:51 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-0abf107a-fd91-49c7-88f4-a48f029c5cf1 tempest-VolumeQuotasAdminTestJSON-343078673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ef2c7f4-5d73-4c2a-9d9f-47137e271b39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:12:51 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-0abf107a-fd91-49c7-88f4-a48f029c5cf1 tempest-VolumeQuotasAdminTestJSON-343078673 None] Flow 'volume_create_manager' (0a07177e-9d58-46cb-a21d-ee9fe620ac37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:12:51 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-0abf107a-fd91-49c7-88f4-a48f029c5cf1 tempest-VolumeQuotasAdminTestJSON-343078673 None] Created volume successfully. Aug 29 01:12:53 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-aa661d4b-14d7-4724-97a7-8860dcf20fb9 tempest-VolumeQuotasAdminTestJSON-1223873430 None] Transfer volume completed successfully. Aug 29 01:12:54 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-c873d0d9-da4b-4725-94dc-2cdc212f494c tempest-VolumeQuotasAdminTestJSON-1957718619 None] Acquiring lock "cinder-13393889-b26c-4472-afbd-2329b26e10f7-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:12:54 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-c873d0d9-da4b-4725-94dc-2cdc212f494c tempest-VolumeQuotasAdminTestJSON-1957718619 None] Lock "cinder-13393889-b26c-4472-afbd-2329b26e10f7-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:12:54 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-c873d0d9-da4b-4725-94dc-2cdc212f494c tempest-VolumeQuotasAdminTestJSON-1957718619 None] Acquiring lock "cinder-quobyte-13393889-b26c-4472-afbd-2329b26e10f7" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:12:54 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-c873d0d9-da4b-4725-94dc-2cdc212f494c tempest-VolumeQuotasAdminTestJSON-1957718619 None] Lock "cinder-quobyte-13393889-b26c-4472-afbd-2329b26e10f7" acquired by "delete_volume" :: waited 0.024s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:12:54 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4f4594e-3e9e-4cf0-a48e-d17ddabdff31]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:12:54 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c873d0d9-da4b-4725-94dc-2cdc212f494c tempest-VolumeQuotasAdminTestJSON-1957718619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-13393889-b26c-4472-afbd-2329b26e10f7 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:12:54 devstack sudo[90839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-13393889-b26c-4472-afbd-2329b26e10f7 Aug 29 01:12:54 devstack sudo[90839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:12:54 devstack sudo[90839]: pam_unix(sudo:session): session closed for user root Aug 29 01:12:54 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c873d0d9-da4b-4725-94dc-2cdc212f494c tempest-VolumeQuotasAdminTestJSON-1957718619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-13393889-b26c-4472-afbd-2329b26e10f7" returned: 0 in 0.614s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:12:54 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c873d0d9-da4b-4725-94dc-2cdc212f494c tempest-VolumeQuotasAdminTestJSON-1957718619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-13393889-b26c-4472-afbd-2329b26e10f7 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:12:54 devstack sudo[90846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-13393889-b26c-4472-afbd-2329b26e10f7 Aug 29 01:12:54 devstack sudo[90846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:12:55 devstack sudo[90846]: pam_unix(sudo:session): session closed for user root Aug 29 01:12:55 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c873d0d9-da4b-4725-94dc-2cdc212f494c tempest-VolumeQuotasAdminTestJSON-1957718619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-13393889-b26c-4472-afbd-2329b26e10f7" returned: 0 in 0.290s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:12:55 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-c873d0d9-da4b-4725-94dc-2cdc212f494c tempest-VolumeQuotasAdminTestJSON-1957718619 None] Lock "cinder-quobyte-13393889-b26c-4472-afbd-2329b26e10f7" released by "delete_volume" :: held 0.957s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:12:55 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-c873d0d9-da4b-4725-94dc-2cdc212f494c tempest-VolumeQuotasAdminTestJSON-1957718619 None] Created reservations ['e3e0894e-4589-49af-90aa-80382b516227', 'e1bd5eb8-3eeb-4eeb-a226-9583e3a0ec3c', 'e6160ce0-67ba-4c20-88d3-8c7bddb9e054', 'c2a6b420-fc21-4105-97ba-2be8fe99796a'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:12:55 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-c873d0d9-da4b-4725-94dc-2cdc212f494c tempest-VolumeQuotasAdminTestJSON-1957718619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:12:55 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-c873d0d9-da4b-4725-94dc-2cdc212f494c tempest-VolumeQuotasAdminTestJSON-1957718619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:12:55 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-c873d0d9-da4b-4725-94dc-2cdc212f494c tempest-VolumeQuotasAdminTestJSON-1957718619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:12:55 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-c873d0d9-da4b-4725-94dc-2cdc212f494c tempest-VolumeQuotasAdminTestJSON-1957718619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:12:55 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-c873d0d9-da4b-4725-94dc-2cdc212f494c tempest-VolumeQuotasAdminTestJSON-1957718619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:12:55 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c873d0d9-da4b-4725-94dc-2cdc212f494c tempest-VolumeQuotasAdminTestJSON-1957718619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:12:55 devstack sudo[90849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:12:55 devstack sudo[90849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:12:55 devstack sudo[90849]: pam_unix(sudo:session): session closed for user root Aug 29 01:12:55 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c873d0d9-da4b-4725-94dc-2cdc212f494c tempest-VolumeQuotasAdminTestJSON-1957718619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.419s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:12:55 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-c873d0d9-da4b-4725-94dc-2cdc212f494c tempest-VolumeQuotasAdminTestJSON-1957718619 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:12:55 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-c873d0d9-da4b-4725-94dc-2cdc212f494c tempest-VolumeQuotasAdminTestJSON-1957718619 None] Deleted volume successfully. Aug 29 01:12:55 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-c873d0d9-da4b-4725-94dc-2cdc212f494c tempest-VolumeQuotasAdminTestJSON-1957718619 None] Lock "cinder-13393889-b26c-4472-afbd-2329b26e10f7-delete_volume" released by "delete_volume" :: held 1.648s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:12:57 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f1414f4-9a71-4b82-95c9-6c7a7c692236 tempest-ServerActionsTestOtherA-1708480225 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:12:57 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-9f1414f4-9a71-4b82-95c9-6c7a7c692236 tempest-ServerActionsTestOtherA-1708480225 None] Flow 'volume_create_manager' (89e8765d-3bf2-4b43-be4c-049d4c3d6de2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:12:57 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-9f1414f4-9a71-4b82-95c9-6c7a7c692236 tempest-ServerActionsTestOtherA-1708480225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bddada5-4507-4076-8539-dbe44db605da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:12:57 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-9f1414f4-9a71-4b82-95c9-6c7a7c692236 tempest-ServerActionsTestOtherA-1708480225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bddada5-4507-4076-8539-dbe44db605da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:12:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-544444349',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e86a809-e98d-46fc-a23a-1530583abff1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5c62dca20b44d5eb68bd411b8d7a2d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:12:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:12:58Z,use_quota=True,user_id='a2b7d8b4c5c2425a8a08eb9ce1f14da6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:12:57 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-9f1414f4-9a71-4b82-95c9-6c7a7c692236 tempest-ServerActionsTestOtherA-1708480225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f698bcbb-a0a9-4d9f-9be6-150bfa825094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:12:57 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-9f1414f4-9a71-4b82-95c9-6c7a7c692236 tempest-ServerActionsTestOtherA-1708480225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f698bcbb-a0a9-4d9f-9be6-150bfa825094) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:12:57 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-9f1414f4-9a71-4b82-95c9-6c7a7c692236 tempest-ServerActionsTestOtherA-1708480225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2a28663-0822-434e-8ed2-46df4df05d1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:12:57 devstack cinder-volume[86111]: DEBUG cinder.image.glance [None req-9f1414f4-9a71-4b82-95c9-6c7a7c692236 tempest-ServerActionsTestOtherA-1708480225 None] Creating Keystone auth plugin from conf {{(pid=86111) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 29 01:12:58 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-746a1704-12b3-439d-a13f-833be1f8a0bb tempest-ServersNegativeTestJSON-1150230952 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:12:58 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-746a1704-12b3-439d-a13f-833be1f8a0bb tempest-ServersNegativeTestJSON-1150230952 None] Flow 'volume_create_manager' (4b6f231f-51f6-4aeb-8215-cf02e21f6781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:12:58 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-746a1704-12b3-439d-a13f-833be1f8a0bb tempest-ServersNegativeTestJSON-1150230952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (593b811b-fddc-4ad2-9d87-563709a78e91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:12:58 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-746a1704-12b3-439d-a13f-833be1f8a0bb tempest-ServersNegativeTestJSON-1150230952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (593b811b-fddc-4ad2-9d87-563709a78e91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:12:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2031133719',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0704ac4f-bf64-452d-9dfb-4a7814018167,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7fb15110cc64739a1599e48657f7f6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:12:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:12:58Z,use_quota=True,user_id='8cfcdebea16a4b869aaacae4a996f22a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:12:58 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-746a1704-12b3-439d-a13f-833be1f8a0bb tempest-ServersNegativeTestJSON-1150230952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40e1d8a2-d3b3-40f6-ae03-06b4d6f0a16a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:12:58 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-746a1704-12b3-439d-a13f-833be1f8a0bb tempest-ServersNegativeTestJSON-1150230952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40e1d8a2-d3b3-40f6-ae03-06b4d6f0a16a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:12:58 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-746a1704-12b3-439d-a13f-833be1f8a0bb tempest-ServersNegativeTestJSON-1150230952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5bd0f95-69a4-415d-a6ff-ea1a822c18e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:12:58 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-746a1704-12b3-439d-a13f-833be1f8a0bb tempest-ServersNegativeTestJSON-1150230952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5bd0f95-69a4-415d-a6ff-ea1a822c18e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0704ac4f-bf64-452d-9dfb-4a7814018167', 'volume_name': 'volume-0704ac4f-bf64-452d-9dfb-4a7814018167', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:12:58 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-746a1704-12b3-439d-a13f-833be1f8a0bb tempest-ServersNegativeTestJSON-1150230952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81ee6adc-4440-4a4a-9afb-7ce96316c77a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:12:58 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-746a1704-12b3-439d-a13f-833be1f8a0bb tempest-ServersNegativeTestJSON-1150230952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81ee6adc-4440-4a4a-9afb-7ce96316c77a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:12:58 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-746a1704-12b3-439d-a13f-833be1f8a0bb tempest-ServersNegativeTestJSON-1150230952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e19c89cf-6388-46f2-8333-d9ae483db122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:12:58 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-746a1704-12b3-439d-a13f-833be1f8a0bb tempest-ServersNegativeTestJSON-1150230952 None] Volume 0704ac4f-bf64-452d-9dfb-4a7814018167: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0704ac4f-bf64-452d-9dfb-4a7814018167', 'volume_size': 1} Aug 29 01:12:58 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-746a1704-12b3-439d-a13f-833be1f8a0bb tempest-ServersNegativeTestJSON-1150230952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:12:58 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-746a1704-12b3-439d-a13f-833be1f8a0bb tempest-ServersNegativeTestJSON-1150230952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:12:58 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-746a1704-12b3-439d-a13f-833be1f8a0bb tempest-ServersNegativeTestJSON-1150230952 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:12:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2031133719',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0704ac4f-bf64-452d-9dfb-4a7814018167,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7fb15110cc64739a1599e48657f7f6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:12:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:12:58Z,use_quota=True,user_id='8cfcdebea16a4b869aaacae4a996f22a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:12:58 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-746a1704-12b3-439d-a13f-833be1f8a0bb tempest-ServersNegativeTestJSON-1150230952 None] Creating volume 0704ac4f-bf64-452d-9dfb-4a7814018167 {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:12:58 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-746a1704-12b3-439d-a13f-833be1f8a0bb tempest-ServersNegativeTestJSON-1150230952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:12:58 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-746a1704-12b3-439d-a13f-833be1f8a0bb tempest-ServersNegativeTestJSON-1150230952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:12:58 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-746a1704-12b3-439d-a13f-833be1f8a0bb tempest-ServersNegativeTestJSON-1150230952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:12:58 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-746a1704-12b3-439d-a13f-833be1f8a0bb tempest-ServersNegativeTestJSON-1150230952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:12:58 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-746a1704-12b3-439d-a13f-833be1f8a0bb tempest-ServersNegativeTestJSON-1150230952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:12:58 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-746a1704-12b3-439d-a13f-833be1f8a0bb tempest-ServersNegativeTestJSON-1150230952 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:12:58 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-746a1704-12b3-439d-a13f-833be1f8a0bb tempest-ServersNegativeTestJSON-1150230952 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:12:58 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-746a1704-12b3-439d-a13f-833be1f8a0bb tempest-ServersNegativeTestJSON-1150230952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-0704ac4f-bf64-452d-9dfb-4a7814018167 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:12:58 devstack sudo[90855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-0704ac4f-bf64-452d-9dfb-4a7814018167 1073741824 Aug 29 01:12:58 devstack sudo[90855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:12:59 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-9f1414f4-9a71-4b82-95c9-6c7a7c692236 tempest-ServerActionsTestOtherA-1708480225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2a28663-0822-434e-8ed2-46df4df05d1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0e86a809-e98d-46fc-a23a-1530583abff1', 'volume_name': 'volume-0e86a809-e98d-46fc-a23a-1530583abff1', 'volume_size': 1, 'image_id': 'f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8d940113004947258ae710723d273006', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab', 'created_at': datetime.datetime(2026, 8, 28, 23, 3, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 23, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:12:59 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-9f1414f4-9a71-4b82-95c9-6c7a7c692236 tempest-ServerActionsTestOtherA-1708480225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d93acde-fb66-40bd-ac48-9b23ae60f189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:12:59 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-9f1414f4-9a71-4b82-95c9-6c7a7c692236 tempest-ServerActionsTestOtherA-1708480225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d93acde-fb66-40bd-ac48-9b23ae60f189) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:12:59 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-9f1414f4-9a71-4b82-95c9-6c7a7c692236 tempest-ServerActionsTestOtherA-1708480225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48412663-1fc7-4b71-8b0c-39d7a9cb067b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:12:59 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-9f1414f4-9a71-4b82-95c9-6c7a7c692236 tempest-ServerActionsTestOtherA-1708480225 None] Volume 0e86a809-e98d-46fc-a23a-1530583abff1: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0e86a809-e98d-46fc-a23a-1530583abff1', 'volume_size': 1, 'image_id': 'f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8d940113004947258ae710723d273006', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab', 'created_at': datetime.datetime(2026, 8, 28, 23, 3, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 23, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 29 01:12:59 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f1414f4-9a71-4b82-95c9-6c7a7c692236 tempest-ServerActionsTestOtherA-1708480225 None] Trying to clone 0e86a809-e98d-46fc-a23a-1530583abff1 from image f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab at location (None, [{'url': 'file:///opt/stack/data/glance/images/f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab', 'metadata': {}}]). {{(pid=86111) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 29 01:12:59 devstack sudo[90855]: pam_unix(sudo:session): session closed for user root Aug 29 01:12:59 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-746a1704-12b3-439d-a13f-833be1f8a0bb tempest-ServersNegativeTestJSON-1150230952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-0704ac4f-bf64-452d-9dfb-4a7814018167 1073741824" returned: 0 in 0.689s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:12:59 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-746a1704-12b3-439d-a13f-833be1f8a0bb tempest-ServersNegativeTestJSON-1150230952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-0704ac4f-bf64-452d-9dfb-4a7814018167 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:12:59 devstack sudo[90861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-0704ac4f-bf64-452d-9dfb-4a7814018167 Aug 29 01:12:59 devstack sudo[90861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:12:59 devstack sudo[90861]: pam_unix(sudo:session): session closed for user root Aug 29 01:12:59 devstack cinder-volume[86111]: DEBUG cinder.image.image_utils [None req-9f1414f4-9a71-4b82-95c9-6c7a7c692236 tempest-ServerActionsTestOtherA-1708480225 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab_9vbw_fvddevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86111) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 29 01:12:59 devstack cinder-volume[86111]: INFO cinder.image.image_utils [None req-9f1414f4-9a71-4b82-95c9-6c7a7c692236 tempest-ServerActionsTestOtherA-1708480225 None] Image download 20.69 MB at 20.69 MB/s Aug 29 01:12:59 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-746a1704-12b3-439d-a13f-833be1f8a0bb tempest-ServersNegativeTestJSON-1150230952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-0704ac4f-bf64-452d-9dfb-4a7814018167" returned: 0 in 0.434s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:12:59 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-746a1704-12b3-439d-a13f-833be1f8a0bb tempest-ServersNegativeTestJSON-1150230952 None] <== create_volume: return (1196ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:12:59 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-746a1704-12b3-439d-a13f-833be1f8a0bb tempest-ServersNegativeTestJSON-1150230952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.199s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:12:59 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-746a1704-12b3-439d-a13f-833be1f8a0bb tempest-ServersNegativeTestJSON-1150230952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e19c89cf-6388-46f2-8333-d9ae483db122) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0704ac4f-bf64-452d-9dfb-4a7814018167', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:12:59 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-746a1704-12b3-439d-a13f-833be1f8a0bb tempest-ServersNegativeTestJSON-1150230952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bac49132-f6a4-4b39-98e7-ee45e4ebf7ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:12:59 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[983cde51-714d-42dd-9f1f-071ba8bddb49]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:12:59 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-9f1414f4-9a71-4b82-95c9-6c7a7c692236 tempest-ServerActionsTestOtherA-1708480225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab_9vbw_fvddevstack@QuobyteHD {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:12:59 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-746a1704-12b3-439d-a13f-833be1f8a0bb tempest-ServersNegativeTestJSON-1150230952 None] Volume volume-0704ac4f-bf64-452d-9dfb-4a7814018167 (0704ac4f-bf64-452d-9dfb-4a7814018167): created successfully Aug 29 01:12:59 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-746a1704-12b3-439d-a13f-833be1f8a0bb tempest-ServersNegativeTestJSON-1150230952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bac49132-f6a4-4b39-98e7-ee45e4ebf7ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:12:59 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-746a1704-12b3-439d-a13f-833be1f8a0bb tempest-ServersNegativeTestJSON-1150230952 None] Flow 'volume_create_manager' (4b6f231f-51f6-4aeb-8215-cf02e21f6781) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:12:59 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-746a1704-12b3-439d-a13f-833be1f8a0bb tempest-ServersNegativeTestJSON-1150230952 None] Created volume successfully. Aug 29 01:12:59 devstack sudo[90885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab_9vbw_fvddevstack@QuobyteHD Aug 29 01:12:59 devstack sudo[90885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:13:00 devstack sudo[90885]: pam_unix(sudo:session): session closed for user root Aug 29 01:13:00 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-9f1414f4-9a71-4b82-95c9-6c7a7c692236 tempest-ServerActionsTestOtherA-1708480225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab_9vbw_fvddevstack@QuobyteHD" returned: 0 in 0.417s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:13:00 devstack cinder-volume[86111]: DEBUG cinder.image.image_utils [None req-9f1414f4-9a71-4b82-95c9-6c7a7c692236 tempest-ServerActionsTestOtherA-1708480225 None] Temporary image f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab is fetched for user a2b7d8b4c5c2425a8a08eb9ce1f14da6. {{(pid=86111) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 29 01:13:00 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[02c1a172-1b81-4b52-bf65-6a91c96ff465]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:13:00 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-9f1414f4-9a71-4b82-95c9-6c7a7c692236 tempest-ServerActionsTestOtherA-1708480225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab_9vbw_fvddevstack@QuobyteHD {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:13:00 devstack sudo[90891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab_9vbw_fvddevstack@QuobyteHD Aug 29 01:13:00 devstack sudo[90891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:13:00 devstack sudo[90891]: pam_unix(sudo:session): session closed for user root Aug 29 01:13:00 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-9f1414f4-9a71-4b82-95c9-6c7a7c692236 tempest-ServerActionsTestOtherA-1708480225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab_9vbw_fvddevstack@QuobyteHD" returned: 0 in 0.560s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:13:00 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-9f1414f4-9a71-4b82-95c9-6c7a7c692236 tempest-ServerActionsTestOtherA-1708480225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:13:00 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-9f1414f4-9a71-4b82-95c9-6c7a7c692236 tempest-ServerActionsTestOtherA-1708480225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:13:00 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-9f1414f4-9a71-4b82-95c9-6c7a7c692236 tempest-ServerActionsTestOtherA-1708480225 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:12:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-544444349',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e86a809-e98d-46fc-a23a-1530583abff1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5c62dca20b44d5eb68bd411b8d7a2d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:12:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:12:58Z,use_quota=True,user_id='a2b7d8b4c5c2425a8a08eb9ce1f14da6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:13:00 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-9f1414f4-9a71-4b82-95c9-6c7a7c692236 tempest-ServerActionsTestOtherA-1708480225 None] Creating volume 0e86a809-e98d-46fc-a23a-1530583abff1 {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:13:00 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-9f1414f4-9a71-4b82-95c9-6c7a7c692236 tempest-ServerActionsTestOtherA-1708480225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:13:00 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-9f1414f4-9a71-4b82-95c9-6c7a7c692236 tempest-ServerActionsTestOtherA-1708480225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:13:00 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-9f1414f4-9a71-4b82-95c9-6c7a7c692236 tempest-ServerActionsTestOtherA-1708480225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:13:00 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-9f1414f4-9a71-4b82-95c9-6c7a7c692236 tempest-ServerActionsTestOtherA-1708480225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:13:00 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-9f1414f4-9a71-4b82-95c9-6c7a7c692236 tempest-ServerActionsTestOtherA-1708480225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:13:00 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-9f1414f4-9a71-4b82-95c9-6c7a7c692236 tempest-ServerActionsTestOtherA-1708480225 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:13:00 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-9f1414f4-9a71-4b82-95c9-6c7a7c692236 tempest-ServerActionsTestOtherA-1708480225 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:13:00 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-9f1414f4-9a71-4b82-95c9-6c7a7c692236 tempest-ServerActionsTestOtherA-1708480225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-0e86a809-e98d-46fc-a23a-1530583abff1 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:13:00 devstack sudo[90896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-0e86a809-e98d-46fc-a23a-1530583abff1 1073741824 Aug 29 01:13:00 devstack sudo[90896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:13:01 devstack sudo[90896]: pam_unix(sudo:session): session closed for user root Aug 29 01:13:01 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-9f1414f4-9a71-4b82-95c9-6c7a7c692236 tempest-ServerActionsTestOtherA-1708480225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-0e86a809-e98d-46fc-a23a-1530583abff1 1073741824" returned: 0 in 0.654s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:13:01 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-9f1414f4-9a71-4b82-95c9-6c7a7c692236 tempest-ServerActionsTestOtherA-1708480225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-0e86a809-e98d-46fc-a23a-1530583abff1 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:13:01 devstack sudo[90902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-0e86a809-e98d-46fc-a23a-1530583abff1 Aug 29 01:13:01 devstack sudo[90902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:13:02 devstack sudo[90902]: pam_unix(sudo:session): session closed for user root Aug 29 01:13:02 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-9f1414f4-9a71-4b82-95c9-6c7a7c692236 tempest-ServerActionsTestOtherA-1708480225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-0e86a809-e98d-46fc-a23a-1530583abff1" returned: 0 in 0.362s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:13:02 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-9f1414f4-9a71-4b82-95c9-6c7a7c692236 tempest-ServerActionsTestOtherA-1708480225 None] <== create_volume: return (1113ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:13:02 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-9f1414f4-9a71-4b82-95c9-6c7a7c692236 tempest-ServerActionsTestOtherA-1708480225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.117s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:13:02 devstack cinder-volume[86111]: DEBUG cinder.volume.volume_utils [None req-9f1414f4-9a71-4b82-95c9-6c7a7c692236 tempest-ServerActionsTestOtherA-1708480225 None] Attempting download of f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab ((None, [{'url': 'file:///opt/stack/data/glance/images/f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab', 'metadata': {}}])) to volume 0e86a809-e98d-46fc-a23a-1530583abff1. {{(pid=86111) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 29 01:13:02 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea98f711-f103-492d-9c32-bd342b5e9cf4]: (4, 'raw') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:13:02 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-9f1414f4-9a71-4b82-95c9-6c7a7c692236 tempest-ServerActionsTestOtherA-1708480225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab_c21gjxt3 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:13:02 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-19842c0b-c12b-481c-9468-674c6c5315f8 tempest-ServersNegativeTestJSON-1150230952 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:13:02 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-19842c0b-c12b-481c-9468-674c6c5315f8 tempest-ServersNegativeTestJSON-1150230952 None] Flow 'volume_create_manager' (dc3c7d89-b158-42df-943d-088f7754ee92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:13:02 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-19842c0b-c12b-481c-9468-674c6c5315f8 tempest-ServersNegativeTestJSON-1150230952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0de9648-2b6e-4df0-ae1f-39316a173805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:13:02 devstack sudo[90905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab_c21gjxt3 Aug 29 01:13:02 devstack sudo[90905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:13:02 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-19842c0b-c12b-481c-9468-674c6c5315f8 tempest-ServersNegativeTestJSON-1150230952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0de9648-2b6e-4df0-ae1f-39316a173805) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:13:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1049903195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a50dfd51-97d1-48df-965e-74956bd12985,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7fb15110cc64739a1599e48657f7f6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:13:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:13:02Z,use_quota=True,user_id='8cfcdebea16a4b869aaacae4a996f22a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:13:02 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-19842c0b-c12b-481c-9468-674c6c5315f8 tempest-ServersNegativeTestJSON-1150230952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37d6a4a3-ca38-4b61-91fe-83662011073c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:13:02 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-19842c0b-c12b-481c-9468-674c6c5315f8 tempest-ServersNegativeTestJSON-1150230952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37d6a4a3-ca38-4b61-91fe-83662011073c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:13:02 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-19842c0b-c12b-481c-9468-674c6c5315f8 tempest-ServersNegativeTestJSON-1150230952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f09f599-de33-4374-8ff2-8e9ced90a69e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:13:02 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-19842c0b-c12b-481c-9468-674c6c5315f8 tempest-ServersNegativeTestJSON-1150230952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f09f599-de33-4374-8ff2-8e9ced90a69e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a50dfd51-97d1-48df-965e-74956bd12985', 'volume_name': 'volume-a50dfd51-97d1-48df-965e-74956bd12985', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:13:02 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-19842c0b-c12b-481c-9468-674c6c5315f8 tempest-ServersNegativeTestJSON-1150230952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db806206-d02a-436f-ba54-91502a1b12b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:13:02 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-19842c0b-c12b-481c-9468-674c6c5315f8 tempest-ServersNegativeTestJSON-1150230952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db806206-d02a-436f-ba54-91502a1b12b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:13:02 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-19842c0b-c12b-481c-9468-674c6c5315f8 tempest-ServersNegativeTestJSON-1150230952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a91a9ee-8800-4c5e-b9d7-5256a275cd67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:13:02 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-19842c0b-c12b-481c-9468-674c6c5315f8 tempest-ServersNegativeTestJSON-1150230952 None] Volume a50dfd51-97d1-48df-965e-74956bd12985: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a50dfd51-97d1-48df-965e-74956bd12985', 'volume_size': 1} Aug 29 01:13:02 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-19842c0b-c12b-481c-9468-674c6c5315f8 tempest-ServersNegativeTestJSON-1150230952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:13:02 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-19842c0b-c12b-481c-9468-674c6c5315f8 tempest-ServersNegativeTestJSON-1150230952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:13:02 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-19842c0b-c12b-481c-9468-674c6c5315f8 tempest-ServersNegativeTestJSON-1150230952 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:13:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1049903195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a50dfd51-97d1-48df-965e-74956bd12985,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7fb15110cc64739a1599e48657f7f6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:13:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:13:02Z,use_quota=True,user_id='8cfcdebea16a4b869aaacae4a996f22a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:13:02 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-19842c0b-c12b-481c-9468-674c6c5315f8 tempest-ServersNegativeTestJSON-1150230952 None] Creating volume a50dfd51-97d1-48df-965e-74956bd12985 {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:13:02 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-19842c0b-c12b-481c-9468-674c6c5315f8 tempest-ServersNegativeTestJSON-1150230952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:13:02 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-19842c0b-c12b-481c-9468-674c6c5315f8 tempest-ServersNegativeTestJSON-1150230952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:13:02 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-19842c0b-c12b-481c-9468-674c6c5315f8 tempest-ServersNegativeTestJSON-1150230952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:13:02 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-19842c0b-c12b-481c-9468-674c6c5315f8 tempest-ServersNegativeTestJSON-1150230952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:13:02 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-19842c0b-c12b-481c-9468-674c6c5315f8 tempest-ServersNegativeTestJSON-1150230952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:13:02 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-19842c0b-c12b-481c-9468-674c6c5315f8 tempest-ServersNegativeTestJSON-1150230952 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:13:02 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-19842c0b-c12b-481c-9468-674c6c5315f8 tempest-ServersNegativeTestJSON-1150230952 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:13:02 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-19842c0b-c12b-481c-9468-674c6c5315f8 tempest-ServersNegativeTestJSON-1150230952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a50dfd51-97d1-48df-965e-74956bd12985 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:13:02 devstack sudo[90907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a50dfd51-97d1-48df-965e-74956bd12985 1073741824 Aug 29 01:13:02 devstack sudo[90907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:13:02 devstack sudo[90905]: pam_unix(sudo:session): session closed for user root Aug 29 01:13:02 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-9f1414f4-9a71-4b82-95c9-6c7a7c692236 tempest-ServerActionsTestOtherA-1708480225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab_c21gjxt3" returned: 0 in 0.384s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:13:02 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-9f1414f4-9a71-4b82-95c9-6c7a7c692236 tempest-ServerActionsTestOtherA-1708480225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab_c21gjxt3 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:13:02 devstack sudo[90911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab_c21gjxt3 Aug 29 01:13:02 devstack sudo[90911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:13:02 devstack sudo[90907]: pam_unix(sudo:session): session closed for user root Aug 29 01:13:02 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-19842c0b-c12b-481c-9468-674c6c5315f8 tempest-ServersNegativeTestJSON-1150230952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a50dfd51-97d1-48df-965e-74956bd12985 1073741824" returned: 0 in 0.592s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:13:02 devstack sudo[90911]: pam_unix(sudo:session): session closed for user root Aug 29 01:13:02 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-9f1414f4-9a71-4b82-95c9-6c7a7c692236 tempest-ServerActionsTestOtherA-1708480225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab_c21gjxt3" returned: 1 in 0.439s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:13:02 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-9f1414f4-9a71-4b82-95c9-6c7a7c692236 tempest-ServerActionsTestOtherA-1708480225 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab_c21gjxt3' failed. Not Retrying. {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 29 01:13:02 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[f80b9ae8-ae9a-4299-9994-d743f8e4213a]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:13:02 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-9f1414f4-9a71-4b82-95c9-6c7a7c692236 tempest-ServerActionsTestOtherA-1708480225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab_9vbw_fvddevstack@QuobyteHD {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:13:03 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-19842c0b-c12b-481c-9468-674c6c5315f8 tempest-ServersNegativeTestJSON-1150230952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a50dfd51-97d1-48df-965e-74956bd12985 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:13:03 devstack sudo[90921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a50dfd51-97d1-48df-965e-74956bd12985 Aug 29 01:13:03 devstack sudo[90921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:13:03 devstack sudo[90920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab_9vbw_fvddevstack@QuobyteHD Aug 29 01:13:03 devstack sudo[90920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:13:03 devstack sudo[90921]: pam_unix(sudo:session): session closed for user root Aug 29 01:13:03 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-19842c0b-c12b-481c-9468-674c6c5315f8 tempest-ServersNegativeTestJSON-1150230952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a50dfd51-97d1-48df-965e-74956bd12985" returned: 0 in 0.350s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:13:03 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-19842c0b-c12b-481c-9468-674c6c5315f8 tempest-ServersNegativeTestJSON-1150230952 None] <== create_volume: return (1019ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:13:03 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-19842c0b-c12b-481c-9468-674c6c5315f8 tempest-ServersNegativeTestJSON-1150230952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.027s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:13:03 devstack sudo[90920]: pam_unix(sudo:session): session closed for user root Aug 29 01:13:03 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-9f1414f4-9a71-4b82-95c9-6c7a7c692236 tempest-ServerActionsTestOtherA-1708480225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab_9vbw_fvddevstack@QuobyteHD" returned: 0 in 0.407s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:13:03 devstack cinder-volume[86111]: DEBUG cinder.image.image_utils [None req-9f1414f4-9a71-4b82-95c9-6c7a7c692236 tempest-ServerActionsTestOtherA-1708480225 None] f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab was qcow2, converting to qcow2 {{(pid=86111) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 29 01:13:03 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-9f1414f4-9a71-4b82-95c9-6c7a7c692236 tempest-ServerActionsTestOtherA-1708480225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab_9vbw_fvddevstack@QuobyteHD /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-0e86a809-e98d-46fc-a23a-1530583abff1 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:13:03 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-19842c0b-c12b-481c-9468-674c6c5315f8 tempest-ServersNegativeTestJSON-1150230952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a91a9ee-8800-4c5e-b9d7-5256a275cd67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a50dfd51-97d1-48df-965e-74956bd12985', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:13:03 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-19842c0b-c12b-481c-9468-674c6c5315f8 tempest-ServersNegativeTestJSON-1150230952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7244fa69-1828-48c5-a9f6-d03ffadb75a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:13:03 devstack sudo[90928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab_9vbw_fvddevstack@QuobyteHD /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-0e86a809-e98d-46fc-a23a-1530583abff1 Aug 29 01:13:03 devstack sudo[90928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:13:03 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-19842c0b-c12b-481c-9468-674c6c5315f8 tempest-ServersNegativeTestJSON-1150230952 None] Volume volume-a50dfd51-97d1-48df-965e-74956bd12985 (a50dfd51-97d1-48df-965e-74956bd12985): created successfully Aug 29 01:13:03 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-19842c0b-c12b-481c-9468-674c6c5315f8 tempest-ServersNegativeTestJSON-1150230952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7244fa69-1828-48c5-a9f6-d03ffadb75a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:13:03 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-19842c0b-c12b-481c-9468-674c6c5315f8 tempest-ServersNegativeTestJSON-1150230952 None] Flow 'volume_create_manager' (dc3c7d89-b158-42df-943d-088f7754ee92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:13:03 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-19842c0b-c12b-481c-9468-674c6c5315f8 tempest-ServersNegativeTestJSON-1150230952 None] Created volume successfully. Aug 29 01:13:05 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-0da1ca86-a885-4072-a699-36c8fc708426 tempest-ServersNegativeTestJSON-1150230952 None] Acquiring lock "cinder-a50dfd51-97d1-48df-965e-74956bd12985-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:13:05 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-0da1ca86-a885-4072-a699-36c8fc708426 tempest-ServersNegativeTestJSON-1150230952 None] Lock "cinder-a50dfd51-97d1-48df-965e-74956bd12985-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:13:05 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-0da1ca86-a885-4072-a699-36c8fc708426 tempest-ServersNegativeTestJSON-1150230952 None] Acquiring lock "cinder-quobyte-a50dfd51-97d1-48df-965e-74956bd12985" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:13:05 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-0da1ca86-a885-4072-a699-36c8fc708426 tempest-ServersNegativeTestJSON-1150230952 None] Lock "cinder-quobyte-a50dfd51-97d1-48df-965e-74956bd12985" acquired by "delete_volume" :: waited 0.022s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:13:05 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcf9b3c2-edfb-4013-adf8-1308278c31f8]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:13:05 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-0da1ca86-a885-4072-a699-36c8fc708426 tempest-ServersNegativeTestJSON-1150230952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a50dfd51-97d1-48df-965e-74956bd12985 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:13:05 devstack sudo[90936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a50dfd51-97d1-48df-965e-74956bd12985 Aug 29 01:13:05 devstack sudo[90936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:13:05 devstack sudo[90936]: pam_unix(sudo:session): session closed for user root Aug 29 01:13:05 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-0da1ca86-a885-4072-a699-36c8fc708426 tempest-ServersNegativeTestJSON-1150230952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a50dfd51-97d1-48df-965e-74956bd12985" returned: 0 in 0.410s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:13:05 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-0da1ca86-a885-4072-a699-36c8fc708426 tempest-ServersNegativeTestJSON-1150230952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a50dfd51-97d1-48df-965e-74956bd12985 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:13:05 devstack sudo[90941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a50dfd51-97d1-48df-965e-74956bd12985 Aug 29 01:13:05 devstack sudo[90941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:13:05 devstack sudo[90928]: pam_unix(sudo:session): session closed for user root Aug 29 01:13:05 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-9f1414f4-9a71-4b82-95c9-6c7a7c692236 tempest-ServerActionsTestOtherA-1708480225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab_9vbw_fvddevstack@QuobyteHD /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-0e86a809-e98d-46fc-a23a-1530583abff1" returned: 0 in 2.259s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:13:05 devstack cinder-volume[86111]: DEBUG cinder.image.image_utils [None req-9f1414f4-9a71-4b82-95c9-6c7a7c692236 tempest-ServerActionsTestOtherA-1708480225 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab_9vbw_fvddevstack@QuobyteHD, size 112.00 MB, duration 2.26 sec, destination /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-0e86a809-e98d-46fc-a23a-1530583abff1 {{(pid=86111) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 29 01:13:05 devstack cinder-volume[86111]: INFO cinder.image.image_utils [None req-9f1414f4-9a71-4b82-95c9-6c7a7c692236 tempest-ServerActionsTestOtherA-1708480225 None] Converted 112.00 MB image at 49.55 MB/s Aug 29 01:13:05 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-9f1414f4-9a71-4b82-95c9-6c7a7c692236 tempest-ServerActionsTestOtherA-1708480225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-0e86a809-e98d-46fc-a23a-1530583abff1 1G {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:13:05 devstack sudo[90943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-0e86a809-e98d-46fc-a23a-1530583abff1 1G Aug 29 01:13:05 devstack sudo[90943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:13:05 devstack sudo[90941]: pam_unix(sudo:session): session closed for user root Aug 29 01:13:05 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-0da1ca86-a885-4072-a699-36c8fc708426 tempest-ServersNegativeTestJSON-1150230952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a50dfd51-97d1-48df-965e-74956bd12985" returned: 0 in 0.299s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:13:05 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-0da1ca86-a885-4072-a699-36c8fc708426 tempest-ServersNegativeTestJSON-1150230952 None] Lock "cinder-quobyte-a50dfd51-97d1-48df-965e-74956bd12985" released by "delete_volume" :: held 0.780s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:13:05 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-0da1ca86-a885-4072-a699-36c8fc708426 tempest-ServersNegativeTestJSON-1150230952 None] Created reservations ['46b6e79f-e556-4f56-ad6b-cfc654d57e43', '7f4dd0fb-cdd6-4b05-9f0e-d7d19ee9a59f', '882f7431-2ad7-4f24-856c-a77f065f76e0', '212f80eb-5bf5-41ff-b823-ea1e72465f48'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:13:06 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-0da1ca86-a885-4072-a699-36c8fc708426 tempest-ServersNegativeTestJSON-1150230952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:13:06 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-0da1ca86-a885-4072-a699-36c8fc708426 tempest-ServersNegativeTestJSON-1150230952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:13:06 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-0da1ca86-a885-4072-a699-36c8fc708426 tempest-ServersNegativeTestJSON-1150230952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:13:06 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-0da1ca86-a885-4072-a699-36c8fc708426 tempest-ServersNegativeTestJSON-1150230952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:13:06 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-0da1ca86-a885-4072-a699-36c8fc708426 tempest-ServersNegativeTestJSON-1150230952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:13:06 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-0da1ca86-a885-4072-a699-36c8fc708426 tempest-ServersNegativeTestJSON-1150230952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:13:06 devstack sudo[90943]: pam_unix(sudo:session): session closed for user root Aug 29 01:13:06 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-9f1414f4-9a71-4b82-95c9-6c7a7c692236 tempest-ServerActionsTestOtherA-1708480225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-0e86a809-e98d-46fc-a23a-1530583abff1 1G" returned: 0 in 0.457s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:13:06 devstack cinder-volume[86111]: DEBUG cinder.volume.volume_utils [None req-9f1414f4-9a71-4b82-95c9-6c7a7c692236 tempest-ServerActionsTestOtherA-1708480225 None] Downloaded image f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab ((None, [{'url': 'file:///opt/stack/data/glance/images/f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab', 'metadata': {}}])) to volume 0e86a809-e98d-46fc-a23a-1530583abff1 successfully. {{(pid=86111) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 29 01:13:06 devstack sudo[90951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:13:06 devstack sudo[90951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:13:06 devstack cinder-volume[86111]: DEBUG cinder.image.image_utils [None req-9f1414f4-9a71-4b82-95c9-6c7a7c692236 tempest-ServerActionsTestOtherA-1708480225 None] Temporary image f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab for user a2b7d8b4c5c2425a8a08eb9ce1f14da6 is deleted. {{(pid=86111) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 29 01:13:06 devstack cinder-volume[86111]: DEBUG cinder.volume.volume_utils [None req-9f1414f4-9a71-4b82-95c9-6c7a7c692236 tempest-ServerActionsTestOtherA-1708480225 None] Marking volume 0e86a809-e98d-46fc-a23a-1530583abff1 as bootable. {{(pid=86111) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 29 01:13:06 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f1414f4-9a71-4b82-95c9-6c7a7c692236 tempest-ServerActionsTestOtherA-1708480225 None] Copying metadata from image f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab to 0e86a809-e98d-46fc-a23a-1530583abff1. {{(pid=86111) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 29 01:13:06 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f1414f4-9a71-4b82-95c9-6c7a7c692236 tempest-ServerActionsTestOtherA-1708480225 None] Creating volume glance metadata for volume 0e86a809-e98d-46fc-a23a-1530583abff1 backed by image f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86111) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 29 01:13:06 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-9f75ffc5-74ef-4176-8c21-cdea8142d9a4 tempest-ServersNegativeTestJSON-1150230952 None] Acquiring lock "cinder-0704ac4f-bf64-452d-9dfb-4a7814018167-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:13:06 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-9f75ffc5-74ef-4176-8c21-cdea8142d9a4 tempest-ServersNegativeTestJSON-1150230952 None] Lock "cinder-0704ac4f-bf64-452d-9dfb-4a7814018167-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:13:06 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-9f1414f4-9a71-4b82-95c9-6c7a7c692236 tempest-ServerActionsTestOtherA-1708480225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48412663-1fc7-4b71-8b0c-39d7a9cb067b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e86a809-e98d-46fc-a23a-1530583abff1', 'volume_size': 1, 'image_id': 'f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8d940113004947258ae710723d273006', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab', 'created_at': datetime.datetime(2026, 8, 28, 23, 3, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 23, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:13:06 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-9f1414f4-9a71-4b82-95c9-6c7a7c692236 tempest-ServerActionsTestOtherA-1708480225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1b7bb8f-cab5-467a-a6f4-f13ed61b2b1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:13:06 devstack sudo[90951]: pam_unix(sudo:session): session closed for user root Aug 29 01:13:06 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-0da1ca86-a885-4072-a699-36c8fc708426 tempest-ServersNegativeTestJSON-1150230952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.484s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:13:06 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-0da1ca86-a885-4072-a699-36c8fc708426 tempest-ServersNegativeTestJSON-1150230952 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:13:06 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-9f75ffc5-74ef-4176-8c21-cdea8142d9a4 tempest-ServersNegativeTestJSON-1150230952 None] Acquiring lock "cinder-quobyte-0704ac4f-bf64-452d-9dfb-4a7814018167" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:13:06 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-9f1414f4-9a71-4b82-95c9-6c7a7c692236 tempest-ServerActionsTestOtherA-1708480225 None] Volume volume-0e86a809-e98d-46fc-a23a-1530583abff1 (0e86a809-e98d-46fc-a23a-1530583abff1): created successfully Aug 29 01:13:06 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-9f1414f4-9a71-4b82-95c9-6c7a7c692236 tempest-ServerActionsTestOtherA-1708480225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1b7bb8f-cab5-467a-a6f4-f13ed61b2b1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:13:06 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-9f1414f4-9a71-4b82-95c9-6c7a7c692236 tempest-ServerActionsTestOtherA-1708480225 None] Flow 'volume_create_manager' (89e8765d-3bf2-4b43-be4c-049d4c3d6de2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:13:06 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-0da1ca86-a885-4072-a699-36c8fc708426 tempest-ServersNegativeTestJSON-1150230952 None] Deleted volume successfully. Aug 29 01:13:06 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-9f1414f4-9a71-4b82-95c9-6c7a7c692236 tempest-ServerActionsTestOtherA-1708480225 None] Created volume successfully. Aug 29 01:13:06 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-9f75ffc5-74ef-4176-8c21-cdea8142d9a4 tempest-ServersNegativeTestJSON-1150230952 None] Lock "cinder-quobyte-0704ac4f-bf64-452d-9dfb-4a7814018167" acquired by "delete_volume" :: waited 0.046s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:13:06 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-0da1ca86-a885-4072-a699-36c8fc708426 tempest-ServersNegativeTestJSON-1150230952 None] Lock "cinder-a50dfd51-97d1-48df-965e-74956bd12985-delete_volume" released by "delete_volume" :: held 1.597s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:13:06 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-6918c97a-bfd8-4ae5-9f50-03ebcac7b357 tempest-VolumeQuotasNegativeTestJSON-406552538 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:13:06 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6918c97a-bfd8-4ae5-9f50-03ebcac7b357 tempest-VolumeQuotasNegativeTestJSON-406552538 None] Flow 'volume_create_manager' (8de61390-3917-49ed-adff-97d374352b89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:13:06 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6918c97a-bfd8-4ae5-9f50-03ebcac7b357 tempest-VolumeQuotasNegativeTestJSON-406552538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4f6a37e-0c35-47e9-a454-dfd2e3f1b286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:13:06 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9e2bef0-7fc8-41ff-a42a-9f429adebe4b]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:13:06 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-9f75ffc5-74ef-4176-8c21-cdea8142d9a4 tempest-ServersNegativeTestJSON-1150230952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-0704ac4f-bf64-452d-9dfb-4a7814018167 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:13:06 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6918c97a-bfd8-4ae5-9f50-03ebcac7b357 tempest-VolumeQuotasNegativeTestJSON-406552538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4f6a37e-0c35-47e9-a454-dfd2e3f1b286) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:13:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-107148213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24d1be36-a5fc-486d-b7f2-5a60265add4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7e0adc7a5d14c35a198c7d60eb57626',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:13:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:13:06Z,use_quota=True,user_id='758fe94957114a14a5d9b540a572755e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:13:06 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6918c97a-bfd8-4ae5-9f50-03ebcac7b357 tempest-VolumeQuotasNegativeTestJSON-406552538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05008205-0499-4b27-a38c-b87d5a353166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:13:06 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6918c97a-bfd8-4ae5-9f50-03ebcac7b357 tempest-VolumeQuotasNegativeTestJSON-406552538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05008205-0499-4b27-a38c-b87d5a353166) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:13:06 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6918c97a-bfd8-4ae5-9f50-03ebcac7b357 tempest-VolumeQuotasNegativeTestJSON-406552538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8dcbf5d-af72-4e43-bdf5-c57e4ab219cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:13:06 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6918c97a-bfd8-4ae5-9f50-03ebcac7b357 tempest-VolumeQuotasNegativeTestJSON-406552538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8dcbf5d-af72-4e43-bdf5-c57e4ab219cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24d1be36-a5fc-486d-b7f2-5a60265add4b', 'volume_name': 'volume-24d1be36-a5fc-486d-b7f2-5a60265add4b', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:13:06 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6918c97a-bfd8-4ae5-9f50-03ebcac7b357 tempest-VolumeQuotasNegativeTestJSON-406552538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (586184db-c327-4e6e-959c-3605d2b64afb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:13:06 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6918c97a-bfd8-4ae5-9f50-03ebcac7b357 tempest-VolumeQuotasNegativeTestJSON-406552538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (586184db-c327-4e6e-959c-3605d2b64afb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:13:06 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6918c97a-bfd8-4ae5-9f50-03ebcac7b357 tempest-VolumeQuotasNegativeTestJSON-406552538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32d5145c-05e0-4c62-9b82-e7fe8b9bc143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:13:06 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-6918c97a-bfd8-4ae5-9f50-03ebcac7b357 tempest-VolumeQuotasNegativeTestJSON-406552538 None] Volume 24d1be36-a5fc-486d-b7f2-5a60265add4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24d1be36-a5fc-486d-b7f2-5a60265add4b', 'volume_size': 1} Aug 29 01:13:06 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-6918c97a-bfd8-4ae5-9f50-03ebcac7b357 tempest-VolumeQuotasNegativeTestJSON-406552538 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:13:06 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-6918c97a-bfd8-4ae5-9f50-03ebcac7b357 tempest-VolumeQuotasNegativeTestJSON-406552538 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:13:06 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-6918c97a-bfd8-4ae5-9f50-03ebcac7b357 tempest-VolumeQuotasNegativeTestJSON-406552538 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:13:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-107148213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24d1be36-a5fc-486d-b7f2-5a60265add4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7e0adc7a5d14c35a198c7d60eb57626',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:13:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:13:06Z,use_quota=True,user_id='758fe94957114a14a5d9b540a572755e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:13:06 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-6918c97a-bfd8-4ae5-9f50-03ebcac7b357 tempest-VolumeQuotasNegativeTestJSON-406552538 None] Creating volume 24d1be36-a5fc-486d-b7f2-5a60265add4b {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:13:06 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-6918c97a-bfd8-4ae5-9f50-03ebcac7b357 tempest-VolumeQuotasNegativeTestJSON-406552538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:13:06 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-6918c97a-bfd8-4ae5-9f50-03ebcac7b357 tempest-VolumeQuotasNegativeTestJSON-406552538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:13:06 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-6918c97a-bfd8-4ae5-9f50-03ebcac7b357 tempest-VolumeQuotasNegativeTestJSON-406552538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:13:06 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-6918c97a-bfd8-4ae5-9f50-03ebcac7b357 tempest-VolumeQuotasNegativeTestJSON-406552538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:13:06 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-6918c97a-bfd8-4ae5-9f50-03ebcac7b357 tempest-VolumeQuotasNegativeTestJSON-406552538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:13:06 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-6918c97a-bfd8-4ae5-9f50-03ebcac7b357 tempest-VolumeQuotasNegativeTestJSON-406552538 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:13:06 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-6918c97a-bfd8-4ae5-9f50-03ebcac7b357 tempest-VolumeQuotasNegativeTestJSON-406552538 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:13:06 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-6918c97a-bfd8-4ae5-9f50-03ebcac7b357 tempest-VolumeQuotasNegativeTestJSON-406552538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-24d1be36-a5fc-486d-b7f2-5a60265add4b 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:13:06 devstack sudo[90958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-24d1be36-a5fc-486d-b7f2-5a60265add4b 1073741824 Aug 29 01:13:06 devstack sudo[90958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:13:06 devstack sudo[90957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-0704ac4f-bf64-452d-9dfb-4a7814018167 Aug 29 01:13:06 devstack sudo[90957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:13:07 devstack sudo[90957]: pam_unix(sudo:session): session closed for user root Aug 29 01:13:07 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-9f75ffc5-74ef-4176-8c21-cdea8142d9a4 tempest-ServersNegativeTestJSON-1150230952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-0704ac4f-bf64-452d-9dfb-4a7814018167" returned: 0 in 0.430s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:13:07 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-9f75ffc5-74ef-4176-8c21-cdea8142d9a4 tempest-ServersNegativeTestJSON-1150230952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-0704ac4f-bf64-452d-9dfb-4a7814018167 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:13:07 devstack sudo[90970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-0704ac4f-bf64-452d-9dfb-4a7814018167 Aug 29 01:13:07 devstack sudo[90970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:13:07 devstack sudo[90958]: pam_unix(sudo:session): session closed for user root Aug 29 01:13:07 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-6918c97a-bfd8-4ae5-9f50-03ebcac7b357 tempest-VolumeQuotasNegativeTestJSON-406552538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-24d1be36-a5fc-486d-b7f2-5a60265add4b 1073741824" returned: 0 in 0.516s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:13:07 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-6918c97a-bfd8-4ae5-9f50-03ebcac7b357 tempest-VolumeQuotasNegativeTestJSON-406552538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-24d1be36-a5fc-486d-b7f2-5a60265add4b {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:13:07 devstack sudo[90973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-24d1be36-a5fc-486d-b7f2-5a60265add4b Aug 29 01:13:07 devstack sudo[90973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:13:07 devstack sudo[90970]: pam_unix(sudo:session): session closed for user root Aug 29 01:13:07 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-9f75ffc5-74ef-4176-8c21-cdea8142d9a4 tempest-ServersNegativeTestJSON-1150230952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-0704ac4f-bf64-452d-9dfb-4a7814018167" returned: 0 in 0.307s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:13:07 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-9f75ffc5-74ef-4176-8c21-cdea8142d9a4 tempest-ServersNegativeTestJSON-1150230952 None] Lock "cinder-quobyte-0704ac4f-bf64-452d-9dfb-4a7814018167" released by "delete_volume" :: held 0.823s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:13:07 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-9f75ffc5-74ef-4176-8c21-cdea8142d9a4 tempest-ServersNegativeTestJSON-1150230952 None] Created reservations ['739cfc54-1c03-4dc5-a001-3e1b99532931', '29f5cc70-a9d2-4d2c-a12b-5a1c146535dc', '88f1d298-88fd-4c90-81b5-6c9028428d88', 'a81ddb95-8882-4051-b771-122c602e2766'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:13:07 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-9f75ffc5-74ef-4176-8c21-cdea8142d9a4 tempest-ServersNegativeTestJSON-1150230952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:13:07 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-9f75ffc5-74ef-4176-8c21-cdea8142d9a4 tempest-ServersNegativeTestJSON-1150230952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:13:07 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-9f75ffc5-74ef-4176-8c21-cdea8142d9a4 tempest-ServersNegativeTestJSON-1150230952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:13:07 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-9f75ffc5-74ef-4176-8c21-cdea8142d9a4 tempest-ServersNegativeTestJSON-1150230952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:13:07 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-9f75ffc5-74ef-4176-8c21-cdea8142d9a4 tempest-ServersNegativeTestJSON-1150230952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:13:07 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-9f75ffc5-74ef-4176-8c21-cdea8142d9a4 tempest-ServersNegativeTestJSON-1150230952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:13:07 devstack sudo[90976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:13:07 devstack sudo[90976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:13:07 devstack sudo[90973]: pam_unix(sudo:session): session closed for user root Aug 29 01:13:07 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-6918c97a-bfd8-4ae5-9f50-03ebcac7b357 tempest-VolumeQuotasNegativeTestJSON-406552538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-24d1be36-a5fc-486d-b7f2-5a60265add4b" returned: 0 in 0.379s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:13:07 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-6918c97a-bfd8-4ae5-9f50-03ebcac7b357 tempest-VolumeQuotasNegativeTestJSON-406552538 None] <== create_volume: return (949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:13:07 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-6918c97a-bfd8-4ae5-9f50-03ebcac7b357 tempest-VolumeQuotasNegativeTestJSON-406552538 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.955s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:13:07 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6918c97a-bfd8-4ae5-9f50-03ebcac7b357 tempest-VolumeQuotasNegativeTestJSON-406552538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32d5145c-05e0-4c62-9b82-e7fe8b9bc143) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24d1be36-a5fc-486d-b7f2-5a60265add4b', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:13:07 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6918c97a-bfd8-4ae5-9f50-03ebcac7b357 tempest-VolumeQuotasNegativeTestJSON-406552538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33cca48d-42e7-4a67-9d7f-f247110c7f6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:13:07 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-6918c97a-bfd8-4ae5-9f50-03ebcac7b357 tempest-VolumeQuotasNegativeTestJSON-406552538 None] Volume volume-24d1be36-a5fc-486d-b7f2-5a60265add4b (24d1be36-a5fc-486d-b7f2-5a60265add4b): created successfully Aug 29 01:13:07 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6918c97a-bfd8-4ae5-9f50-03ebcac7b357 tempest-VolumeQuotasNegativeTestJSON-406552538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33cca48d-42e7-4a67-9d7f-f247110c7f6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:13:07 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6918c97a-bfd8-4ae5-9f50-03ebcac7b357 tempest-VolumeQuotasNegativeTestJSON-406552538 None] Flow 'volume_create_manager' (8de61390-3917-49ed-adff-97d374352b89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:13:07 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-6918c97a-bfd8-4ae5-9f50-03ebcac7b357 tempest-VolumeQuotasNegativeTestJSON-406552538 None] Created volume successfully. Aug 29 01:13:07 devstack sudo[90976]: pam_unix(sudo:session): session closed for user root Aug 29 01:13:07 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-9f75ffc5-74ef-4176-8c21-cdea8142d9a4 tempest-ServersNegativeTestJSON-1150230952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.340s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:13:07 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-9f75ffc5-74ef-4176-8c21-cdea8142d9a4 tempest-ServersNegativeTestJSON-1150230952 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:13:07 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-9f75ffc5-74ef-4176-8c21-cdea8142d9a4 tempest-ServersNegativeTestJSON-1150230952 None] Deleted volume successfully. Aug 29 01:13:08 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-9f75ffc5-74ef-4176-8c21-cdea8142d9a4 tempest-ServersNegativeTestJSON-1150230952 None] Lock "cinder-0704ac4f-bf64-452d-9dfb-4a7814018167-delete_volume" released by "delete_volume" :: held 1.585s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:13:10 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-5cf73fd5-f2ac-4443-bff6-e3d044afa8b4 tempest-VolumeQuotasNegativeTestJSON-406552538 None] Acquiring lock "cinder-24d1be36-a5fc-486d-b7f2-5a60265add4b-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:13:10 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-5cf73fd5-f2ac-4443-bff6-e3d044afa8b4 tempest-VolumeQuotasNegativeTestJSON-406552538 None] Lock "cinder-24d1be36-a5fc-486d-b7f2-5a60265add4b-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:13:10 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-5cf73fd5-f2ac-4443-bff6-e3d044afa8b4 tempest-VolumeQuotasNegativeTestJSON-406552538 None] Acquiring lock "cinder-quobyte-24d1be36-a5fc-486d-b7f2-5a60265add4b" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:13:10 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-5cf73fd5-f2ac-4443-bff6-e3d044afa8b4 tempest-VolumeQuotasNegativeTestJSON-406552538 None] Lock "cinder-quobyte-24d1be36-a5fc-486d-b7f2-5a60265add4b" acquired by "delete_volume" :: waited 0.043s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:13:10 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[658b8aed-9ef0-4710-973c-228173ae0547]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:13:10 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-5cf73fd5-f2ac-4443-bff6-e3d044afa8b4 tempest-VolumeQuotasNegativeTestJSON-406552538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-24d1be36-a5fc-486d-b7f2-5a60265add4b {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:13:10 devstack sudo[91027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-24d1be36-a5fc-486d-b7f2-5a60265add4b Aug 29 01:13:10 devstack sudo[91027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:13:11 devstack sudo[91027]: pam_unix(sudo:session): session closed for user root Aug 29 01:13:11 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-5cf73fd5-f2ac-4443-bff6-e3d044afa8b4 tempest-VolumeQuotasNegativeTestJSON-406552538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-24d1be36-a5fc-486d-b7f2-5a60265add4b" returned: 0 in 0.637s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:13:11 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-5cf73fd5-f2ac-4443-bff6-e3d044afa8b4 tempest-VolumeQuotasNegativeTestJSON-406552538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-24d1be36-a5fc-486d-b7f2-5a60265add4b {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:13:11 devstack sudo[91039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-24d1be36-a5fc-486d-b7f2-5a60265add4b Aug 29 01:13:11 devstack sudo[91039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:13:11 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [req-bf883979-5645-4702-a5d2-6bfd790f7bb8 req-f88034b3-180d-4c2c-8272-3481090d643c tempest-ServerActionsTestOtherA-1708480225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:13:11 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [req-bf883979-5645-4702-a5d2-6bfd790f7bb8 req-f88034b3-180d-4c2c-8272-3481090d643c tempest-ServerActionsTestOtherA-1708480225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:13:11 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [req-bf883979-5645-4702-a5d2-6bfd790f7bb8 req-f88034b3-180d-4c2c-8272-3481090d643c tempest-ServerActionsTestOtherA-1708480225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:13:11 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [req-bf883979-5645-4702-a5d2-6bfd790f7bb8 req-f88034b3-180d-4c2c-8272-3481090d643c tempest-ServerActionsTestOtherA-1708480225 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630', 'name': 'volume-0e86a809-e98d-46fc-a23a-1530583abff1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '74b207f4-1e9e-4991-b4aa-051f3b604751', 'enforce_multipath': True} {{(pid=86111) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 29 01:13:11 devstack sudo[91039]: pam_unix(sudo:session): session closed for user root Aug 29 01:13:11 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-5cf73fd5-f2ac-4443-bff6-e3d044afa8b4 tempest-VolumeQuotasNegativeTestJSON-406552538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-24d1be36-a5fc-486d-b7f2-5a60265add4b" returned: 0 in 0.448s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:13:11 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-5cf73fd5-f2ac-4443-bff6-e3d044afa8b4 tempest-VolumeQuotasNegativeTestJSON-406552538 None] Lock "cinder-quobyte-24d1be36-a5fc-486d-b7f2-5a60265add4b" released by "delete_volume" :: held 1.171s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:13:11 devstack cinder-volume[86111]: INFO cinder.volume.manager [req-bf883979-5645-4702-a5d2-6bfd790f7bb8 req-f88034b3-180d-4c2c-8272-3481090d643c tempest-ServerActionsTestOtherA-1708480225 None] attachment_update completed successfully. Aug 29 01:13:11 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-5cf73fd5-f2ac-4443-bff6-e3d044afa8b4 tempest-VolumeQuotasNegativeTestJSON-406552538 None] Created reservations ['24bebc8a-7f18-4e33-a08c-0bc95671e794', '9e0710b5-9f40-41fa-b919-eed841c439e9', '8dc9cf95-197d-442d-b790-82fcee9a3b94', '32d37f74-6358-4f35-8946-14b694a05ef6'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:13:11 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-5cf73fd5-f2ac-4443-bff6-e3d044afa8b4 tempest-VolumeQuotasNegativeTestJSON-406552538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:13:11 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-5cf73fd5-f2ac-4443-bff6-e3d044afa8b4 tempest-VolumeQuotasNegativeTestJSON-406552538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:13:11 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-5cf73fd5-f2ac-4443-bff6-e3d044afa8b4 tempest-VolumeQuotasNegativeTestJSON-406552538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:13:11 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-5cf73fd5-f2ac-4443-bff6-e3d044afa8b4 tempest-VolumeQuotasNegativeTestJSON-406552538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:13:11 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-5cf73fd5-f2ac-4443-bff6-e3d044afa8b4 tempest-VolumeQuotasNegativeTestJSON-406552538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:13:11 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-5cf73fd5-f2ac-4443-bff6-e3d044afa8b4 tempest-VolumeQuotasNegativeTestJSON-406552538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:13:11 devstack sudo[91048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:13:11 devstack sudo[91048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:13:12 devstack sudo[91048]: pam_unix(sudo:session): session closed for user root Aug 29 01:13:12 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-5cf73fd5-f2ac-4443-bff6-e3d044afa8b4 tempest-VolumeQuotasNegativeTestJSON-406552538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.397s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:13:12 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-5cf73fd5-f2ac-4443-bff6-e3d044afa8b4 tempest-VolumeQuotasNegativeTestJSON-406552538 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:13:12 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-5cf73fd5-f2ac-4443-bff6-e3d044afa8b4 tempest-VolumeQuotasNegativeTestJSON-406552538 None] Deleted volume successfully. Aug 29 01:13:12 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-5cf73fd5-f2ac-4443-bff6-e3d044afa8b4 tempest-VolumeQuotasNegativeTestJSON-406552538 None] Lock "cinder-24d1be36-a5fc-486d-b7f2-5a60265add4b-delete_volume" released by "delete_volume" :: held 1.956s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:13:21 devstack cinder-volume[86111]: DEBUG dbcounter [-] [86111] Writing DB stats cinder:UPDATE=64,cinder:SELECT=60,cinder:INSERT=14,cinder:DELETE=4 {{(pid=86111) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 29 01:13:22 devstack cinder-volume[86111]: DEBUG dbcounter [-] [86111] Writing DB stats cinder:SELECT=46,cinder:UPDATE=59,cinder:INSERT=25,cinder:DELETE=7 {{(pid=86111) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 29 01:13:25 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a6df084-cab0-4bc5-8fe1-6d0d76873316 tempest-VolumeRetypeWithoutMigrationTest-1865093935 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:13:25 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-3a6df084-cab0-4bc5-8fe1-6d0d76873316 tempest-VolumeRetypeWithoutMigrationTest-1865093935 None] Flow 'volume_create_manager' (d889988b-7f7d-4d25-af5b-9a2e20e6a44a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:13:25 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-3a6df084-cab0-4bc5-8fe1-6d0d76873316 tempest-VolumeRetypeWithoutMigrationTest-1865093935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (312ad296-204c-4aaa-a112-515dd2ab64d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:13:25 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-3a6df084-cab0-4bc5-8fe1-6d0d76873316 tempest-VolumeRetypeWithoutMigrationTest-1865093935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (312ad296-204c-4aaa-a112-515dd2ab64d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:13:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-338900206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=434cdd08-d8c9-42ab-bfb6-9d29ecf0c572,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1bb1d82acb34d248f780f3ccb6855ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:13:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:13:25Z,use_quota=True,user_id='111160d225d14add90188e81d7dd6077',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68ffab85-cb0b-4ba1-9db5-9705c2b3616a),volume_type_id=68ffab85-cb0b-4ba1-9db5-9705c2b3616a)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:13:25 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-3a6df084-cab0-4bc5-8fe1-6d0d76873316 tempest-VolumeRetypeWithoutMigrationTest-1865093935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89105657-c44e-475d-9d3f-d59293e2a98f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:13:25 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-3a6df084-cab0-4bc5-8fe1-6d0d76873316 tempest-VolumeRetypeWithoutMigrationTest-1865093935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89105657-c44e-475d-9d3f-d59293e2a98f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:13:25 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-3a6df084-cab0-4bc5-8fe1-6d0d76873316 tempest-VolumeRetypeWithoutMigrationTest-1865093935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (629946aa-cf38-4373-a91b-d112de3dc70a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:13:25 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-3a6df084-cab0-4bc5-8fe1-6d0d76873316 tempest-VolumeRetypeWithoutMigrationTest-1865093935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (629946aa-cf38-4373-a91b-d112de3dc70a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '434cdd08-d8c9-42ab-bfb6-9d29ecf0c572', 'volume_name': 'volume-434cdd08-d8c9-42ab-bfb6-9d29ecf0c572', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:13:25 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-3a6df084-cab0-4bc5-8fe1-6d0d76873316 tempest-VolumeRetypeWithoutMigrationTest-1865093935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4139bcc0-1161-48c2-9792-56e0f3dbb80b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:13:25 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-3a6df084-cab0-4bc5-8fe1-6d0d76873316 tempest-VolumeRetypeWithoutMigrationTest-1865093935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4139bcc0-1161-48c2-9792-56e0f3dbb80b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:13:25 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-3a6df084-cab0-4bc5-8fe1-6d0d76873316 tempest-VolumeRetypeWithoutMigrationTest-1865093935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3b42289-9a16-4e2f-88ed-11403e0d9bb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:13:25 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-3a6df084-cab0-4bc5-8fe1-6d0d76873316 tempest-VolumeRetypeWithoutMigrationTest-1865093935 None] Volume 434cdd08-d8c9-42ab-bfb6-9d29ecf0c572: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-434cdd08-d8c9-42ab-bfb6-9d29ecf0c572', 'volume_size': 1} Aug 29 01:13:25 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-3a6df084-cab0-4bc5-8fe1-6d0d76873316 tempest-VolumeRetypeWithoutMigrationTest-1865093935 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:13:25 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-3a6df084-cab0-4bc5-8fe1-6d0d76873316 tempest-VolumeRetypeWithoutMigrationTest-1865093935 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:13:25 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-3a6df084-cab0-4bc5-8fe1-6d0d76873316 tempest-VolumeRetypeWithoutMigrationTest-1865093935 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:13:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-338900206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=434cdd08-d8c9-42ab-bfb6-9d29ecf0c572,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1bb1d82acb34d248f780f3ccb6855ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:13:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:13:25Z,use_quota=True,user_id='111160d225d14add90188e81d7dd6077',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68ffab85-cb0b-4ba1-9db5-9705c2b3616a),volume_type_id=68ffab85-cb0b-4ba1-9db5-9705c2b3616a)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:13:25 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-3a6df084-cab0-4bc5-8fe1-6d0d76873316 tempest-VolumeRetypeWithoutMigrationTest-1865093935 None] Creating volume 434cdd08-d8c9-42ab-bfb6-9d29ecf0c572 {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:13:25 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-3a6df084-cab0-4bc5-8fe1-6d0d76873316 tempest-VolumeRetypeWithoutMigrationTest-1865093935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:13:25 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-3a6df084-cab0-4bc5-8fe1-6d0d76873316 tempest-VolumeRetypeWithoutMigrationTest-1865093935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:13:25 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-3a6df084-cab0-4bc5-8fe1-6d0d76873316 tempest-VolumeRetypeWithoutMigrationTest-1865093935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:13:25 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-3a6df084-cab0-4bc5-8fe1-6d0d76873316 tempest-VolumeRetypeWithoutMigrationTest-1865093935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:13:25 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-3a6df084-cab0-4bc5-8fe1-6d0d76873316 tempest-VolumeRetypeWithoutMigrationTest-1865093935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:13:25 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-3a6df084-cab0-4bc5-8fe1-6d0d76873316 tempest-VolumeRetypeWithoutMigrationTest-1865093935 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:13:25 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-3a6df084-cab0-4bc5-8fe1-6d0d76873316 tempest-VolumeRetypeWithoutMigrationTest-1865093935 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:13:25 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-3a6df084-cab0-4bc5-8fe1-6d0d76873316 tempest-VolumeRetypeWithoutMigrationTest-1865093935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-434cdd08-d8c9-42ab-bfb6-9d29ecf0c572 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:13:25 devstack sudo[91598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-434cdd08-d8c9-42ab-bfb6-9d29ecf0c572 1073741824 Aug 29 01:13:25 devstack sudo[91598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:13:26 devstack sudo[91598]: pam_unix(sudo:session): session closed for user root Aug 29 01:13:26 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-3a6df084-cab0-4bc5-8fe1-6d0d76873316 tempest-VolumeRetypeWithoutMigrationTest-1865093935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-434cdd08-d8c9-42ab-bfb6-9d29ecf0c572 1073741824" returned: 0 in 0.632s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:13:26 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-3a6df084-cab0-4bc5-8fe1-6d0d76873316 tempest-VolumeRetypeWithoutMigrationTest-1865093935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-434cdd08-d8c9-42ab-bfb6-9d29ecf0c572 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:13:26 devstack sudo[91604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-434cdd08-d8c9-42ab-bfb6-9d29ecf0c572 Aug 29 01:13:26 devstack sudo[91604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:13:27 devstack sudo[91604]: pam_unix(sudo:session): session closed for user root Aug 29 01:13:27 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-3a6df084-cab0-4bc5-8fe1-6d0d76873316 tempest-VolumeRetypeWithoutMigrationTest-1865093935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-434cdd08-d8c9-42ab-bfb6-9d29ecf0c572" returned: 0 in 0.612s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:13:27 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-3a6df084-cab0-4bc5-8fe1-6d0d76873316 tempest-VolumeRetypeWithoutMigrationTest-1865093935 None] <== create_volume: return (1324ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:13:27 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-3a6df084-cab0-4bc5-8fe1-6d0d76873316 tempest-VolumeRetypeWithoutMigrationTest-1865093935 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.332s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:13:27 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-3a6df084-cab0-4bc5-8fe1-6d0d76873316 tempest-VolumeRetypeWithoutMigrationTest-1865093935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3b42289-9a16-4e2f-88ed-11403e0d9bb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-434cdd08-d8c9-42ab-bfb6-9d29ecf0c572', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:13:27 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-3a6df084-cab0-4bc5-8fe1-6d0d76873316 tempest-VolumeRetypeWithoutMigrationTest-1865093935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e411096-6f67-4fb9-9b24-f53e4c1b77ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:13:27 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-3a6df084-cab0-4bc5-8fe1-6d0d76873316 tempest-VolumeRetypeWithoutMigrationTest-1865093935 None] Volume volume-434cdd08-d8c9-42ab-bfb6-9d29ecf0c572 (434cdd08-d8c9-42ab-bfb6-9d29ecf0c572): created successfully Aug 29 01:13:27 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-3a6df084-cab0-4bc5-8fe1-6d0d76873316 tempest-VolumeRetypeWithoutMigrationTest-1865093935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e411096-6f67-4fb9-9b24-f53e4c1b77ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:13:27 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-3a6df084-cab0-4bc5-8fe1-6d0d76873316 tempest-VolumeRetypeWithoutMigrationTest-1865093935 None] Flow 'volume_create_manager' (d889988b-7f7d-4d25-af5b-9a2e20e6a44a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:13:27 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-3a6df084-cab0-4bc5-8fe1-6d0d76873316 tempest-VolumeRetypeWithoutMigrationTest-1865093935 None] Created volume successfully. Aug 29 01:13:28 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-d37dc50b-9c84-4480-8dd4-8356c9d737b5 tempest-VolumeRetypeWithoutMigrationTest-1865093935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:13:28 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-d37dc50b-9c84-4480-8dd4-8356c9d737b5 tempest-VolumeRetypeWithoutMigrationTest-1865093935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:13:28 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-d37dc50b-9c84-4480-8dd4-8356c9d737b5 tempest-VolumeRetypeWithoutMigrationTest-1865093935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:13:28 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-d37dc50b-9c84-4480-8dd4-8356c9d737b5 tempest-VolumeRetypeWithoutMigrationTest-1865093935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:13:28 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-d37dc50b-9c84-4480-8dd4-8356c9d737b5 tempest-VolumeRetypeWithoutMigrationTest-1865093935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:13:28 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d37dc50b-9c84-4480-8dd4-8356c9d737b5 tempest-VolumeRetypeWithoutMigrationTest-1865093935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:13:28 devstack sudo[91635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:13:28 devstack sudo[91635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:13:28 devstack sudo[91635]: pam_unix(sudo:session): session closed for user root Aug 29 01:13:28 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d37dc50b-9c84-4480-8dd4-8356c9d737b5 tempest-VolumeRetypeWithoutMigrationTest-1865093935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.445s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:13:28 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-d37dc50b-9c84-4480-8dd4-8356c9d737b5 tempest-VolumeRetypeWithoutMigrationTest-1865093935 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:13:28 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-d37dc50b-9c84-4480-8dd4-8356c9d737b5 tempest-VolumeRetypeWithoutMigrationTest-1865093935 None] Retype volume completed successfully. Aug 29 01:13:29 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-87915fed-499f-4e1e-bae5-96db0419de65 tempest-VolumeRetypeWithoutMigrationTest-1865093935 None] Acquiring lock "cinder-434cdd08-d8c9-42ab-bfb6-9d29ecf0c572-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:13:29 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-87915fed-499f-4e1e-bae5-96db0419de65 tempest-VolumeRetypeWithoutMigrationTest-1865093935 None] Lock "cinder-434cdd08-d8c9-42ab-bfb6-9d29ecf0c572-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:13:29 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-87915fed-499f-4e1e-bae5-96db0419de65 tempest-VolumeRetypeWithoutMigrationTest-1865093935 None] Acquiring lock "cinder-quobyte-434cdd08-d8c9-42ab-bfb6-9d29ecf0c572" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:13:29 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-87915fed-499f-4e1e-bae5-96db0419de65 tempest-VolumeRetypeWithoutMigrationTest-1865093935 None] Lock "cinder-quobyte-434cdd08-d8c9-42ab-bfb6-9d29ecf0c572" acquired by "delete_volume" :: waited 0.024s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:13:29 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e336d56-7394-4ae1-9e33-1f8bc6108fa4]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:13:29 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-87915fed-499f-4e1e-bae5-96db0419de65 tempest-VolumeRetypeWithoutMigrationTest-1865093935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-434cdd08-d8c9-42ab-bfb6-9d29ecf0c572 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:13:30 devstack sudo[91641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-434cdd08-d8c9-42ab-bfb6-9d29ecf0c572 Aug 29 01:13:30 devstack sudo[91641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:13:30 devstack sudo[91641]: pam_unix(sudo:session): session closed for user root Aug 29 01:13:30 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-87915fed-499f-4e1e-bae5-96db0419de65 tempest-VolumeRetypeWithoutMigrationTest-1865093935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-434cdd08-d8c9-42ab-bfb6-9d29ecf0c572" returned: 0 in 0.571s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:13:30 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-87915fed-499f-4e1e-bae5-96db0419de65 tempest-VolumeRetypeWithoutMigrationTest-1865093935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-434cdd08-d8c9-42ab-bfb6-9d29ecf0c572 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:13:30 devstack sudo[91647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-434cdd08-d8c9-42ab-bfb6-9d29ecf0c572 Aug 29 01:13:30 devstack sudo[91647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:13:30 devstack sudo[91647]: pam_unix(sudo:session): session closed for user root Aug 29 01:13:30 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-87915fed-499f-4e1e-bae5-96db0419de65 tempest-VolumeRetypeWithoutMigrationTest-1865093935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-434cdd08-d8c9-42ab-bfb6-9d29ecf0c572" returned: 0 in 0.330s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:13:30 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-87915fed-499f-4e1e-bae5-96db0419de65 tempest-VolumeRetypeWithoutMigrationTest-1865093935 None] Lock "cinder-quobyte-434cdd08-d8c9-42ab-bfb6-9d29ecf0c572" released by "delete_volume" :: held 0.978s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:13:30 devstack cinder-volume[86111]: WARNING cinder.quota [None req-87915fed-499f-4e1e-bae5-96db0419de65 tempest-VolumeRetypeWithoutMigrationTest-1865093935 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Aug 29 01:13:30 devstack cinder-volume[86111]: WARNING cinder.quota [None req-87915fed-499f-4e1e-bae5-96db0419de65 tempest-VolumeRetypeWithoutMigrationTest-1865093935 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Aug 29 01:13:30 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-87915fed-499f-4e1e-bae5-96db0419de65 tempest-VolumeRetypeWithoutMigrationTest-1865093935 None] Created reservations ['f53e90dc-4e63-4649-892b-5f8747cfcd3f', '435a3703-c062-47d8-ba73-84ac43b8ff55', 'a3801dfd-8235-4874-9309-d5e08636c29e', '197c19e4-5c34-4dd0-b714-17fae984d705'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:13:31 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-87915fed-499f-4e1e-bae5-96db0419de65 tempest-VolumeRetypeWithoutMigrationTest-1865093935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:13:31 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-87915fed-499f-4e1e-bae5-96db0419de65 tempest-VolumeRetypeWithoutMigrationTest-1865093935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:13:31 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-87915fed-499f-4e1e-bae5-96db0419de65 tempest-VolumeRetypeWithoutMigrationTest-1865093935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:13:31 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-87915fed-499f-4e1e-bae5-96db0419de65 tempest-VolumeRetypeWithoutMigrationTest-1865093935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:13:31 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-87915fed-499f-4e1e-bae5-96db0419de65 tempest-VolumeRetypeWithoutMigrationTest-1865093935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:13:31 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-87915fed-499f-4e1e-bae5-96db0419de65 tempest-VolumeRetypeWithoutMigrationTest-1865093935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:13:31 devstack sudo[91651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:13:31 devstack sudo[91651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:13:31 devstack sudo[91651]: pam_unix(sudo:session): session closed for user root Aug 29 01:13:31 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-87915fed-499f-4e1e-bae5-96db0419de65 tempest-VolumeRetypeWithoutMigrationTest-1865093935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.378s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:13:31 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-87915fed-499f-4e1e-bae5-96db0419de65 tempest-VolumeRetypeWithoutMigrationTest-1865093935 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:13:31 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-87915fed-499f-4e1e-bae5-96db0419de65 tempest-VolumeRetypeWithoutMigrationTest-1865093935 None] Deleted volume successfully. Aug 29 01:13:31 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-87915fed-499f-4e1e-bae5-96db0419de65 tempest-VolumeRetypeWithoutMigrationTest-1865093935 None] Lock "cinder-434cdd08-d8c9-42ab-bfb6-9d29ecf0c572-delete_volume" released by "delete_volume" :: held 1.768s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:13:35 devstack cinder-volume[86111]: INFO cinder.volume.manager [req-7735ea61-7f22-4b1c-b907-b92ff1f2c283 req-628519bc-d421-4014-ae9e-bde4553a88a5 tempest-ServerActionsTestOtherA-1708480225 None] Terminate volume connection completed successfully. Aug 29 01:13:35 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [req-7735ea61-7f22-4b1c-b907-b92ff1f2c283 req-628519bc-d421-4014-ae9e-bde4553a88a5 tempest-ServerActionsTestOtherA-1708480225 None] Deleting attachment 74b207f4-1e9e-4991-b4aa-051f3b604751. {{(pid=86111) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 29 01:13:37 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-f40e3d12-c8d9-4c8b-853d-7ccf19283c0a tempest-GroupsTest-123402461 None] Group tempest-Group1-2011560554: creating Aug 29 01:13:37 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-f40e3d12-c8d9-4c8b-853d-7ccf19283c0a tempest-GroupsTest-123402461 None] Group tempest-Group1-2011560554: created successfully Aug 29 01:13:37 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-f40e3d12-c8d9-4c8b-853d-7ccf19283c0a tempest-GroupsTest-123402461 None] Create group completed successfully. Aug 29 01:13:38 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [req-7735ea61-7f22-4b1c-b907-b92ff1f2c283 req-426ac7c5-1c6e-4055-b464-e012ff03cba5 tempest-ServerActionsTestOtherA-1708480225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:13:38 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [req-7735ea61-7f22-4b1c-b907-b92ff1f2c283 req-426ac7c5-1c6e-4055-b464-e012ff03cba5 tempest-ServerActionsTestOtherA-1708480225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:13:38 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [req-7735ea61-7f22-4b1c-b907-b92ff1f2c283 req-426ac7c5-1c6e-4055-b464-e012ff03cba5 tempest-ServerActionsTestOtherA-1708480225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:13:38 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [req-7735ea61-7f22-4b1c-b907-b92ff1f2c283 req-426ac7c5-1c6e-4055-b464-e012ff03cba5 tempest-ServerActionsTestOtherA-1708480225 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630', 'name': 'volume-0e86a809-e98d-46fc-a23a-1530583abff1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '14ae41d4-b50d-4b9f-bf8c-374e87afadb6', 'enforce_multipath': True} {{(pid=86111) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 29 01:13:38 devstack cinder-volume[86111]: INFO cinder.volume.manager [req-7735ea61-7f22-4b1c-b907-b92ff1f2c283 req-426ac7c5-1c6e-4055-b464-e012ff03cba5 tempest-ServerActionsTestOtherA-1708480225 None] attachment_update completed successfully. Aug 29 01:13:39 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-4c83feb4-1c2e-4f69-8cc4-c4ad8c715f3e tempest-GroupsTest-123402461 None] Group tempest-Group2-775979977: creating Aug 29 01:13:39 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-4c83feb4-1c2e-4f69-8cc4-c4ad8c715f3e tempest-GroupsTest-123402461 None] Group tempest-Group2-775979977: created successfully Aug 29 01:13:39 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-4c83feb4-1c2e-4f69-8cc4-c4ad8c715f3e tempest-GroupsTest-123402461 None] Create group completed successfully. Aug 29 01:13:40 devstack cinder-volume[86111]: DEBUG oslo_service.periodic_task [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86111) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 29 01:13:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:13:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:13:40 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:13:40 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:13:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:13:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:13:40 devstack sudo[92152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:13:40 devstack sudo[92152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:13:41 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-79002d8e-6371-4f52-9929-50f20df71f74 tempest-GroupsTest-123402461 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:13:41 devstack sudo[92152]: pam_unix(sudo:session): session closed for user root Aug 29 01:13:41 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-79002d8e-6371-4f52-9929-50f20df71f74 tempest-GroupsTest-123402461 None] Flow 'volume_create_manager' (6629da50-c149-45d7-b881-8ed1bec5e132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:13:41 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-79002d8e-6371-4f52-9929-50f20df71f74 tempest-GroupsTest-123402461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87353ca4-86ca-4195-aea6-aae5a8f8b322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:13:41 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-de752545-d617-440e-8362-d04fae0901a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.478s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:13:41 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:13:41 devstack cinder-volume[86111]: DEBUG oslo_service.periodic_task [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Running periodic task VolumeManager._thread_info {{(pid=86111) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 29 01:13:41 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-de752545-d617-440e-8362-d04fae0901a5 None None] thread count: 28 {{(pid=86111) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 29 01:13:41 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-de752545-d617-440e-8362-d04fae0901a5 None None] thread info: [<_MainThread(MainThread, started 129173440548992)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86111) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 29 01:13:41 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-79002d8e-6371-4f52-9929-50f20df71f74 tempest-GroupsTest-123402461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87353ca4-86ca-4195-aea6-aae5a8f8b322) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:13:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-848424139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a673246c-05cd-4539-a748-a3a0a402202f,host='devstack@QuobyteHD#QuobyteHD',id=6ef74271-fbd0-4f8e-9817-213ab4dc5725,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79e233ea9dbd4b0485bc05c628e52ff6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:13:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:13:41Z,use_quota=True,user_id='36c3979b00964ae7a93121c029911ce6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(39769d29-ec40-4bda-bde0-ae7cc66c88ed),volume_type_id=39769d29-ec40-4bda-bde0-ae7cc66c88ed)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:13:41 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-79002d8e-6371-4f52-9929-50f20df71f74 tempest-GroupsTest-123402461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3838f39b-c2df-470a-9426-6542a95da320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:13:41 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-79002d8e-6371-4f52-9929-50f20df71f74 tempest-GroupsTest-123402461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3838f39b-c2df-470a-9426-6542a95da320) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:13:41 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-79002d8e-6371-4f52-9929-50f20df71f74 tempest-GroupsTest-123402461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a54b23a6-09d2-438e-a898-da86d98e054d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:13:41 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-79002d8e-6371-4f52-9929-50f20df71f74 tempest-GroupsTest-123402461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a54b23a6-09d2-438e-a898-da86d98e054d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ef74271-fbd0-4f8e-9817-213ab4dc5725', 'volume_name': 'volume-6ef74271-fbd0-4f8e-9817-213ab4dc5725', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:13:41 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-79002d8e-6371-4f52-9929-50f20df71f74 tempest-GroupsTest-123402461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa86ab73-ea19-4691-a7b6-1fbdb31a8ae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:13:41 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-79002d8e-6371-4f52-9929-50f20df71f74 tempest-GroupsTest-123402461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa86ab73-ea19-4691-a7b6-1fbdb31a8ae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:13:41 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-79002d8e-6371-4f52-9929-50f20df71f74 tempest-GroupsTest-123402461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cfa4ded-be54-41ec-b307-ffccfaf55fef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:13:41 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-79002d8e-6371-4f52-9929-50f20df71f74 tempest-GroupsTest-123402461 None] Volume 6ef74271-fbd0-4f8e-9817-213ab4dc5725: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ef74271-fbd0-4f8e-9817-213ab4dc5725', 'volume_size': 1} Aug 29 01:13:41 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-79002d8e-6371-4f52-9929-50f20df71f74 tempest-GroupsTest-123402461 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:13:41 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-79002d8e-6371-4f52-9929-50f20df71f74 tempest-GroupsTest-123402461 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:13:41 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-79002d8e-6371-4f52-9929-50f20df71f74 tempest-GroupsTest-123402461 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a673246c-05cd-4539-a748-a3a0a402202f,created_at=2026-08-28T23:13:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-848424139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a673246c-05cd-4539-a748-a3a0a402202f,host='devstack@QuobyteHD#QuobyteHD',id=6ef74271-fbd0-4f8e-9817-213ab4dc5725,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79e233ea9dbd4b0485bc05c628e52ff6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:13:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:13:41Z,use_quota=True,user_id='36c3979b00964ae7a93121c029911ce6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(39769d29-ec40-4bda-bde0-ae7cc66c88ed),volume_type_id=39769d29-ec40-4bda-bde0-ae7cc66c88ed)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:13:41 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-79002d8e-6371-4f52-9929-50f20df71f74 tempest-GroupsTest-123402461 None] Creating volume 6ef74271-fbd0-4f8e-9817-213ab4dc5725 {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:13:41 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-79002d8e-6371-4f52-9929-50f20df71f74 tempest-GroupsTest-123402461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:13:41 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-79002d8e-6371-4f52-9929-50f20df71f74 tempest-GroupsTest-123402461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:13:41 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-79002d8e-6371-4f52-9929-50f20df71f74 tempest-GroupsTest-123402461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:13:41 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-79002d8e-6371-4f52-9929-50f20df71f74 tempest-GroupsTest-123402461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:13:41 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-79002d8e-6371-4f52-9929-50f20df71f74 tempest-GroupsTest-123402461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:13:41 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-79002d8e-6371-4f52-9929-50f20df71f74 tempest-GroupsTest-123402461 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:13:41 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-79002d8e-6371-4f52-9929-50f20df71f74 tempest-GroupsTest-123402461 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:13:41 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-79002d8e-6371-4f52-9929-50f20df71f74 tempest-GroupsTest-123402461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-6ef74271-fbd0-4f8e-9817-213ab4dc5725 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:13:41 devstack sudo[92157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-6ef74271-fbd0-4f8e-9817-213ab4dc5725 1073741824 Aug 29 01:13:41 devstack sudo[92157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:13:42 devstack sudo[92157]: pam_unix(sudo:session): session closed for user root Aug 29 01:13:42 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-79002d8e-6371-4f52-9929-50f20df71f74 tempest-GroupsTest-123402461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-6ef74271-fbd0-4f8e-9817-213ab4dc5725 1073741824" returned: 0 in 0.750s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:13:42 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-79002d8e-6371-4f52-9929-50f20df71f74 tempest-GroupsTest-123402461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-6ef74271-fbd0-4f8e-9817-213ab4dc5725 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:13:42 devstack sudo[92169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-6ef74271-fbd0-4f8e-9817-213ab4dc5725 Aug 29 01:13:42 devstack sudo[92169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:13:42 devstack sudo[92169]: pam_unix(sudo:session): session closed for user root Aug 29 01:13:42 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-79002d8e-6371-4f52-9929-50f20df71f74 tempest-GroupsTest-123402461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-6ef74271-fbd0-4f8e-9817-213ab4dc5725" returned: 0 in 0.501s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:13:42 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-79002d8e-6371-4f52-9929-50f20df71f74 tempest-GroupsTest-123402461 None] <== create_volume: return (1340ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:13:42 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-79002d8e-6371-4f52-9929-50f20df71f74 tempest-GroupsTest-123402461 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.350s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:13:42 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-79002d8e-6371-4f52-9929-50f20df71f74 tempest-GroupsTest-123402461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cfa4ded-be54-41ec-b307-ffccfaf55fef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ef74271-fbd0-4f8e-9817-213ab4dc5725', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:13:42 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-79002d8e-6371-4f52-9929-50f20df71f74 tempest-GroupsTest-123402461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (312842ad-3e94-4d39-976d-2a1ed6d2dff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:13:42 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-79002d8e-6371-4f52-9929-50f20df71f74 tempest-GroupsTest-123402461 None] Volume volume-6ef74271-fbd0-4f8e-9817-213ab4dc5725 (6ef74271-fbd0-4f8e-9817-213ab4dc5725): created successfully Aug 29 01:13:42 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-79002d8e-6371-4f52-9929-50f20df71f74 tempest-GroupsTest-123402461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (312842ad-3e94-4d39-976d-2a1ed6d2dff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:13:42 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-79002d8e-6371-4f52-9929-50f20df71f74 tempest-GroupsTest-123402461 None] Flow 'volume_create_manager' (6629da50-c149-45d7-b881-8ed1bec5e132) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:13:42 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-79002d8e-6371-4f52-9929-50f20df71f74 tempest-GroupsTest-123402461 None] Created volume successfully. Aug 29 01:13:43 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-667a5d98-1a2f-4756-b864-fa6713391b10 tempest-AttachVolumeTestJSON-257506515 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:13:43 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-667a5d98-1a2f-4756-b864-fa6713391b10 tempest-AttachVolumeTestJSON-257506515 None] Flow 'volume_create_manager' (7ef2dc38-33eb-48d9-a0a9-530d50be9058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:13:43 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-667a5d98-1a2f-4756-b864-fa6713391b10 tempest-AttachVolumeTestJSON-257506515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f54e93e-e835-41c2-ac44-23776b868110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:13:43 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-667a5d98-1a2f-4756-b864-fa6713391b10 tempest-AttachVolumeTestJSON-257506515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f54e93e-e835-41c2-ac44-23776b868110) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:13:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1916107104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4600cdee-4116-4eb6-b560-1e63977828f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1deedd35ed26432a9fe2138a14f3709d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:13:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:13:43Z,use_quota=True,user_id='929bae8a458349cc97fe1423a5c7481a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:13:43 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-667a5d98-1a2f-4756-b864-fa6713391b10 tempest-AttachVolumeTestJSON-257506515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d588b9e9-326a-4119-9653-c29a173fbcc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:13:43 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-667a5d98-1a2f-4756-b864-fa6713391b10 tempest-AttachVolumeTestJSON-257506515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d588b9e9-326a-4119-9653-c29a173fbcc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:13:43 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-667a5d98-1a2f-4756-b864-fa6713391b10 tempest-AttachVolumeTestJSON-257506515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc7538f6-be5f-4f0e-b8fe-9cf1a16b7ce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:13:43 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-667a5d98-1a2f-4756-b864-fa6713391b10 tempest-AttachVolumeTestJSON-257506515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc7538f6-be5f-4f0e-b8fe-9cf1a16b7ce7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4600cdee-4116-4eb6-b560-1e63977828f7', 'volume_name': 'volume-4600cdee-4116-4eb6-b560-1e63977828f7', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:13:43 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-667a5d98-1a2f-4756-b864-fa6713391b10 tempest-AttachVolumeTestJSON-257506515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b80ced7-1e84-44ea-ac68-4995d4fafd81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:13:43 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-667a5d98-1a2f-4756-b864-fa6713391b10 tempest-AttachVolumeTestJSON-257506515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b80ced7-1e84-44ea-ac68-4995d4fafd81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:13:43 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-667a5d98-1a2f-4756-b864-fa6713391b10 tempest-AttachVolumeTestJSON-257506515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb8d234c-7984-40ef-b50e-5d36be1a74ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:13:43 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-667a5d98-1a2f-4756-b864-fa6713391b10 tempest-AttachVolumeTestJSON-257506515 None] Volume 4600cdee-4116-4eb6-b560-1e63977828f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4600cdee-4116-4eb6-b560-1e63977828f7', 'volume_size': 1} Aug 29 01:13:43 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-667a5d98-1a2f-4756-b864-fa6713391b10 tempest-AttachVolumeTestJSON-257506515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:13:43 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-667a5d98-1a2f-4756-b864-fa6713391b10 tempest-AttachVolumeTestJSON-257506515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:13:43 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-667a5d98-1a2f-4756-b864-fa6713391b10 tempest-AttachVolumeTestJSON-257506515 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:13:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1916107104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4600cdee-4116-4eb6-b560-1e63977828f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1deedd35ed26432a9fe2138a14f3709d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:13:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:13:43Z,use_quota=True,user_id='929bae8a458349cc97fe1423a5c7481a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:13:43 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-667a5d98-1a2f-4756-b864-fa6713391b10 tempest-AttachVolumeTestJSON-257506515 None] Creating volume 4600cdee-4116-4eb6-b560-1e63977828f7 {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:13:43 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-667a5d98-1a2f-4756-b864-fa6713391b10 tempest-AttachVolumeTestJSON-257506515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:13:43 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-667a5d98-1a2f-4756-b864-fa6713391b10 tempest-AttachVolumeTestJSON-257506515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:13:43 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-667a5d98-1a2f-4756-b864-fa6713391b10 tempest-AttachVolumeTestJSON-257506515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:13:43 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-667a5d98-1a2f-4756-b864-fa6713391b10 tempest-AttachVolumeTestJSON-257506515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:13:43 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-667a5d98-1a2f-4756-b864-fa6713391b10 tempest-AttachVolumeTestJSON-257506515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:13:43 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-667a5d98-1a2f-4756-b864-fa6713391b10 tempest-AttachVolumeTestJSON-257506515 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:13:43 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-667a5d98-1a2f-4756-b864-fa6713391b10 tempest-AttachVolumeTestJSON-257506515 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:13:43 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-667a5d98-1a2f-4756-b864-fa6713391b10 tempest-AttachVolumeTestJSON-257506515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-4600cdee-4116-4eb6-b560-1e63977828f7 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:13:43 devstack sudo[92172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-4600cdee-4116-4eb6-b560-1e63977828f7 1073741824 Aug 29 01:13:43 devstack sudo[92172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:13:43 devstack sudo[92172]: pam_unix(sudo:session): session closed for user root Aug 29 01:13:43 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-667a5d98-1a2f-4756-b864-fa6713391b10 tempest-AttachVolumeTestJSON-257506515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-4600cdee-4116-4eb6-b560-1e63977828f7 1073741824" returned: 0 in 0.715s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:13:44 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-667a5d98-1a2f-4756-b864-fa6713391b10 tempest-AttachVolumeTestJSON-257506515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-4600cdee-4116-4eb6-b560-1e63977828f7 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:13:44 devstack sudo[92179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-4600cdee-4116-4eb6-b560-1e63977828f7 Aug 29 01:13:44 devstack sudo[92179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:13:44 devstack sudo[92179]: pam_unix(sudo:session): session closed for user root Aug 29 01:13:44 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-667a5d98-1a2f-4756-b864-fa6713391b10 tempest-AttachVolumeTestJSON-257506515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-4600cdee-4116-4eb6-b560-1e63977828f7" returned: 0 in 0.436s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:13:44 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-667a5d98-1a2f-4756-b864-fa6713391b10 tempest-AttachVolumeTestJSON-257506515 None] <== create_volume: return (1303ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:13:44 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-667a5d98-1a2f-4756-b864-fa6713391b10 tempest-AttachVolumeTestJSON-257506515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.305s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:13:44 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-667a5d98-1a2f-4756-b864-fa6713391b10 tempest-AttachVolumeTestJSON-257506515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb8d234c-7984-40ef-b50e-5d36be1a74ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4600cdee-4116-4eb6-b560-1e63977828f7', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:13:44 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-667a5d98-1a2f-4756-b864-fa6713391b10 tempest-AttachVolumeTestJSON-257506515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f9dc9a8-5ccd-4fea-a2c2-83ef42bd955a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:13:44 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-667a5d98-1a2f-4756-b864-fa6713391b10 tempest-AttachVolumeTestJSON-257506515 None] Volume volume-4600cdee-4116-4eb6-b560-1e63977828f7 (4600cdee-4116-4eb6-b560-1e63977828f7): created successfully Aug 29 01:13:44 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-667a5d98-1a2f-4756-b864-fa6713391b10 tempest-AttachVolumeTestJSON-257506515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f9dc9a8-5ccd-4fea-a2c2-83ef42bd955a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:13:44 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-667a5d98-1a2f-4756-b864-fa6713391b10 tempest-AttachVolumeTestJSON-257506515 None] Flow 'volume_create_manager' (7ef2dc38-33eb-48d9-a0a9-530d50be9058) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:13:44 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-667a5d98-1a2f-4756-b864-fa6713391b10 tempest-AttachVolumeTestJSON-257506515 None] Created volume successfully. Aug 29 01:13:45 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-a9330ef8-c4fc-4442-8659-f0c94de4093e tempest-GroupsTest-123402461 None] Acquiring lock "cinder-quobyte-6ef74271-fbd0-4f8e-9817-213ab4dc5725" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:13:45 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-a9330ef8-c4fc-4442-8659-f0c94de4093e tempest-GroupsTest-123402461 None] Lock "cinder-quobyte-6ef74271-fbd0-4f8e-9817-213ab4dc5725" acquired by "delete_volume" :: waited 0.030s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:13:45 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7372126-ecc0-45cf-b49d-300e595a82df]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:13:45 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-a9330ef8-c4fc-4442-8659-f0c94de4093e tempest-GroupsTest-123402461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-6ef74271-fbd0-4f8e-9817-213ab4dc5725 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:13:45 devstack sudo[92182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-6ef74271-fbd0-4f8e-9817-213ab4dc5725 Aug 29 01:13:45 devstack sudo[92182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:13:46 devstack sudo[92182]: pam_unix(sudo:session): session closed for user root Aug 29 01:13:46 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-a9330ef8-c4fc-4442-8659-f0c94de4093e tempest-GroupsTest-123402461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-6ef74271-fbd0-4f8e-9817-213ab4dc5725" returned: 0 in 0.843s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:13:46 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-a9330ef8-c4fc-4442-8659-f0c94de4093e tempest-GroupsTest-123402461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-6ef74271-fbd0-4f8e-9817-213ab4dc5725 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:13:46 devstack sudo[92193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-6ef74271-fbd0-4f8e-9817-213ab4dc5725 Aug 29 01:13:46 devstack sudo[92193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:13:46 devstack sudo[92193]: pam_unix(sudo:session): session closed for user root Aug 29 01:13:46 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-a9330ef8-c4fc-4442-8659-f0c94de4093e tempest-GroupsTest-123402461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-6ef74271-fbd0-4f8e-9817-213ab4dc5725" returned: 0 in 0.485s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:13:46 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-a9330ef8-c4fc-4442-8659-f0c94de4093e tempest-GroupsTest-123402461 None] Lock "cinder-quobyte-6ef74271-fbd0-4f8e-9817-213ab4dc5725" released by "delete_volume" :: held 1.454s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:13:46 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-a9330ef8-c4fc-4442-8659-f0c94de4093e tempest-GroupsTest-123402461 None] Created reservations ['1593b8ef-0cc6-459a-bb91-ca66aaa8655b'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:13:46 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [req-e602902d-e511-42bc-b126-a1f5c8326542 req-d23f26dd-9ad9-465b-9109-8b1dd68ce346 tempest-AttachVolumeTestJSON-257506515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:13:46 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [req-e602902d-e511-42bc-b126-a1f5c8326542 req-d23f26dd-9ad9-465b-9109-8b1dd68ce346 tempest-AttachVolumeTestJSON-257506515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:13:46 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [req-e602902d-e511-42bc-b126-a1f5c8326542 req-d23f26dd-9ad9-465b-9109-8b1dd68ce346 tempest-AttachVolumeTestJSON-257506515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:13:46 devstack cinder-volume[86111]: WARNING cinder.quota [None req-a9330ef8-c4fc-4442-8659-f0c94de4093e tempest-GroupsTest-123402461 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1950384190 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1950384190, it is now deprecated. Please use the default quota class for default quota. Aug 29 01:13:46 devstack cinder-volume[86111]: WARNING cinder.quota [None req-a9330ef8-c4fc-4442-8659-f0c94de4093e tempest-GroupsTest-123402461 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1950384190 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1950384190, it is now deprecated. Please use the default quota class for default quota. Aug 29 01:13:46 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [req-e602902d-e511-42bc-b126-a1f5c8326542 req-d23f26dd-9ad9-465b-9109-8b1dd68ce346 tempest-AttachVolumeTestJSON-257506515 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630', 'name': 'volume-4600cdee-4116-4eb6-b560-1e63977828f7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f9f47ded-3d40-478b-a180-04e539607432', 'enforce_multipath': True} {{(pid=86111) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 29 01:13:46 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-a9330ef8-c4fc-4442-8659-f0c94de4093e tempest-GroupsTest-123402461 None] Created reservations ['0ae5fff5-2c2b-412b-b3d2-8bc138b66a35', 'aa736e88-49aa-4453-b500-052a308e0737', '90c7b201-eb32-4642-8364-6ee25d73687b', '7e95bd20-d234-4285-afd9-1115b14f6222'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:13:46 devstack cinder-volume[86111]: INFO cinder.volume.manager [req-e602902d-e511-42bc-b126-a1f5c8326542 req-d23f26dd-9ad9-465b-9109-8b1dd68ce346 tempest-AttachVolumeTestJSON-257506515 None] attachment_update completed successfully. Aug 29 01:13:47 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-a9330ef8-c4fc-4442-8659-f0c94de4093e tempest-GroupsTest-123402461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:13:47 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-a9330ef8-c4fc-4442-8659-f0c94de4093e tempest-GroupsTest-123402461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:13:47 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-a9330ef8-c4fc-4442-8659-f0c94de4093e tempest-GroupsTest-123402461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:13:47 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-a9330ef8-c4fc-4442-8659-f0c94de4093e tempest-GroupsTest-123402461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:13:47 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-a9330ef8-c4fc-4442-8659-f0c94de4093e tempest-GroupsTest-123402461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:13:47 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-a9330ef8-c4fc-4442-8659-f0c94de4093e tempest-GroupsTest-123402461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:13:47 devstack sudo[92206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:13:47 devstack sudo[92206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:13:47 devstack sudo[92206]: pam_unix(sudo:session): session closed for user root Aug 29 01:13:47 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-a9330ef8-c4fc-4442-8659-f0c94de4093e tempest-GroupsTest-123402461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.464s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:13:47 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-a9330ef8-c4fc-4442-8659-f0c94de4093e tempest-GroupsTest-123402461 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:13:47 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-a9330ef8-c4fc-4442-8659-f0c94de4093e tempest-GroupsTest-123402461 None] Delete group completed successfully. Aug 29 01:13:48 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-0b725744-93f4-4783-8ff2-2451cb6d410e tempest-GroupsTest-123402461 None] Created reservations ['7ff93546-3160-45fa-8674-1360588c8839'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:13:48 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-0b725744-93f4-4783-8ff2-2451cb6d410e tempest-GroupsTest-123402461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:13:48 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-0b725744-93f4-4783-8ff2-2451cb6d410e tempest-GroupsTest-123402461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:13:48 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-0b725744-93f4-4783-8ff2-2451cb6d410e tempest-GroupsTest-123402461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:13:48 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-0b725744-93f4-4783-8ff2-2451cb6d410e tempest-GroupsTest-123402461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:13:48 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-0b725744-93f4-4783-8ff2-2451cb6d410e tempest-GroupsTest-123402461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:13:48 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-0b725744-93f4-4783-8ff2-2451cb6d410e tempest-GroupsTest-123402461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:13:48 devstack sudo[92212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:13:48 devstack sudo[92212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:13:48 devstack sudo[92212]: pam_unix(sudo:session): session closed for user root Aug 29 01:13:48 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-0b725744-93f4-4783-8ff2-2451cb6d410e tempest-GroupsTest-123402461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.313s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:13:48 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-0b725744-93f4-4783-8ff2-2451cb6d410e tempest-GroupsTest-123402461 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:13:48 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-0b725744-93f4-4783-8ff2-2451cb6d410e tempest-GroupsTest-123402461 None] Delete group completed successfully. Aug 29 01:13:49 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-83e11f0a-7305-4caa-8944-ffd33905c7c7 tempest-GroupsTest-123402461 None] Group tempest-GroupsTest-Group-579627524: creating Aug 29 01:13:49 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-83e11f0a-7305-4caa-8944-ffd33905c7c7 tempest-GroupsTest-123402461 None] Group tempest-GroupsTest-Group-579627524: created successfully Aug 29 01:13:49 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-83e11f0a-7305-4caa-8944-ffd33905c7c7 tempest-GroupsTest-123402461 None] Create group completed successfully. Aug 29 01:13:51 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2734406-db70-425d-a20b-ebafd047900a tempest-GroupsTest-123402461 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:13:51 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-f2734406-db70-425d-a20b-ebafd047900a tempest-GroupsTest-123402461 None] Flow 'volume_create_manager' (cccff1f8-c219-4272-ac4d-19e4e08be49e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:13:51 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-f2734406-db70-425d-a20b-ebafd047900a tempest-GroupsTest-123402461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93ebe293-b4cc-44a2-8eea-acd333956fd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:13:51 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-f2734406-db70-425d-a20b-ebafd047900a tempest-GroupsTest-123402461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93ebe293-b4cc-44a2-8eea-acd333956fd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:13:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1436956954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ddb680da-98ec-47d8-b32a-c4bdde49831a,host='devstack@QuobyteHD#QuobyteHD',id=ef45e338-a722-4d3a-a2eb-934d06e77c0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79e233ea9dbd4b0485bc05c628e52ff6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:13:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:13:52Z,use_quota=True,user_id='36c3979b00964ae7a93121c029911ce6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c065ddd2-ad11-47a9-bc96-25bae6320d6d),volume_type_id=c065ddd2-ad11-47a9-bc96-25bae6320d6d)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:13:51 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-f2734406-db70-425d-a20b-ebafd047900a tempest-GroupsTest-123402461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad5dd39b-31b9-43c7-931f-a7bc851f3f02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:13:51 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-f2734406-db70-425d-a20b-ebafd047900a tempest-GroupsTest-123402461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad5dd39b-31b9-43c7-931f-a7bc851f3f02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:13:51 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-f2734406-db70-425d-a20b-ebafd047900a tempest-GroupsTest-123402461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (155fbab5-4b71-4686-852e-6fe93f09f8bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:13:51 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-f2734406-db70-425d-a20b-ebafd047900a tempest-GroupsTest-123402461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (155fbab5-4b71-4686-852e-6fe93f09f8bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef45e338-a722-4d3a-a2eb-934d06e77c0c', 'volume_name': 'volume-ef45e338-a722-4d3a-a2eb-934d06e77c0c', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:13:51 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-f2734406-db70-425d-a20b-ebafd047900a tempest-GroupsTest-123402461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39426b81-9ea4-4822-bfe6-6924247ff711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:13:51 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-f2734406-db70-425d-a20b-ebafd047900a tempest-GroupsTest-123402461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39426b81-9ea4-4822-bfe6-6924247ff711) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:13:51 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-f2734406-db70-425d-a20b-ebafd047900a tempest-GroupsTest-123402461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7401334-4459-4545-b7fe-20e7c4ab4056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:13:51 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-f2734406-db70-425d-a20b-ebafd047900a tempest-GroupsTest-123402461 None] Volume ef45e338-a722-4d3a-a2eb-934d06e77c0c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef45e338-a722-4d3a-a2eb-934d06e77c0c', 'volume_size': 1} Aug 29 01:13:51 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-f2734406-db70-425d-a20b-ebafd047900a tempest-GroupsTest-123402461 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:13:51 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-f2734406-db70-425d-a20b-ebafd047900a tempest-GroupsTest-123402461 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:13:51 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-f2734406-db70-425d-a20b-ebafd047900a tempest-GroupsTest-123402461 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=ddb680da-98ec-47d8-b32a-c4bdde49831a,created_at=2026-08-28T23:13:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1436956954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ddb680da-98ec-47d8-b32a-c4bdde49831a,host='devstack@QuobyteHD#QuobyteHD',id=ef45e338-a722-4d3a-a2eb-934d06e77c0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79e233ea9dbd4b0485bc05c628e52ff6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:13:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:13:52Z,use_quota=True,user_id='36c3979b00964ae7a93121c029911ce6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c065ddd2-ad11-47a9-bc96-25bae6320d6d),volume_type_id=c065ddd2-ad11-47a9-bc96-25bae6320d6d)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:13:51 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-f2734406-db70-425d-a20b-ebafd047900a tempest-GroupsTest-123402461 None] Creating volume ef45e338-a722-4d3a-a2eb-934d06e77c0c {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:13:51 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-f2734406-db70-425d-a20b-ebafd047900a tempest-GroupsTest-123402461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:13:51 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-f2734406-db70-425d-a20b-ebafd047900a tempest-GroupsTest-123402461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:13:51 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-f2734406-db70-425d-a20b-ebafd047900a tempest-GroupsTest-123402461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:13:51 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-f2734406-db70-425d-a20b-ebafd047900a tempest-GroupsTest-123402461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:13:51 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-f2734406-db70-425d-a20b-ebafd047900a tempest-GroupsTest-123402461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:13:51 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-f2734406-db70-425d-a20b-ebafd047900a tempest-GroupsTest-123402461 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:13:51 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-f2734406-db70-425d-a20b-ebafd047900a tempest-GroupsTest-123402461 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:13:51 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-f2734406-db70-425d-a20b-ebafd047900a tempest-GroupsTest-123402461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ef45e338-a722-4d3a-a2eb-934d06e77c0c 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:13:52 devstack sudo[92232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ef45e338-a722-4d3a-a2eb-934d06e77c0c 1073741824 Aug 29 01:13:52 devstack sudo[92232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:13:52 devstack sudo[92232]: pam_unix(sudo:session): session closed for user root Aug 29 01:13:52 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-f2734406-db70-425d-a20b-ebafd047900a tempest-GroupsTest-123402461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ef45e338-a722-4d3a-a2eb-934d06e77c0c 1073741824" returned: 0 in 0.889s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:13:52 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-f2734406-db70-425d-a20b-ebafd047900a tempest-GroupsTest-123402461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ef45e338-a722-4d3a-a2eb-934d06e77c0c {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:13:53 devstack sudo[92258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ef45e338-a722-4d3a-a2eb-934d06e77c0c Aug 29 01:13:53 devstack sudo[92258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:13:53 devstack sudo[92258]: pam_unix(sudo:session): session closed for user root Aug 29 01:13:53 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-f2734406-db70-425d-a20b-ebafd047900a tempest-GroupsTest-123402461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ef45e338-a722-4d3a-a2eb-934d06e77c0c" returned: 0 in 0.493s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:13:53 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-f2734406-db70-425d-a20b-ebafd047900a tempest-GroupsTest-123402461 None] <== create_volume: return (1498ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:13:53 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-f2734406-db70-425d-a20b-ebafd047900a tempest-GroupsTest-123402461 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.503s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:13:53 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-f2734406-db70-425d-a20b-ebafd047900a tempest-GroupsTest-123402461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7401334-4459-4545-b7fe-20e7c4ab4056) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef45e338-a722-4d3a-a2eb-934d06e77c0c', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:13:53 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-f2734406-db70-425d-a20b-ebafd047900a tempest-GroupsTest-123402461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e35aa31-d89c-45d4-8816-d29ccf25a580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:13:53 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-f2734406-db70-425d-a20b-ebafd047900a tempest-GroupsTest-123402461 None] Volume volume-ef45e338-a722-4d3a-a2eb-934d06e77c0c (ef45e338-a722-4d3a-a2eb-934d06e77c0c): created successfully Aug 29 01:13:53 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-f2734406-db70-425d-a20b-ebafd047900a tempest-GroupsTest-123402461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e35aa31-d89c-45d4-8816-d29ccf25a580) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:13:53 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-f2734406-db70-425d-a20b-ebafd047900a tempest-GroupsTest-123402461 None] Flow 'volume_create_manager' (cccff1f8-c219-4272-ac4d-19e4e08be49e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:13:53 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-f2734406-db70-425d-a20b-ebafd047900a tempest-GroupsTest-123402461 None] Created volume successfully. Aug 29 01:13:55 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b52d580-2705-4a8a-bdce-dca26465b387 tempest-GroupsTest-123402461 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:13:55 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-2b52d580-2705-4a8a-bdce-dca26465b387 tempest-GroupsTest-123402461 None] Flow 'volume_create_manager' (d94ea4ad-333d-4e0a-abbd-3c098e1c6dc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:13:55 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-2b52d580-2705-4a8a-bdce-dca26465b387 tempest-GroupsTest-123402461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ba9f797-d6b4-422f-baf9-e4a1c9673257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:13:55 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-2b52d580-2705-4a8a-bdce-dca26465b387 tempest-GroupsTest-123402461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ba9f797-d6b4-422f-baf9-e4a1c9673257) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:13:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1520546990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ddb680da-98ec-47d8-b32a-c4bdde49831a,host='devstack@QuobyteHD#QuobyteHD',id=a4c40666-ba6b-46d0-a5c9-ade32041a15a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79e233ea9dbd4b0485bc05c628e52ff6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:13:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:13:55Z,use_quota=True,user_id='36c3979b00964ae7a93121c029911ce6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c065ddd2-ad11-47a9-bc96-25bae6320d6d),volume_type_id=c065ddd2-ad11-47a9-bc96-25bae6320d6d)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:13:55 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-2b52d580-2705-4a8a-bdce-dca26465b387 tempest-GroupsTest-123402461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85ea99c3-f5dc-4e65-9479-affd2469ec92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:13:55 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-2b52d580-2705-4a8a-bdce-dca26465b387 tempest-GroupsTest-123402461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85ea99c3-f5dc-4e65-9479-affd2469ec92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:13:55 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-2b52d580-2705-4a8a-bdce-dca26465b387 tempest-GroupsTest-123402461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb3b51d9-c289-4653-905e-89fe420448c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:13:55 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-2b52d580-2705-4a8a-bdce-dca26465b387 tempest-GroupsTest-123402461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb3b51d9-c289-4653-905e-89fe420448c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4c40666-ba6b-46d0-a5c9-ade32041a15a', 'volume_name': 'volume-a4c40666-ba6b-46d0-a5c9-ade32041a15a', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:13:55 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-2b52d580-2705-4a8a-bdce-dca26465b387 tempest-GroupsTest-123402461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5ce99f4-2237-4074-994a-4844510c046b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:13:55 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-2b52d580-2705-4a8a-bdce-dca26465b387 tempest-GroupsTest-123402461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5ce99f4-2237-4074-994a-4844510c046b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:13:55 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-2b52d580-2705-4a8a-bdce-dca26465b387 tempest-GroupsTest-123402461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13783bda-4e76-4fe1-b6ce-ae873d9362ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:13:55 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-2b52d580-2705-4a8a-bdce-dca26465b387 tempest-GroupsTest-123402461 None] Volume a4c40666-ba6b-46d0-a5c9-ade32041a15a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4c40666-ba6b-46d0-a5c9-ade32041a15a', 'volume_size': 1} Aug 29 01:13:55 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-2b52d580-2705-4a8a-bdce-dca26465b387 tempest-GroupsTest-123402461 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:13:55 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-2b52d580-2705-4a8a-bdce-dca26465b387 tempest-GroupsTest-123402461 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:13:55 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-2b52d580-2705-4a8a-bdce-dca26465b387 tempest-GroupsTest-123402461 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=ddb680da-98ec-47d8-b32a-c4bdde49831a,created_at=2026-08-28T23:13:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1520546990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ddb680da-98ec-47d8-b32a-c4bdde49831a,host='devstack@QuobyteHD#QuobyteHD',id=a4c40666-ba6b-46d0-a5c9-ade32041a15a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79e233ea9dbd4b0485bc05c628e52ff6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:13:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:13:55Z,use_quota=True,user_id='36c3979b00964ae7a93121c029911ce6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c065ddd2-ad11-47a9-bc96-25bae6320d6d),volume_type_id=c065ddd2-ad11-47a9-bc96-25bae6320d6d)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:13:55 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-2b52d580-2705-4a8a-bdce-dca26465b387 tempest-GroupsTest-123402461 None] Creating volume a4c40666-ba6b-46d0-a5c9-ade32041a15a {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:13:55 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-2b52d580-2705-4a8a-bdce-dca26465b387 tempest-GroupsTest-123402461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:13:55 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-2b52d580-2705-4a8a-bdce-dca26465b387 tempest-GroupsTest-123402461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:13:55 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-2b52d580-2705-4a8a-bdce-dca26465b387 tempest-GroupsTest-123402461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:13:55 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-2b52d580-2705-4a8a-bdce-dca26465b387 tempest-GroupsTest-123402461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:13:55 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-2b52d580-2705-4a8a-bdce-dca26465b387 tempest-GroupsTest-123402461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:13:55 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-2b52d580-2705-4a8a-bdce-dca26465b387 tempest-GroupsTest-123402461 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:13:55 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-2b52d580-2705-4a8a-bdce-dca26465b387 tempest-GroupsTest-123402461 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:13:55 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-2b52d580-2705-4a8a-bdce-dca26465b387 tempest-GroupsTest-123402461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a4c40666-ba6b-46d0-a5c9-ade32041a15a 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:13:55 devstack sudo[92332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a4c40666-ba6b-46d0-a5c9-ade32041a15a 1073741824 Aug 29 01:13:55 devstack sudo[92332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:13:56 devstack sudo[92332]: pam_unix(sudo:session): session closed for user root Aug 29 01:13:56 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-2b52d580-2705-4a8a-bdce-dca26465b387 tempest-GroupsTest-123402461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a4c40666-ba6b-46d0-a5c9-ade32041a15a 1073741824" returned: 0 in 0.915s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:13:56 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-2b52d580-2705-4a8a-bdce-dca26465b387 tempest-GroupsTest-123402461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a4c40666-ba6b-46d0-a5c9-ade32041a15a {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:13:56 devstack sudo[92339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a4c40666-ba6b-46d0-a5c9-ade32041a15a Aug 29 01:13:56 devstack sudo[92339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:13:57 devstack sudo[92339]: pam_unix(sudo:session): session closed for user root Aug 29 01:13:57 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-2b52d580-2705-4a8a-bdce-dca26465b387 tempest-GroupsTest-123402461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a4c40666-ba6b-46d0-a5c9-ade32041a15a" returned: 0 in 0.650s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:13:57 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-2b52d580-2705-4a8a-bdce-dca26465b387 tempest-GroupsTest-123402461 None] <== create_volume: return (1635ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:13:57 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-2b52d580-2705-4a8a-bdce-dca26465b387 tempest-GroupsTest-123402461 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.643s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:13:57 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-2b52d580-2705-4a8a-bdce-dca26465b387 tempest-GroupsTest-123402461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13783bda-4e76-4fe1-b6ce-ae873d9362ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4c40666-ba6b-46d0-a5c9-ade32041a15a', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:13:57 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-2b52d580-2705-4a8a-bdce-dca26465b387 tempest-GroupsTest-123402461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a010a57-55e5-45a4-b2f1-35c9f56e15c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:13:57 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-2b52d580-2705-4a8a-bdce-dca26465b387 tempest-GroupsTest-123402461 None] Volume volume-a4c40666-ba6b-46d0-a5c9-ade32041a15a (a4c40666-ba6b-46d0-a5c9-ade32041a15a): created successfully Aug 29 01:13:57 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-2b52d580-2705-4a8a-bdce-dca26465b387 tempest-GroupsTest-123402461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a010a57-55e5-45a4-b2f1-35c9f56e15c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:13:57 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-2b52d580-2705-4a8a-bdce-dca26465b387 tempest-GroupsTest-123402461 None] Flow 'volume_create_manager' (d94ea4ad-333d-4e0a-abbd-3c098e1c6dc6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:13:57 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-2b52d580-2705-4a8a-bdce-dca26465b387 tempest-GroupsTest-123402461 None] Created volume successfully. Aug 29 01:13:58 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-0bb3afc4-c99d-451f-b8ae-40a93e1fc601 tempest-GroupsTest-123402461 None] Update group completed successfully. Aug 29 01:14:00 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-c5f59989-889a-4cbc-afc1-68e1afd9f676 tempest-GroupsTest-123402461 None] Update group completed successfully. Aug 29 01:14:02 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-245e827f-ead6-48b7-894c-31967df9b5a5 tempest-GroupsTest-123402461 None] Acquiring lock "cinder-quobyte-a4c40666-ba6b-46d0-a5c9-ade32041a15a" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:14:02 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-245e827f-ead6-48b7-894c-31967df9b5a5 tempest-GroupsTest-123402461 None] Lock "cinder-quobyte-a4c40666-ba6b-46d0-a5c9-ade32041a15a" acquired by "delete_volume" :: waited 0.034s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:14:02 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd6f1c74-f405-45e4-aa2a-236d14ed519a]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:14:02 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-245e827f-ead6-48b7-894c-31967df9b5a5 tempest-GroupsTest-123402461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a4c40666-ba6b-46d0-a5c9-ade32041a15a {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:14:02 devstack sudo[92375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a4c40666-ba6b-46d0-a5c9-ade32041a15a Aug 29 01:14:02 devstack sudo[92375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:14:02 devstack sudo[92375]: pam_unix(sudo:session): session closed for user root Aug 29 01:14:02 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-245e827f-ead6-48b7-894c-31967df9b5a5 tempest-GroupsTest-123402461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a4c40666-ba6b-46d0-a5c9-ade32041a15a" returned: 0 in 0.450s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:14:02 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-245e827f-ead6-48b7-894c-31967df9b5a5 tempest-GroupsTest-123402461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a4c40666-ba6b-46d0-a5c9-ade32041a15a {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:14:02 devstack sudo[92381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a4c40666-ba6b-46d0-a5c9-ade32041a15a Aug 29 01:14:02 devstack sudo[92381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:14:03 devstack sudo[92381]: pam_unix(sudo:session): session closed for user root Aug 29 01:14:03 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-245e827f-ead6-48b7-894c-31967df9b5a5 tempest-GroupsTest-123402461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a4c40666-ba6b-46d0-a5c9-ade32041a15a" returned: 0 in 0.283s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:14:03 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-245e827f-ead6-48b7-894c-31967df9b5a5 tempest-GroupsTest-123402461 None] Lock "cinder-quobyte-a4c40666-ba6b-46d0-a5c9-ade32041a15a" released by "delete_volume" :: held 0.787s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:14:03 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-245e827f-ead6-48b7-894c-31967df9b5a5 tempest-GroupsTest-123402461 None] Acquiring lock "cinder-quobyte-ef45e338-a722-4d3a-a2eb-934d06e77c0c" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:14:03 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-245e827f-ead6-48b7-894c-31967df9b5a5 tempest-GroupsTest-123402461 None] Lock "cinder-quobyte-ef45e338-a722-4d3a-a2eb-934d06e77c0c" acquired by "delete_volume" :: waited 0.028s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:14:03 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[439cc99a-f49c-46ef-ad86-ee13a202a8df]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:14:03 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-245e827f-ead6-48b7-894c-31967df9b5a5 tempest-GroupsTest-123402461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ef45e338-a722-4d3a-a2eb-934d06e77c0c {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:14:03 devstack sudo[92384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ef45e338-a722-4d3a-a2eb-934d06e77c0c Aug 29 01:14:03 devstack sudo[92384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:14:03 devstack sudo[92384]: pam_unix(sudo:session): session closed for user root Aug 29 01:14:03 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-245e827f-ead6-48b7-894c-31967df9b5a5 tempest-GroupsTest-123402461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ef45e338-a722-4d3a-a2eb-934d06e77c0c" returned: 0 in 0.473s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:14:03 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-245e827f-ead6-48b7-894c-31967df9b5a5 tempest-GroupsTest-123402461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ef45e338-a722-4d3a-a2eb-934d06e77c0c {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:14:03 devstack sudo[92389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ef45e338-a722-4d3a-a2eb-934d06e77c0c Aug 29 01:14:03 devstack sudo[92389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:14:03 devstack sudo[92389]: pam_unix(sudo:session): session closed for user root Aug 29 01:14:03 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-245e827f-ead6-48b7-894c-31967df9b5a5 tempest-GroupsTest-123402461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ef45e338-a722-4d3a-a2eb-934d06e77c0c" returned: 0 in 0.259s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:14:04 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-245e827f-ead6-48b7-894c-31967df9b5a5 tempest-GroupsTest-123402461 None] Lock "cinder-quobyte-ef45e338-a722-4d3a-a2eb-934d06e77c0c" released by "delete_volume" :: held 0.786s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:14:04 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-245e827f-ead6-48b7-894c-31967df9b5a5 tempest-GroupsTest-123402461 None] Created reservations ['d455b2f8-d96d-4e87-b917-fb5f36994ebf'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:14:04 devstack cinder-volume[86111]: WARNING cinder.quota [None req-245e827f-ead6-48b7-894c-31967df9b5a5 tempest-GroupsTest-123402461 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1927770745 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1927770745, it is now deprecated. Please use the default quota class for default quota. Aug 29 01:14:04 devstack cinder-volume[86111]: WARNING cinder.quota [None req-245e827f-ead6-48b7-894c-31967df9b5a5 tempest-GroupsTest-123402461 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1927770745 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1927770745, it is now deprecated. Please use the default quota class for default quota. Aug 29 01:14:04 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-245e827f-ead6-48b7-894c-31967df9b5a5 tempest-GroupsTest-123402461 None] Created reservations ['4a4840da-90ea-4db5-9e95-3b5a0ce05d0c', '9eb72e5f-0fff-4df0-8da5-087e07b56ac9', '676d2a37-c806-4df9-a0d7-259321a2fb52', '0b78574b-5386-4818-9e54-3f38592155ed'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:14:04 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-245e827f-ead6-48b7-894c-31967df9b5a5 tempest-GroupsTest-123402461 None] Created reservations ['9b7b4192-62aa-416b-a061-731045e0c36a', 'f3ffe820-b331-4641-b282-aaff8d15fefc', '89e694b6-f9a2-4d4e-9341-1103102df6a4', 'dce3819b-2b09-4432-9457-ee17ac12a21f'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:14:04 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-245e827f-ead6-48b7-894c-31967df9b5a5 tempest-GroupsTest-123402461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:14:04 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-245e827f-ead6-48b7-894c-31967df9b5a5 tempest-GroupsTest-123402461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:14:04 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-245e827f-ead6-48b7-894c-31967df9b5a5 tempest-GroupsTest-123402461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:14:04 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-245e827f-ead6-48b7-894c-31967df9b5a5 tempest-GroupsTest-123402461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:14:04 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-245e827f-ead6-48b7-894c-31967df9b5a5 tempest-GroupsTest-123402461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:14:04 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-245e827f-ead6-48b7-894c-31967df9b5a5 tempest-GroupsTest-123402461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:14:04 devstack sudo[92392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:14:04 devstack sudo[92392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:14:04 devstack sudo[92392]: pam_unix(sudo:session): session closed for user root Aug 29 01:14:04 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-245e827f-ead6-48b7-894c-31967df9b5a5 tempest-GroupsTest-123402461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.299s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:14:04 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-245e827f-ead6-48b7-894c-31967df9b5a5 tempest-GroupsTest-123402461 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:14:04 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-245e827f-ead6-48b7-894c-31967df9b5a5 tempest-GroupsTest-123402461 None] Delete group completed successfully. Aug 29 01:14:14 devstack cinder-volume[86111]: DEBUG dbcounter [-] [86111] Writing DB stats cinder:SELECT=62,cinder:UPDATE=81,cinder:DELETE=4,cinder:INSERT=7 {{(pid=86111) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 29 01:14:14 devstack cinder-volume[86111]: DEBUG dbcounter [-] [86111] Writing DB stats cinder:SELECT=80,cinder:UPDATE=53,cinder:INSERT=17,cinder:DELETE=2 {{(pid=86111) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 29 01:14:15 devstack cinder-volume[86111]: INFO cinder.volume.manager [req-4b821770-5cca-4767-8126-91ec0de3291c req-e40beb5e-c48d-46c9-b859-bdda69314465 tempest-ServerActionsTestOtherA-1708480225 None] Terminate volume connection completed successfully. Aug 29 01:14:15 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [req-4b821770-5cca-4767-8126-91ec0de3291c req-e40beb5e-c48d-46c9-b859-bdda69314465 tempest-ServerActionsTestOtherA-1708480225 None] Deleting attachment 14ae41d4-b50d-4b9f-bf8c-374e87afadb6. {{(pid=86111) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 29 01:14:15 devstack cinder-volume[86111]: DEBUG cinder.coordination [req-4b821770-5cca-4767-8126-91ec0de3291c req-e5991be2-eb3d-48bd-8148-ff950d6768d0 tempest-ServerActionsTestOtherA-1708480225 None] Acquiring lock "cinder-0e86a809-e98d-46fc-a23a-1530583abff1-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:14:15 devstack cinder-volume[86111]: DEBUG cinder.coordination [req-4b821770-5cca-4767-8126-91ec0de3291c req-e5991be2-eb3d-48bd-8148-ff950d6768d0 tempest-ServerActionsTestOtherA-1708480225 None] Lock "cinder-0e86a809-e98d-46fc-a23a-1530583abff1-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:14:15 devstack cinder-volume[86111]: DEBUG cinder.coordination [req-4b821770-5cca-4767-8126-91ec0de3291c req-e5991be2-eb3d-48bd-8148-ff950d6768d0 tempest-ServerActionsTestOtherA-1708480225 None] Acquiring lock "cinder-quobyte-0e86a809-e98d-46fc-a23a-1530583abff1" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:14:15 devstack cinder-volume[86111]: DEBUG cinder.coordination [req-4b821770-5cca-4767-8126-91ec0de3291c req-e5991be2-eb3d-48bd-8148-ff950d6768d0 tempest-ServerActionsTestOtherA-1708480225 None] Lock "cinder-quobyte-0e86a809-e98d-46fc-a23a-1530583abff1" acquired by "delete_volume" :: waited 0.024s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:14:15 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[73e84dc0-58be-42e1-81e0-48f973502b6d]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:14:15 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [req-4b821770-5cca-4767-8126-91ec0de3291c req-e5991be2-eb3d-48bd-8148-ff950d6768d0 tempest-ServerActionsTestOtherA-1708480225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-0e86a809-e98d-46fc-a23a-1530583abff1 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:14:15 devstack sudo[92443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-0e86a809-e98d-46fc-a23a-1530583abff1 Aug 29 01:14:15 devstack sudo[92443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:14:16 devstack sudo[92443]: pam_unix(sudo:session): session closed for user root Aug 29 01:14:16 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [req-4b821770-5cca-4767-8126-91ec0de3291c req-e5991be2-eb3d-48bd-8148-ff950d6768d0 tempest-ServerActionsTestOtherA-1708480225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-0e86a809-e98d-46fc-a23a-1530583abff1" returned: 0 in 0.568s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:14:16 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [req-4b821770-5cca-4767-8126-91ec0de3291c req-e5991be2-eb3d-48bd-8148-ff950d6768d0 tempest-ServerActionsTestOtherA-1708480225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-0e86a809-e98d-46fc-a23a-1530583abff1 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:14:16 devstack sudo[92448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-0e86a809-e98d-46fc-a23a-1530583abff1 Aug 29 01:14:16 devstack sudo[92448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:14:16 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-f8198591-b1a2-48ba-a0dd-9408e164e89d tempest-ServerActionsTestOtherA-1708480225 None] Acquiring lock "cinder-9af8977b-2315-4371-8d6a-87bcad5bc11f-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:14:16 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-f8198591-b1a2-48ba-a0dd-9408e164e89d tempest-ServerActionsTestOtherA-1708480225 None] Lock "cinder-9af8977b-2315-4371-8d6a-87bcad5bc11f-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:14:16 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-f8198591-b1a2-48ba-a0dd-9408e164e89d tempest-ServerActionsTestOtherA-1708480225 None] Acquiring lock "cinder-quobyte-9af8977b-2315-4371-8d6a-87bcad5bc11f" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:14:16 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-f8198591-b1a2-48ba-a0dd-9408e164e89d tempest-ServerActionsTestOtherA-1708480225 None] Lock "cinder-quobyte-9af8977b-2315-4371-8d6a-87bcad5bc11f" acquired by "delete_volume" :: waited 0.040s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:14:16 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdf35f30-40db-4d31-a792-0e3fd92e0c20]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:14:16 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-f8198591-b1a2-48ba-a0dd-9408e164e89d tempest-ServerActionsTestOtherA-1708480225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-9af8977b-2315-4371-8d6a-87bcad5bc11f {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:14:16 devstack sudo[92448]: pam_unix(sudo:session): session closed for user root Aug 29 01:14:16 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [req-4b821770-5cca-4767-8126-91ec0de3291c req-e5991be2-eb3d-48bd-8148-ff950d6768d0 tempest-ServerActionsTestOtherA-1708480225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-0e86a809-e98d-46fc-a23a-1530583abff1" returned: 0 in 0.546s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:14:16 devstack cinder-volume[86111]: DEBUG cinder.coordination [req-4b821770-5cca-4767-8126-91ec0de3291c req-e5991be2-eb3d-48bd-8148-ff950d6768d0 tempest-ServerActionsTestOtherA-1708480225 None] Lock "cinder-quobyte-0e86a809-e98d-46fc-a23a-1530583abff1" released by "delete_volume" :: held 1.206s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:14:16 devstack cinder-volume[86111]: DEBUG cinder.quota [req-4b821770-5cca-4767-8126-91ec0de3291c req-e5991be2-eb3d-48bd-8148-ff950d6768d0 tempest-ServerActionsTestOtherA-1708480225 None] Created reservations ['bd343615-f8ff-4e1a-b5dd-955a52f3d605', 'd3f198b2-b0a5-491d-94ee-15bb26186934', 'dc474125-f31e-432f-b2e9-1cdfafe9b25e', '2ac421fe-ffb2-45ba-b072-5b9b6ca3f50f'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:14:16 devstack sudo[92451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-9af8977b-2315-4371-8d6a-87bcad5bc11f Aug 29 01:14:16 devstack sudo[92451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:14:16 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [req-4b821770-5cca-4767-8126-91ec0de3291c req-e5991be2-eb3d-48bd-8148-ff950d6768d0 tempest-ServerActionsTestOtherA-1708480225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:14:16 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [req-4b821770-5cca-4767-8126-91ec0de3291c req-e5991be2-eb3d-48bd-8148-ff950d6768d0 tempest-ServerActionsTestOtherA-1708480225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:14:16 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [req-4b821770-5cca-4767-8126-91ec0de3291c req-e5991be2-eb3d-48bd-8148-ff950d6768d0 tempest-ServerActionsTestOtherA-1708480225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:14:16 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [req-4b821770-5cca-4767-8126-91ec0de3291c req-e5991be2-eb3d-48bd-8148-ff950d6768d0 tempest-ServerActionsTestOtherA-1708480225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:14:16 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [req-4b821770-5cca-4767-8126-91ec0de3291c req-e5991be2-eb3d-48bd-8148-ff950d6768d0 tempest-ServerActionsTestOtherA-1708480225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:14:16 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [req-4b821770-5cca-4767-8126-91ec0de3291c req-e5991be2-eb3d-48bd-8148-ff950d6768d0 tempest-ServerActionsTestOtherA-1708480225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:14:17 devstack sudo[92453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:14:17 devstack sudo[92453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:14:17 devstack sudo[92451]: pam_unix(sudo:session): session closed for user root Aug 29 01:14:17 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-f8198591-b1a2-48ba-a0dd-9408e164e89d tempest-ServerActionsTestOtherA-1708480225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-9af8977b-2315-4371-8d6a-87bcad5bc11f" returned: 0 in 1.007s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:14:17 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-f8198591-b1a2-48ba-a0dd-9408e164e89d tempest-ServerActionsTestOtherA-1708480225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-9af8977b-2315-4371-8d6a-87bcad5bc11f {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:14:17 devstack sudo[92453]: pam_unix(sudo:session): session closed for user root Aug 29 01:14:17 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [req-4b821770-5cca-4767-8126-91ec0de3291c req-e5991be2-eb3d-48bd-8148-ff950d6768d0 tempest-ServerActionsTestOtherA-1708480225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.637s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:14:17 devstack cinder-volume[86111]: DEBUG cinder.manager [req-4b821770-5cca-4767-8126-91ec0de3291c req-e5991be2-eb3d-48bd-8148-ff950d6768d0 tempest-ServerActionsTestOtherA-1708480225 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:14:17 devstack sudo[92474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-9af8977b-2315-4371-8d6a-87bcad5bc11f Aug 29 01:14:17 devstack sudo[92474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:14:17 devstack cinder-volume[86111]: INFO cinder.volume.manager [req-4b821770-5cca-4767-8126-91ec0de3291c req-e5991be2-eb3d-48bd-8148-ff950d6768d0 tempest-ServerActionsTestOtherA-1708480225 None] Deleted volume successfully. Aug 29 01:14:17 devstack cinder-volume[86111]: DEBUG cinder.coordination [req-4b821770-5cca-4767-8126-91ec0de3291c req-e5991be2-eb3d-48bd-8148-ff950d6768d0 tempest-ServerActionsTestOtherA-1708480225 None] Lock "cinder-0e86a809-e98d-46fc-a23a-1530583abff1-delete_volume" released by "delete_volume" :: held 2.327s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:14:17 devstack sudo[92474]: pam_unix(sudo:session): session closed for user root Aug 29 01:14:17 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-f8198591-b1a2-48ba-a0dd-9408e164e89d tempest-ServerActionsTestOtherA-1708480225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-9af8977b-2315-4371-8d6a-87bcad5bc11f" returned: 0 in 0.378s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:14:17 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-f8198591-b1a2-48ba-a0dd-9408e164e89d tempest-ServerActionsTestOtherA-1708480225 None] Lock "cinder-quobyte-9af8977b-2315-4371-8d6a-87bcad5bc11f" released by "delete_volume" :: held 1.470s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:14:18 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-f8198591-b1a2-48ba-a0dd-9408e164e89d tempest-ServerActionsTestOtherA-1708480225 None] Created reservations ['45783b88-7dd2-4f35-87fa-c728103eefe3', 'ca2b14c0-dbbf-461c-9e23-5cee9b409f28', '9d39e3f8-20de-4a47-9e89-5f97f9d82107', '9b310420-8c4d-49be-846a-9c69da13807d'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:14:18 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-f8198591-b1a2-48ba-a0dd-9408e164e89d tempest-ServerActionsTestOtherA-1708480225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:14:18 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-f8198591-b1a2-48ba-a0dd-9408e164e89d tempest-ServerActionsTestOtherA-1708480225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:14:18 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-f8198591-b1a2-48ba-a0dd-9408e164e89d tempest-ServerActionsTestOtherA-1708480225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:14:18 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-f8198591-b1a2-48ba-a0dd-9408e164e89d tempest-ServerActionsTestOtherA-1708480225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:14:18 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-f8198591-b1a2-48ba-a0dd-9408e164e89d tempest-ServerActionsTestOtherA-1708480225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:14:18 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-f8198591-b1a2-48ba-a0dd-9408e164e89d tempest-ServerActionsTestOtherA-1708480225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:14:18 devstack sudo[92481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:14:18 devstack sudo[92481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:14:18 devstack sudo[92481]: pam_unix(sudo:session): session closed for user root Aug 29 01:14:18 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-f8198591-b1a2-48ba-a0dd-9408e164e89d tempest-ServerActionsTestOtherA-1708480225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.356s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:14:18 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-f8198591-b1a2-48ba-a0dd-9408e164e89d tempest-ServerActionsTestOtherA-1708480225 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:14:18 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-f8198591-b1a2-48ba-a0dd-9408e164e89d tempest-ServerActionsTestOtherA-1708480225 None] Deleted volume successfully. Aug 29 01:14:18 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-f8198591-b1a2-48ba-a0dd-9408e164e89d tempest-ServerActionsTestOtherA-1708480225 None] Lock "cinder-9af8977b-2315-4371-8d6a-87bcad5bc11f-delete_volume" released by "delete_volume" :: held 2.221s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:14:18 devstack cinder-volume[86111]: INFO cinder.volume.manager [req-8fc8445e-c0e0-4c24-a756-1761ff1d39bf req-4e33e84b-51d0-4c1c-bbcf-9b2c85990ab3 tempest-AttachVolumeTestJSON-257506515 None] Terminate volume connection completed successfully. Aug 29 01:14:18 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [req-8fc8445e-c0e0-4c24-a756-1761ff1d39bf req-4e33e84b-51d0-4c1c-bbcf-9b2c85990ab3 tempest-AttachVolumeTestJSON-257506515 None] Deleting attachment f9f47ded-3d40-478b-a180-04e539607432. {{(pid=86111) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 29 01:14:24 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-61ff3e53-695a-41b9-94ab-3988f5fce64d tempest-VolumesServicesTestJSON-1970592385 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:14:24 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-61ff3e53-695a-41b9-94ab-3988f5fce64d tempest-VolumesServicesTestJSON-1970592385 None] Flow 'volume_create_manager' (38db8116-d73f-4a7a-873d-dd0e050fbe45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:14:24 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-61ff3e53-695a-41b9-94ab-3988f5fce64d tempest-VolumesServicesTestJSON-1970592385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40aaaa9b-b9d4-43bf-bfd5-d4a0bd67c26f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:14:24 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-61ff3e53-695a-41b9-94ab-3988f5fce64d tempest-VolumesServicesTestJSON-1970592385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40aaaa9b-b9d4-43bf-bfd5-d4a0bd67c26f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:14:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-891804424',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77f6159d-3ae2-42e1-9e0d-632e46cd93b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9a2d20d320840a48eecd4935552d46d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:14:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:14:24Z,use_quota=True,user_id='89e58691ac044547b93e912a96130b94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:14:24 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-61ff3e53-695a-41b9-94ab-3988f5fce64d tempest-VolumesServicesTestJSON-1970592385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6f16f80-fb80-40be-a79d-5ef9342b8a41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:14:24 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-61ff3e53-695a-41b9-94ab-3988f5fce64d tempest-VolumesServicesTestJSON-1970592385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6f16f80-fb80-40be-a79d-5ef9342b8a41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:14:24 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-61ff3e53-695a-41b9-94ab-3988f5fce64d tempest-VolumesServicesTestJSON-1970592385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1e97348-dc43-49eb-97a3-a0a26bfdac14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:14:24 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-61ff3e53-695a-41b9-94ab-3988f5fce64d tempest-VolumesServicesTestJSON-1970592385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1e97348-dc43-49eb-97a3-a0a26bfdac14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77f6159d-3ae2-42e1-9e0d-632e46cd93b6', 'volume_name': 'volume-77f6159d-3ae2-42e1-9e0d-632e46cd93b6', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:14:24 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-61ff3e53-695a-41b9-94ab-3988f5fce64d tempest-VolumesServicesTestJSON-1970592385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28ab482a-7f3a-4309-b9cd-0bed97451f87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:14:24 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-61ff3e53-695a-41b9-94ab-3988f5fce64d tempest-VolumesServicesTestJSON-1970592385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28ab482a-7f3a-4309-b9cd-0bed97451f87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:14:24 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-61ff3e53-695a-41b9-94ab-3988f5fce64d tempest-VolumesServicesTestJSON-1970592385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba5bd64f-5e35-4a8c-9243-67f7fbe73ddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:14:24 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-61ff3e53-695a-41b9-94ab-3988f5fce64d tempest-VolumesServicesTestJSON-1970592385 None] Volume 77f6159d-3ae2-42e1-9e0d-632e46cd93b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77f6159d-3ae2-42e1-9e0d-632e46cd93b6', 'volume_size': 1} Aug 29 01:14:24 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-61ff3e53-695a-41b9-94ab-3988f5fce64d tempest-VolumesServicesTestJSON-1970592385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:14:24 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-61ff3e53-695a-41b9-94ab-3988f5fce64d tempest-VolumesServicesTestJSON-1970592385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:14:24 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-61ff3e53-695a-41b9-94ab-3988f5fce64d tempest-VolumesServicesTestJSON-1970592385 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:14:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-891804424',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77f6159d-3ae2-42e1-9e0d-632e46cd93b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9a2d20d320840a48eecd4935552d46d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:14:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:14:24Z,use_quota=True,user_id='89e58691ac044547b93e912a96130b94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:14:24 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-61ff3e53-695a-41b9-94ab-3988f5fce64d tempest-VolumesServicesTestJSON-1970592385 None] Creating volume 77f6159d-3ae2-42e1-9e0d-632e46cd93b6 {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:14:24 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-61ff3e53-695a-41b9-94ab-3988f5fce64d tempest-VolumesServicesTestJSON-1970592385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:14:24 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-61ff3e53-695a-41b9-94ab-3988f5fce64d tempest-VolumesServicesTestJSON-1970592385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:14:24 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-61ff3e53-695a-41b9-94ab-3988f5fce64d tempest-VolumesServicesTestJSON-1970592385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:14:24 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-61ff3e53-695a-41b9-94ab-3988f5fce64d tempest-VolumesServicesTestJSON-1970592385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:14:24 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-61ff3e53-695a-41b9-94ab-3988f5fce64d tempest-VolumesServicesTestJSON-1970592385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:14:24 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-61ff3e53-695a-41b9-94ab-3988f5fce64d tempest-VolumesServicesTestJSON-1970592385 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:14:24 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-61ff3e53-695a-41b9-94ab-3988f5fce64d tempest-VolumesServicesTestJSON-1970592385 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:14:24 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-61ff3e53-695a-41b9-94ab-3988f5fce64d tempest-VolumesServicesTestJSON-1970592385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-77f6159d-3ae2-42e1-9e0d-632e46cd93b6 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:14:24 devstack sudo[92633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-77f6159d-3ae2-42e1-9e0d-632e46cd93b6 1073741824 Aug 29 01:14:24 devstack sudo[92633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:14:24 devstack sudo[92633]: pam_unix(sudo:session): session closed for user root Aug 29 01:14:24 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-61ff3e53-695a-41b9-94ab-3988f5fce64d tempest-VolumesServicesTestJSON-1970592385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-77f6159d-3ae2-42e1-9e0d-632e46cd93b6 1073741824" returned: 0 in 0.705s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:14:24 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-61ff3e53-695a-41b9-94ab-3988f5fce64d tempest-VolumesServicesTestJSON-1970592385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-77f6159d-3ae2-42e1-9e0d-632e46cd93b6 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:14:25 devstack sudo[92640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-77f6159d-3ae2-42e1-9e0d-632e46cd93b6 Aug 29 01:14:25 devstack sudo[92640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:14:25 devstack sudo[92640]: pam_unix(sudo:session): session closed for user root Aug 29 01:14:25 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-61ff3e53-695a-41b9-94ab-3988f5fce64d tempest-VolumesServicesTestJSON-1970592385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-77f6159d-3ae2-42e1-9e0d-632e46cd93b6" returned: 0 in 0.397s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:14:25 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-61ff3e53-695a-41b9-94ab-3988f5fce64d tempest-VolumesServicesTestJSON-1970592385 None] <== create_volume: return (1193ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:14:25 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-61ff3e53-695a-41b9-94ab-3988f5fce64d tempest-VolumesServicesTestJSON-1970592385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.201s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:14:25 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-61ff3e53-695a-41b9-94ab-3988f5fce64d tempest-VolumesServicesTestJSON-1970592385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba5bd64f-5e35-4a8c-9243-67f7fbe73ddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77f6159d-3ae2-42e1-9e0d-632e46cd93b6', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:14:25 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-61ff3e53-695a-41b9-94ab-3988f5fce64d tempest-VolumesServicesTestJSON-1970592385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (402ab742-8cd3-4371-ac5e-3810faff4d54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:14:25 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-61ff3e53-695a-41b9-94ab-3988f5fce64d tempest-VolumesServicesTestJSON-1970592385 None] Volume volume-77f6159d-3ae2-42e1-9e0d-632e46cd93b6 (77f6159d-3ae2-42e1-9e0d-632e46cd93b6): created successfully Aug 29 01:14:25 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-61ff3e53-695a-41b9-94ab-3988f5fce64d tempest-VolumesServicesTestJSON-1970592385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (402ab742-8cd3-4371-ac5e-3810faff4d54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:14:25 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-61ff3e53-695a-41b9-94ab-3988f5fce64d tempest-VolumesServicesTestJSON-1970592385 None] Flow 'volume_create_manager' (38db8116-d73f-4a7a-873d-dd0e050fbe45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:14:25 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-61ff3e53-695a-41b9-94ab-3988f5fce64d tempest-VolumesServicesTestJSON-1970592385 None] Created volume successfully. Aug 29 01:14:26 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-6a60ce43-7835-49dd-b7e8-415959334370 tempest-VolumesServicesTestJSON-1970592385 None] Acquiring lock "cinder-77f6159d-3ae2-42e1-9e0d-632e46cd93b6-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:14:26 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-6a60ce43-7835-49dd-b7e8-415959334370 tempest-VolumesServicesTestJSON-1970592385 None] Lock "cinder-77f6159d-3ae2-42e1-9e0d-632e46cd93b6-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:14:26 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-6a60ce43-7835-49dd-b7e8-415959334370 tempest-VolumesServicesTestJSON-1970592385 None] Acquiring lock "cinder-quobyte-77f6159d-3ae2-42e1-9e0d-632e46cd93b6" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:14:26 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-6a60ce43-7835-49dd-b7e8-415959334370 tempest-VolumesServicesTestJSON-1970592385 None] Lock "cinder-quobyte-77f6159d-3ae2-42e1-9e0d-632e46cd93b6" acquired by "delete_volume" :: waited 0.032s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:14:26 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d669dd9-ffb6-4bcc-b32f-281219e07124]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:14:26 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-6a60ce43-7835-49dd-b7e8-415959334370 tempest-VolumesServicesTestJSON-1970592385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-77f6159d-3ae2-42e1-9e0d-632e46cd93b6 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:14:27 devstack sudo[92664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-77f6159d-3ae2-42e1-9e0d-632e46cd93b6 Aug 29 01:14:27 devstack sudo[92664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:14:27 devstack sudo[92664]: pam_unix(sudo:session): session closed for user root Aug 29 01:14:27 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-6a60ce43-7835-49dd-b7e8-415959334370 tempest-VolumesServicesTestJSON-1970592385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-77f6159d-3ae2-42e1-9e0d-632e46cd93b6" returned: 0 in 0.629s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:14:27 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-6a60ce43-7835-49dd-b7e8-415959334370 tempest-VolumesServicesTestJSON-1970592385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-77f6159d-3ae2-42e1-9e0d-632e46cd93b6 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:14:27 devstack sudo[92678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-77f6159d-3ae2-42e1-9e0d-632e46cd93b6 Aug 29 01:14:27 devstack sudo[92678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:14:28 devstack sudo[92678]: pam_unix(sudo:session): session closed for user root Aug 29 01:14:28 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-6a60ce43-7835-49dd-b7e8-415959334370 tempest-VolumesServicesTestJSON-1970592385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-77f6159d-3ae2-42e1-9e0d-632e46cd93b6" returned: 0 in 0.566s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:14:28 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-6a60ce43-7835-49dd-b7e8-415959334370 tempest-VolumesServicesTestJSON-1970592385 None] Lock "cinder-quobyte-77f6159d-3ae2-42e1-9e0d-632e46cd93b6" released by "delete_volume" :: held 1.295s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:14:28 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-6a60ce43-7835-49dd-b7e8-415959334370 tempest-VolumesServicesTestJSON-1970592385 None] Created reservations ['fe17df26-a677-4929-971c-e1a3ca5f84ab', 'e172b075-203d-4f5b-80e0-b200493a8f87', '6744358a-7857-4df9-9f35-ee45f3e95a4e', '1f63bc75-a351-4d24-bbff-4742010badb2'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:14:28 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-6a60ce43-7835-49dd-b7e8-415959334370 tempest-VolumesServicesTestJSON-1970592385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:14:28 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-6a60ce43-7835-49dd-b7e8-415959334370 tempest-VolumesServicesTestJSON-1970592385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:14:28 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-6a60ce43-7835-49dd-b7e8-415959334370 tempest-VolumesServicesTestJSON-1970592385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:14:28 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-6a60ce43-7835-49dd-b7e8-415959334370 tempest-VolumesServicesTestJSON-1970592385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:14:28 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-6a60ce43-7835-49dd-b7e8-415959334370 tempest-VolumesServicesTestJSON-1970592385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:14:28 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-6a60ce43-7835-49dd-b7e8-415959334370 tempest-VolumesServicesTestJSON-1970592385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:14:28 devstack sudo[92733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:14:28 devstack sudo[92733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:14:29 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-53dfa617-8261-4eba-a839-60dee3f515a7 tempest-VolumesActionsTest-728309357 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:14:29 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-53dfa617-8261-4eba-a839-60dee3f515a7 tempest-VolumesActionsTest-728309357 None] Flow 'volume_create_manager' (550c5392-6f3c-4568-bbc3-3bbbabd8dce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:14:29 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-53dfa617-8261-4eba-a839-60dee3f515a7 tempest-VolumesActionsTest-728309357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb756d7f-c62e-4d2d-974f-08b3a413cd98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:14:29 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-53dfa617-8261-4eba-a839-60dee3f515a7 tempest-VolumesActionsTest-728309357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb756d7f-c62e-4d2d-974f-08b3a413cd98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:14:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-839515765',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee7523d0-cc69-4198-84d4-bc51b4e90295,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6ee2a844fb74fa88050b13a10c9487f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:14:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:14:29Z,use_quota=True,user_id='d5d10b5589044eaf81e496cca37ae3b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:14:29 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-53dfa617-8261-4eba-a839-60dee3f515a7 tempest-VolumesActionsTest-728309357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1693f193-bccc-493e-8fd3-d60f1ffc99ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:14:29 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-53dfa617-8261-4eba-a839-60dee3f515a7 tempest-VolumesActionsTest-728309357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1693f193-bccc-493e-8fd3-d60f1ffc99ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:14:29 devstack sudo[92733]: pam_unix(sudo:session): session closed for user root Aug 29 01:14:29 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-53dfa617-8261-4eba-a839-60dee3f515a7 tempest-VolumesActionsTest-728309357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3333c8eb-4f0a-4c18-b2f2-33bb7c2c1640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:14:29 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-53dfa617-8261-4eba-a839-60dee3f515a7 tempest-VolumesActionsTest-728309357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3333c8eb-4f0a-4c18-b2f2-33bb7c2c1640) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee7523d0-cc69-4198-84d4-bc51b4e90295', 'volume_name': 'volume-ee7523d0-cc69-4198-84d4-bc51b4e90295', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:14:29 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-53dfa617-8261-4eba-a839-60dee3f515a7 tempest-VolumesActionsTest-728309357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33377f75-798c-4165-8955-fa26e1dcc7aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:14:29 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-53dfa617-8261-4eba-a839-60dee3f515a7 tempest-VolumesActionsTest-728309357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33377f75-798c-4165-8955-fa26e1dcc7aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:14:29 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-53dfa617-8261-4eba-a839-60dee3f515a7 tempest-VolumesActionsTest-728309357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (079c8864-2e8b-4219-9156-6863310471dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:14:29 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-53dfa617-8261-4eba-a839-60dee3f515a7 tempest-VolumesActionsTest-728309357 None] Volume ee7523d0-cc69-4198-84d4-bc51b4e90295: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee7523d0-cc69-4198-84d4-bc51b4e90295', 'volume_size': 1} Aug 29 01:14:29 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-53dfa617-8261-4eba-a839-60dee3f515a7 tempest-VolumesActionsTest-728309357 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:14:29 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-53dfa617-8261-4eba-a839-60dee3f515a7 tempest-VolumesActionsTest-728309357 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:14:29 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-53dfa617-8261-4eba-a839-60dee3f515a7 tempest-VolumesActionsTest-728309357 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:14:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-839515765',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee7523d0-cc69-4198-84d4-bc51b4e90295,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6ee2a844fb74fa88050b13a10c9487f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:14:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:14:29Z,use_quota=True,user_id='d5d10b5589044eaf81e496cca37ae3b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:14:29 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-53dfa617-8261-4eba-a839-60dee3f515a7 tempest-VolumesActionsTest-728309357 None] Creating volume ee7523d0-cc69-4198-84d4-bc51b4e90295 {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:14:29 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-53dfa617-8261-4eba-a839-60dee3f515a7 tempest-VolumesActionsTest-728309357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:14:29 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-53dfa617-8261-4eba-a839-60dee3f515a7 tempest-VolumesActionsTest-728309357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:14:29 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-53dfa617-8261-4eba-a839-60dee3f515a7 tempest-VolumesActionsTest-728309357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:14:29 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-53dfa617-8261-4eba-a839-60dee3f515a7 tempest-VolumesActionsTest-728309357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:14:29 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-53dfa617-8261-4eba-a839-60dee3f515a7 tempest-VolumesActionsTest-728309357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:14:29 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-53dfa617-8261-4eba-a839-60dee3f515a7 tempest-VolumesActionsTest-728309357 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:14:29 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-53dfa617-8261-4eba-a839-60dee3f515a7 tempest-VolumesActionsTest-728309357 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:14:29 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-53dfa617-8261-4eba-a839-60dee3f515a7 tempest-VolumesActionsTest-728309357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ee7523d0-cc69-4198-84d4-bc51b4e90295 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:14:29 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-6a60ce43-7835-49dd-b7e8-415959334370 tempest-VolumesServicesTestJSON-1970592385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.634s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:14:29 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-6a60ce43-7835-49dd-b7e8-415959334370 tempest-VolumesServicesTestJSON-1970592385 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:14:29 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-6a60ce43-7835-49dd-b7e8-415959334370 tempest-VolumesServicesTestJSON-1970592385 None] Deleted volume successfully. Aug 29 01:14:29 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-6a60ce43-7835-49dd-b7e8-415959334370 tempest-VolumesServicesTestJSON-1970592385 None] Lock "cinder-77f6159d-3ae2-42e1-9e0d-632e46cd93b6-delete_volume" released by "delete_volume" :: held 2.491s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:14:29 devstack sudo[92742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ee7523d0-cc69-4198-84d4-bc51b4e90295 1073741824 Aug 29 01:14:29 devstack sudo[92742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:14:30 devstack sudo[92742]: pam_unix(sudo:session): session closed for user root Aug 29 01:14:30 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-53dfa617-8261-4eba-a839-60dee3f515a7 tempest-VolumesActionsTest-728309357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ee7523d0-cc69-4198-84d4-bc51b4e90295 1073741824" returned: 0 in 1.329s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:14:30 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-53dfa617-8261-4eba-a839-60dee3f515a7 tempest-VolumesActionsTest-728309357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ee7523d0-cc69-4198-84d4-bc51b4e90295 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:14:30 devstack sudo[92759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ee7523d0-cc69-4198-84d4-bc51b4e90295 Aug 29 01:14:30 devstack sudo[92759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:14:31 devstack sudo[92759]: pam_unix(sudo:session): session closed for user root Aug 29 01:14:31 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-53dfa617-8261-4eba-a839-60dee3f515a7 tempest-VolumesActionsTest-728309357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ee7523d0-cc69-4198-84d4-bc51b4e90295" returned: 0 in 0.446s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:14:31 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-53dfa617-8261-4eba-a839-60dee3f515a7 tempest-VolumesActionsTest-728309357 None] <== create_volume: return (1873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:14:31 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-53dfa617-8261-4eba-a839-60dee3f515a7 tempest-VolumesActionsTest-728309357 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.879s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:14:31 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-53dfa617-8261-4eba-a839-60dee3f515a7 tempest-VolumesActionsTest-728309357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (079c8864-2e8b-4219-9156-6863310471dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee7523d0-cc69-4198-84d4-bc51b4e90295', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:14:31 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-53dfa617-8261-4eba-a839-60dee3f515a7 tempest-VolumesActionsTest-728309357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9880c52-2aec-421c-99e4-bcbabbb6f709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:14:31 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-53dfa617-8261-4eba-a839-60dee3f515a7 tempest-VolumesActionsTest-728309357 None] Volume volume-ee7523d0-cc69-4198-84d4-bc51b4e90295 (ee7523d0-cc69-4198-84d4-bc51b4e90295): created successfully Aug 29 01:14:31 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-53dfa617-8261-4eba-a839-60dee3f515a7 tempest-VolumesActionsTest-728309357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9880c52-2aec-421c-99e4-bcbabbb6f709) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:14:31 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-53dfa617-8261-4eba-a839-60dee3f515a7 tempest-VolumesActionsTest-728309357 None] Flow 'volume_create_manager' (550c5392-6f3c-4568-bbc3-3bbbabd8dce7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:14:31 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-53dfa617-8261-4eba-a839-60dee3f515a7 tempest-VolumesActionsTest-728309357 None] Created volume successfully. Aug 29 01:14:32 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-a2c61d4f-2fc2-4272-8097-d6428c362422 tempest-VolumesActionsTest-728309357 None] Acquiring lock "cinder-ee7523d0-cc69-4198-84d4-bc51b4e90295" by "attach_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:14:32 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-a2c61d4f-2fc2-4272-8097-d6428c362422 tempest-VolumesActionsTest-728309357 None] Lock "cinder-ee7523d0-cc69-4198-84d4-bc51b4e90295" acquired by "attach_volume" :: waited 0.065s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:14:32 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-a2c61d4f-2fc2-4272-8097-d6428c362422 tempest-VolumesActionsTest-728309357 None] Attaching volume ee7523d0-cc69-4198-84d4-bc51b4e90295 to instance 99d09ebe-6491-47dc-84ab-76fcedb002e4 at mountpoint /dev/vdb on host None. Aug 29 01:14:32 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-a2c61d4f-2fc2-4272-8097-d6428c362422 tempest-VolumesActionsTest-728309357 None] Attach volume completed successfully. Aug 29 01:14:32 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-a2c61d4f-2fc2-4272-8097-d6428c362422 tempest-VolumesActionsTest-728309357 None] Lock "cinder-ee7523d0-cc69-4198-84d4-bc51b4e90295" released by "attach_volume" :: held 0.191s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:14:33 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-03128ceb-8a29-43bd-913a-04ba7e809c73 tempest-VolumesActionsTest-44467744 None] Terminate volume connection completed successfully. Aug 29 01:14:34 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-03128ceb-8a29-43bd-913a-04ba7e809c73 tempest-VolumesActionsTest-44467744 None] Acquiring lock "cinder-ee7523d0-cc69-4198-84d4-bc51b4e90295-detach_volume" by "detach_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:14:34 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-03128ceb-8a29-43bd-913a-04ba7e809c73 tempest-VolumesActionsTest-44467744 None] Lock "cinder-ee7523d0-cc69-4198-84d4-bc51b4e90295-detach_volume" acquired by "detach_volume" :: waited 0.039s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:14:34 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-03128ceb-8a29-43bd-913a-04ba7e809c73 tempest-VolumesActionsTest-44467744 None] Detaching volume ee7523d0-cc69-4198-84d4-bc51b4e90295 from instance 99d09ebe-6491-47dc-84ab-76fcedb002e4. Aug 29 01:14:34 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-03128ceb-8a29-43bd-913a-04ba7e809c73 tempest-VolumesActionsTest-44467744 None] Detach volume completed successfully. Aug 29 01:14:34 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-03128ceb-8a29-43bd-913a-04ba7e809c73 tempest-VolumesActionsTest-44467744 None] Lock "cinder-ee7523d0-cc69-4198-84d4-bc51b4e90295-detach_volume" released by "detach_volume" :: held 0.160s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:14:34 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-dbafd4d9-dfaf-4b93-8f7d-001062eb5446 tempest-VolumesActionsTest-728309357 None] Acquiring lock "cinder-ee7523d0-cc69-4198-84d4-bc51b4e90295-detach_volume" by "detach_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:14:34 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-dbafd4d9-dfaf-4b93-8f7d-001062eb5446 tempest-VolumesActionsTest-728309357 None] Lock "cinder-ee7523d0-cc69-4198-84d4-bc51b4e90295-detach_volume" acquired by "detach_volume" :: waited 0.033s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:14:34 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-dbafd4d9-dfaf-4b93-8f7d-001062eb5446 tempest-VolumesActionsTest-728309357 None] Volume detach called, but volume not attached. Aug 29 01:14:34 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-dbafd4d9-dfaf-4b93-8f7d-001062eb5446 tempest-VolumesActionsTest-728309357 None] Lock "cinder-ee7523d0-cc69-4198-84d4-bc51b4e90295-detach_volume" released by "detach_volume" :: held 0.031s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:14:35 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-5ef95836-9e16-470f-955f-e448eedfe1c2 tempest-VolumesActionsTest-728309357 None] Acquiring lock "cinder-ee7523d0-cc69-4198-84d4-bc51b4e90295-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:14:35 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-5ef95836-9e16-470f-955f-e448eedfe1c2 tempest-VolumesActionsTest-728309357 None] Lock "cinder-ee7523d0-cc69-4198-84d4-bc51b4e90295-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:14:35 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-5ef95836-9e16-470f-955f-e448eedfe1c2 tempest-VolumesActionsTest-728309357 None] Acquiring lock "cinder-quobyte-ee7523d0-cc69-4198-84d4-bc51b4e90295" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:14:35 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-5ef95836-9e16-470f-955f-e448eedfe1c2 tempest-VolumesActionsTest-728309357 None] Lock "cinder-quobyte-ee7523d0-cc69-4198-84d4-bc51b4e90295" acquired by "delete_volume" :: waited 0.052s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:14:35 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[6995b796-1cfa-42a7-a48e-c7bf35f836c2]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:14:35 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-5ef95836-9e16-470f-955f-e448eedfe1c2 tempest-VolumesActionsTest-728309357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ee7523d0-cc69-4198-84d4-bc51b4e90295 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:14:35 devstack sudo[92764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ee7523d0-cc69-4198-84d4-bc51b4e90295 Aug 29 01:14:35 devstack sudo[92764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:14:35 devstack sudo[92764]: pam_unix(sudo:session): session closed for user root Aug 29 01:14:35 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-5ef95836-9e16-470f-955f-e448eedfe1c2 tempest-VolumesActionsTest-728309357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ee7523d0-cc69-4198-84d4-bc51b4e90295" returned: 0 in 0.500s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:14:35 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-5ef95836-9e16-470f-955f-e448eedfe1c2 tempest-VolumesActionsTest-728309357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ee7523d0-cc69-4198-84d4-bc51b4e90295 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:14:35 devstack sudo[92769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ee7523d0-cc69-4198-84d4-bc51b4e90295 Aug 29 01:14:35 devstack sudo[92769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:14:36 devstack sudo[92769]: pam_unix(sudo:session): session closed for user root Aug 29 01:14:36 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-5ef95836-9e16-470f-955f-e448eedfe1c2 tempest-VolumesActionsTest-728309357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ee7523d0-cc69-4198-84d4-bc51b4e90295" returned: 0 in 0.604s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:14:36 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-5ef95836-9e16-470f-955f-e448eedfe1c2 tempest-VolumesActionsTest-728309357 None] Lock "cinder-quobyte-ee7523d0-cc69-4198-84d4-bc51b4e90295" released by "delete_volume" :: held 1.201s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:14:36 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-5ef95836-9e16-470f-955f-e448eedfe1c2 tempest-VolumesActionsTest-728309357 None] Created reservations ['016dcdb7-8b1b-4c54-9745-b27f6479a061', '564a2e8d-b36f-48d2-b044-2cce4fb34257', '8d542e00-df6d-4b9e-8fa1-6156d5559589', '628ff00f-abc3-43af-920f-75878994f3f4'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:14:36 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-5ef95836-9e16-470f-955f-e448eedfe1c2 tempest-VolumesActionsTest-728309357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:14:36 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-5ef95836-9e16-470f-955f-e448eedfe1c2 tempest-VolumesActionsTest-728309357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:14:36 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-5ef95836-9e16-470f-955f-e448eedfe1c2 tempest-VolumesActionsTest-728309357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:14:36 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-5ef95836-9e16-470f-955f-e448eedfe1c2 tempest-VolumesActionsTest-728309357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:14:36 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-5ef95836-9e16-470f-955f-e448eedfe1c2 tempest-VolumesActionsTest-728309357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:14:36 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-5ef95836-9e16-470f-955f-e448eedfe1c2 tempest-VolumesActionsTest-728309357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:14:36 devstack sudo[92772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:14:36 devstack sudo[92772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:14:37 devstack sudo[92772]: pam_unix(sudo:session): session closed for user root Aug 29 01:14:37 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-5ef95836-9e16-470f-955f-e448eedfe1c2 tempest-VolumesActionsTest-728309357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.660s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:14:37 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-5ef95836-9e16-470f-955f-e448eedfe1c2 tempest-VolumesActionsTest-728309357 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:14:37 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-5ef95836-9e16-470f-955f-e448eedfe1c2 tempest-VolumesActionsTest-728309357 None] Deleted volume successfully. Aug 29 01:14:37 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-5ef95836-9e16-470f-955f-e448eedfe1c2 tempest-VolumesActionsTest-728309357 None] Lock "cinder-ee7523d0-cc69-4198-84d4-bc51b4e90295-delete_volume" released by "delete_volume" :: held 2.297s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:14:40 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-8655dc7d-adee-4722-a068-9084dc29f01f tempest-VolumeSnapshotQuotasNegativeTestJSON-1508612450 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:14:40 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-8655dc7d-adee-4722-a068-9084dc29f01f tempest-VolumeSnapshotQuotasNegativeTestJSON-1508612450 None] Flow 'volume_create_manager' (a7f9ca60-0c13-4b5f-867a-1897c4f92d82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:14:40 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-8655dc7d-adee-4722-a068-9084dc29f01f tempest-VolumeSnapshotQuotasNegativeTestJSON-1508612450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c6c9f33-87b6-494f-ae63-b21ff4d5f13b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:14:40 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-8655dc7d-adee-4722-a068-9084dc29f01f tempest-VolumeSnapshotQuotasNegativeTestJSON-1508612450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c6c9f33-87b6-494f-ae63-b21ff4d5f13b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:14:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-638555233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a83a2102-ae06-4ead-bc8b-85f87cf19545,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdd49caba8ec4531a897753e50b4cbde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:14:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:14:40Z,use_quota=True,user_id='2dea795b1eeb4a5b8de42cd5c8655d44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:14:40 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-8655dc7d-adee-4722-a068-9084dc29f01f tempest-VolumeSnapshotQuotasNegativeTestJSON-1508612450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef25cd0e-cf0b-442e-bffe-f7f826351512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:14:40 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-8655dc7d-adee-4722-a068-9084dc29f01f tempest-VolumeSnapshotQuotasNegativeTestJSON-1508612450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef25cd0e-cf0b-442e-bffe-f7f826351512) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:14:40 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-8655dc7d-adee-4722-a068-9084dc29f01f tempest-VolumeSnapshotQuotasNegativeTestJSON-1508612450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff80ce1f-1ada-428e-b1da-f0f2e42a3f89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:14:40 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-8655dc7d-adee-4722-a068-9084dc29f01f tempest-VolumeSnapshotQuotasNegativeTestJSON-1508612450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff80ce1f-1ada-428e-b1da-f0f2e42a3f89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a83a2102-ae06-4ead-bc8b-85f87cf19545', 'volume_name': 'volume-a83a2102-ae06-4ead-bc8b-85f87cf19545', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:14:40 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-8655dc7d-adee-4722-a068-9084dc29f01f tempest-VolumeSnapshotQuotasNegativeTestJSON-1508612450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12193d83-4c1c-403a-9707-ca973d859843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:14:40 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-8655dc7d-adee-4722-a068-9084dc29f01f tempest-VolumeSnapshotQuotasNegativeTestJSON-1508612450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12193d83-4c1c-403a-9707-ca973d859843) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:14:40 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-8655dc7d-adee-4722-a068-9084dc29f01f tempest-VolumeSnapshotQuotasNegativeTestJSON-1508612450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (112dba19-7857-4442-80e6-3bdda095f17b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:14:40 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-8655dc7d-adee-4722-a068-9084dc29f01f tempest-VolumeSnapshotQuotasNegativeTestJSON-1508612450 None] Volume a83a2102-ae06-4ead-bc8b-85f87cf19545: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a83a2102-ae06-4ead-bc8b-85f87cf19545', 'volume_size': 1} Aug 29 01:14:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-8655dc7d-adee-4722-a068-9084dc29f01f tempest-VolumeSnapshotQuotasNegativeTestJSON-1508612450 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:14:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-8655dc7d-adee-4722-a068-9084dc29f01f tempest-VolumeSnapshotQuotasNegativeTestJSON-1508612450 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:14:40 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-8655dc7d-adee-4722-a068-9084dc29f01f tempest-VolumeSnapshotQuotasNegativeTestJSON-1508612450 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:14:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-638555233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a83a2102-ae06-4ead-bc8b-85f87cf19545,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdd49caba8ec4531a897753e50b4cbde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:14:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:14:40Z,use_quota=True,user_id='2dea795b1eeb4a5b8de42cd5c8655d44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:14:40 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-8655dc7d-adee-4722-a068-9084dc29f01f tempest-VolumeSnapshotQuotasNegativeTestJSON-1508612450 None] Creating volume a83a2102-ae06-4ead-bc8b-85f87cf19545 {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:14:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-8655dc7d-adee-4722-a068-9084dc29f01f tempest-VolumeSnapshotQuotasNegativeTestJSON-1508612450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:14:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-8655dc7d-adee-4722-a068-9084dc29f01f tempest-VolumeSnapshotQuotasNegativeTestJSON-1508612450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:14:40 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-8655dc7d-adee-4722-a068-9084dc29f01f tempest-VolumeSnapshotQuotasNegativeTestJSON-1508612450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:14:40 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-8655dc7d-adee-4722-a068-9084dc29f01f tempest-VolumeSnapshotQuotasNegativeTestJSON-1508612450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:14:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-8655dc7d-adee-4722-a068-9084dc29f01f tempest-VolumeSnapshotQuotasNegativeTestJSON-1508612450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:14:40 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-8655dc7d-adee-4722-a068-9084dc29f01f tempest-VolumeSnapshotQuotasNegativeTestJSON-1508612450 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:14:40 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-8655dc7d-adee-4722-a068-9084dc29f01f tempest-VolumeSnapshotQuotasNegativeTestJSON-1508612450 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:14:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8655dc7d-adee-4722-a068-9084dc29f01f tempest-VolumeSnapshotQuotasNegativeTestJSON-1508612450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a83a2102-ae06-4ead-bc8b-85f87cf19545 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:14:40 devstack sudo[92817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a83a2102-ae06-4ead-bc8b-85f87cf19545 1073741824 Aug 29 01:14:40 devstack sudo[92817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:14:40 devstack cinder-volume[86111]: DEBUG oslo_service.periodic_task [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86111) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 29 01:14:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:14:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:14:40 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:14:40 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:14:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:14:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:14:40 devstack sudo[92819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:14:40 devstack sudo[92819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:14:41 devstack sudo[92819]: pam_unix(sudo:session): session closed for user root Aug 29 01:14:41 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-de752545-d617-440e-8362-d04fae0901a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.589s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:14:41 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:14:41 devstack sudo[92817]: pam_unix(sudo:session): session closed for user root Aug 29 01:14:41 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8655dc7d-adee-4722-a068-9084dc29f01f tempest-VolumeSnapshotQuotasNegativeTestJSON-1508612450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a83a2102-ae06-4ead-bc8b-85f87cf19545 1073741824" returned: 0 in 0.923s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:14:41 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8655dc7d-adee-4722-a068-9084dc29f01f tempest-VolumeSnapshotQuotasNegativeTestJSON-1508612450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a83a2102-ae06-4ead-bc8b-85f87cf19545 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:14:41 devstack sudo[92831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a83a2102-ae06-4ead-bc8b-85f87cf19545 Aug 29 01:14:41 devstack sudo[92831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:14:42 devstack sudo[92831]: pam_unix(sudo:session): session closed for user root Aug 29 01:14:42 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8655dc7d-adee-4722-a068-9084dc29f01f tempest-VolumeSnapshotQuotasNegativeTestJSON-1508612450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a83a2102-ae06-4ead-bc8b-85f87cf19545" returned: 0 in 0.483s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:14:42 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-8655dc7d-adee-4722-a068-9084dc29f01f tempest-VolumeSnapshotQuotasNegativeTestJSON-1508612450 None] <== create_volume: return (1476ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:14:42 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-8655dc7d-adee-4722-a068-9084dc29f01f tempest-VolumeSnapshotQuotasNegativeTestJSON-1508612450 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.484s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:14:42 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-8655dc7d-adee-4722-a068-9084dc29f01f tempest-VolumeSnapshotQuotasNegativeTestJSON-1508612450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (112dba19-7857-4442-80e6-3bdda095f17b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a83a2102-ae06-4ead-bc8b-85f87cf19545', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:14:42 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-8655dc7d-adee-4722-a068-9084dc29f01f tempest-VolumeSnapshotQuotasNegativeTestJSON-1508612450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb73c76e-6427-4991-835a-cd5d7a6f1d96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:14:42 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-8655dc7d-adee-4722-a068-9084dc29f01f tempest-VolumeSnapshotQuotasNegativeTestJSON-1508612450 None] Volume volume-a83a2102-ae06-4ead-bc8b-85f87cf19545 (a83a2102-ae06-4ead-bc8b-85f87cf19545): created successfully Aug 29 01:14:42 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-8655dc7d-adee-4722-a068-9084dc29f01f tempest-VolumeSnapshotQuotasNegativeTestJSON-1508612450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb73c76e-6427-4991-835a-cd5d7a6f1d96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:14:42 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-8655dc7d-adee-4722-a068-9084dc29f01f tempest-VolumeSnapshotQuotasNegativeTestJSON-1508612450 None] Flow 'volume_create_manager' (a7f9ca60-0c13-4b5f-867a-1897c4f92d82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:14:42 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-8655dc7d-adee-4722-a068-9084dc29f01f tempest-VolumeSnapshotQuotasNegativeTestJSON-1508612450 None] Created volume successfully. Aug 29 01:14:42 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-3853d14a-55db-4a4c-a487-d14e23b3bfc8 tempest-VolumesActionsTest-728309357 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:14:42 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-3853d14a-55db-4a4c-a487-d14e23b3bfc8 tempest-VolumesActionsTest-728309357 None] Flow 'volume_create_manager' (db07ab62-6f1e-4679-b1ca-ddd4ff9a49ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:14:42 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-3853d14a-55db-4a4c-a487-d14e23b3bfc8 tempest-VolumesActionsTest-728309357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cef26cc-02cf-4e98-9d26-cfc6e6ba997b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:14:42 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-3853d14a-55db-4a4c-a487-d14e23b3bfc8 tempest-VolumesActionsTest-728309357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cef26cc-02cf-4e98-9d26-cfc6e6ba997b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:14:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-264979827',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad55572c-4fa9-475d-a070-ad2ba740732f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6ee2a844fb74fa88050b13a10c9487f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:14:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:14:42Z,use_quota=True,user_id='d5d10b5589044eaf81e496cca37ae3b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:14:42 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-3853d14a-55db-4a4c-a487-d14e23b3bfc8 tempest-VolumesActionsTest-728309357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (887da4a5-7ba0-4e34-8463-6c33970947ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:14:42 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-3853d14a-55db-4a4c-a487-d14e23b3bfc8 tempest-VolumesActionsTest-728309357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (887da4a5-7ba0-4e34-8463-6c33970947ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:14:42 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-3853d14a-55db-4a4c-a487-d14e23b3bfc8 tempest-VolumesActionsTest-728309357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a53abba-ce41-4fd2-8383-889a7fe0e3a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:14:42 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-3853d14a-55db-4a4c-a487-d14e23b3bfc8 tempest-VolumesActionsTest-728309357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a53abba-ce41-4fd2-8383-889a7fe0e3a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad55572c-4fa9-475d-a070-ad2ba740732f', 'volume_name': 'volume-ad55572c-4fa9-475d-a070-ad2ba740732f', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:14:42 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-3853d14a-55db-4a4c-a487-d14e23b3bfc8 tempest-VolumesActionsTest-728309357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66c54e8e-54dc-434d-95d1-9c03cd1c7995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:14:42 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-3853d14a-55db-4a4c-a487-d14e23b3bfc8 tempest-VolumesActionsTest-728309357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66c54e8e-54dc-434d-95d1-9c03cd1c7995) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:14:42 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-3853d14a-55db-4a4c-a487-d14e23b3bfc8 tempest-VolumesActionsTest-728309357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8168c2a4-8f49-453f-a8df-5e5d80672c68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:14:42 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-3853d14a-55db-4a4c-a487-d14e23b3bfc8 tempest-VolumesActionsTest-728309357 None] Volume ad55572c-4fa9-475d-a070-ad2ba740732f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad55572c-4fa9-475d-a070-ad2ba740732f', 'volume_size': 1} Aug 29 01:14:42 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-3853d14a-55db-4a4c-a487-d14e23b3bfc8 tempest-VolumesActionsTest-728309357 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:14:42 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-3853d14a-55db-4a4c-a487-d14e23b3bfc8 tempest-VolumesActionsTest-728309357 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:14:42 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-3853d14a-55db-4a4c-a487-d14e23b3bfc8 tempest-VolumesActionsTest-728309357 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:14:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-264979827',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad55572c-4fa9-475d-a070-ad2ba740732f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6ee2a844fb74fa88050b13a10c9487f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:14:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:14:42Z,use_quota=True,user_id='d5d10b5589044eaf81e496cca37ae3b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:14:42 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-3853d14a-55db-4a4c-a487-d14e23b3bfc8 tempest-VolumesActionsTest-728309357 None] Creating volume ad55572c-4fa9-475d-a070-ad2ba740732f {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:14:42 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-3853d14a-55db-4a4c-a487-d14e23b3bfc8 tempest-VolumesActionsTest-728309357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:14:42 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-3853d14a-55db-4a4c-a487-d14e23b3bfc8 tempest-VolumesActionsTest-728309357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:14:42 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-3853d14a-55db-4a4c-a487-d14e23b3bfc8 tempest-VolumesActionsTest-728309357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:14:42 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-3853d14a-55db-4a4c-a487-d14e23b3bfc8 tempest-VolumesActionsTest-728309357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:14:42 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-3853d14a-55db-4a4c-a487-d14e23b3bfc8 tempest-VolumesActionsTest-728309357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:14:42 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-3853d14a-55db-4a4c-a487-d14e23b3bfc8 tempest-VolumesActionsTest-728309357 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:14:42 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-3853d14a-55db-4a4c-a487-d14e23b3bfc8 tempest-VolumesActionsTest-728309357 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:14:42 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-3853d14a-55db-4a4c-a487-d14e23b3bfc8 tempest-VolumesActionsTest-728309357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ad55572c-4fa9-475d-a070-ad2ba740732f 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:14:42 devstack sudo[92837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ad55572c-4fa9-475d-a070-ad2ba740732f 1073741824 Aug 29 01:14:42 devstack sudo[92837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:14:42 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-f1325f92-670a-4052-bde6-b48678bd1e8c tempest-VolumeSnapshotQuotasNegativeTestJSON-1508612450 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:14:43 devstack sudo[92837]: pam_unix(sudo:session): session closed for user root Aug 29 01:14:43 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-3853d14a-55db-4a4c-a487-d14e23b3bfc8 tempest-VolumesActionsTest-728309357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ad55572c-4fa9-475d-a070-ad2ba740732f 1073741824" returned: 0 in 0.511s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:14:43 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-3853d14a-55db-4a4c-a487-d14e23b3bfc8 tempest-VolumesActionsTest-728309357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ad55572c-4fa9-475d-a070-ad2ba740732f {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:14:43 devstack sudo[92844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ad55572c-4fa9-475d-a070-ad2ba740732f Aug 29 01:14:43 devstack sudo[92844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:14:43 devstack sudo[92844]: pam_unix(sudo:session): session closed for user root Aug 29 01:14:43 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-3853d14a-55db-4a4c-a487-d14e23b3bfc8 tempest-VolumesActionsTest-728309357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ad55572c-4fa9-475d-a070-ad2ba740732f" returned: 0 in 0.330s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:14:43 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-3853d14a-55db-4a4c-a487-d14e23b3bfc8 tempest-VolumesActionsTest-728309357 None] <== create_volume: return (897ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:14:43 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-3853d14a-55db-4a4c-a487-d14e23b3bfc8 tempest-VolumesActionsTest-728309357 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.901s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:14:43 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-f1325f92-670a-4052-bde6-b48678bd1e8c tempest-VolumeSnapshotQuotasNegativeTestJSON-1508612450 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.810s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:14:43 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-3853d14a-55db-4a4c-a487-d14e23b3bfc8 tempest-VolumesActionsTest-728309357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8168c2a4-8f49-453f-a8df-5e5d80672c68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad55572c-4fa9-475d-a070-ad2ba740732f', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:14:43 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-3853d14a-55db-4a4c-a487-d14e23b3bfc8 tempest-VolumesActionsTest-728309357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (286ef5ef-6d75-4dd0-90b3-e9c255a26c2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:14:43 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-f1325f92-670a-4052-bde6-b48678bd1e8c tempest-VolumeSnapshotQuotasNegativeTestJSON-1508612450 None] Creating offline snapshot 88fb5153-ab87-4bbe-bc0d-cc72da303e38 of volume a83a2102-ae06-4ead-bc8b-85f87cf19545 {{(pid=86111) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 29 01:14:43 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-3853d14a-55db-4a4c-a487-d14e23b3bfc8 tempest-VolumesActionsTest-728309357 None] Volume volume-ad55572c-4fa9-475d-a070-ad2ba740732f (ad55572c-4fa9-475d-a070-ad2ba740732f): created successfully Aug 29 01:14:43 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-3853d14a-55db-4a4c-a487-d14e23b3bfc8 tempest-VolumesActionsTest-728309357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (286ef5ef-6d75-4dd0-90b3-e9c255a26c2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:14:43 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-3853d14a-55db-4a4c-a487-d14e23b3bfc8 tempest-VolumesActionsTest-728309357 None] Flow 'volume_create_manager' (db07ab62-6f1e-4679-b1ca-ddd4ff9a49ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:14:43 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[364bf699-9154-4f42-93fc-ecfefd7275c6]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:14:43 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-f1325f92-670a-4052-bde6-b48678bd1e8c tempest-VolumeSnapshotQuotasNegativeTestJSON-1508612450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a83a2102-ae06-4ead-bc8b-85f87cf19545 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:14:43 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-3853d14a-55db-4a4c-a487-d14e23b3bfc8 tempest-VolumesActionsTest-728309357 None] Created volume successfully. Aug 29 01:14:43 devstack sudo[92847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a83a2102-ae06-4ead-bc8b-85f87cf19545 Aug 29 01:14:43 devstack sudo[92847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:14:44 devstack sudo[92847]: pam_unix(sudo:session): session closed for user root Aug 29 01:14:44 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-f1325f92-670a-4052-bde6-b48678bd1e8c tempest-VolumeSnapshotQuotasNegativeTestJSON-1508612450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a83a2102-ae06-4ead-bc8b-85f87cf19545" returned: 0 in 0.434s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:14:44 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-f1325f92-670a-4052-bde6-b48678bd1e8c tempest-VolumeSnapshotQuotasNegativeTestJSON-1508612450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a83a2102-ae06-4ead-bc8b-85f87cf19545,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a83a2102-ae06-4ead-bc8b-85f87cf19545.88fb5153-ab87-4bbe-bc0d-cc72da303e38 1G {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:14:44 devstack sudo[92856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a83a2102-ae06-4ead-bc8b-85f87cf19545,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a83a2102-ae06-4ead-bc8b-85f87cf19545.88fb5153-ab87-4bbe-bc0d-cc72da303e38 1G Aug 29 01:14:44 devstack sudo[92856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:14:44 devstack sudo[92856]: pam_unix(sudo:session): session closed for user root Aug 29 01:14:44 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-f1325f92-670a-4052-bde6-b48678bd1e8c tempest-VolumeSnapshotQuotasNegativeTestJSON-1508612450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a83a2102-ae06-4ead-bc8b-85f87cf19545,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a83a2102-ae06-4ead-bc8b-85f87cf19545.88fb5153-ab87-4bbe-bc0d-cc72da303e38 1G" returned: 0 in 0.506s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:14:44 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-f1325f92-670a-4052-bde6-b48678bd1e8c tempest-VolumeSnapshotQuotasNegativeTestJSON-1508612450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a83a2102-ae06-4ead-bc8b-85f87cf19545 -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a83a2102-ae06-4ead-bc8b-85f87cf19545.88fb5153-ab87-4bbe-bc0d-cc72da303e38 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:14:44 devstack sudo[92861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a83a2102-ae06-4ead-bc8b-85f87cf19545 -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a83a2102-ae06-4ead-bc8b-85f87cf19545.88fb5153-ab87-4bbe-bc0d-cc72da303e38 Aug 29 01:14:44 devstack sudo[92861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:14:44 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-72922331-52c8-4b4d-8893-9f8a4843ff19 tempest-VolumesActionsTest-44467744 None] Acquiring lock "cinder-ad55572c-4fa9-475d-a070-ad2ba740732f-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:14:44 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-72922331-52c8-4b4d-8893-9f8a4843ff19 tempest-VolumesActionsTest-44467744 None] Lock "cinder-ad55572c-4fa9-475d-a070-ad2ba740732f-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:14:44 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-72922331-52c8-4b4d-8893-9f8a4843ff19 tempest-VolumesActionsTest-44467744 None] Acquiring lock "cinder-quobyte-ad55572c-4fa9-475d-a070-ad2ba740732f" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:14:44 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-72922331-52c8-4b4d-8893-9f8a4843ff19 tempest-VolumesActionsTest-44467744 None] Lock "cinder-quobyte-ad55572c-4fa9-475d-a070-ad2ba740732f" acquired by "delete_volume" :: waited 0.018s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:14:44 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[510c99c8-4353-46d2-857a-2242cfbad224]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:14:44 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-72922331-52c8-4b4d-8893-9f8a4843ff19 tempest-VolumesActionsTest-44467744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ad55572c-4fa9-475d-a070-ad2ba740732f {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:14:44 devstack sudo[92861]: pam_unix(sudo:session): session closed for user root Aug 29 01:14:44 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-f1325f92-670a-4052-bde6-b48678bd1e8c tempest-VolumeSnapshotQuotasNegativeTestJSON-1508612450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a83a2102-ae06-4ead-bc8b-85f87cf19545 -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a83a2102-ae06-4ead-bc8b-85f87cf19545.88fb5153-ab87-4bbe-bc0d-cc72da303e38" returned: 0 in 0.380s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:14:44 devstack cinder-volume[86111]: WARNING cinder.volume.drivers.remotefs [None req-f1325f92-670a-4052-bde6-b48678bd1e8c tempest-VolumeSnapshotQuotasNegativeTestJSON-1508612450 None] /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a83a2102-ae06-4ead-bc8b-85f87cf19545.88fb5153-ab87-4bbe-bc0d-cc72da303e38 is being set with open permissions: ugo+rw Aug 29 01:14:44 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-f1325f92-670a-4052-bde6-b48678bd1e8c tempest-VolumeSnapshotQuotasNegativeTestJSON-1508612450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a83a2102-ae06-4ead-bc8b-85f87cf19545.88fb5153-ab87-4bbe-bc0d-cc72da303e38 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:14:45 devstack sudo[92867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a83a2102-ae06-4ead-bc8b-85f87cf19545.88fb5153-ab87-4bbe-bc0d-cc72da303e38 Aug 29 01:14:45 devstack sudo[92867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:14:45 devstack sudo[92866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ad55572c-4fa9-475d-a070-ad2ba740732f Aug 29 01:14:45 devstack sudo[92866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:14:45 devstack sudo[92867]: pam_unix(sudo:session): session closed for user root Aug 29 01:14:45 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-f1325f92-670a-4052-bde6-b48678bd1e8c tempest-VolumeSnapshotQuotasNegativeTestJSON-1508612450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a83a2102-ae06-4ead-bc8b-85f87cf19545.88fb5153-ab87-4bbe-bc0d-cc72da303e38" returned: 0 in 0.267s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:14:45 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-f1325f92-670a-4052-bde6-b48678bd1e8c tempest-VolumeSnapshotQuotasNegativeTestJSON-1508612450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a83a2102-ae06-4ead-bc8b-85f87cf19545.info {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:14:45 devstack sudo[92866]: pam_unix(sudo:session): session closed for user root Aug 29 01:14:45 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-72922331-52c8-4b4d-8893-9f8a4843ff19 tempest-VolumesActionsTest-44467744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ad55572c-4fa9-475d-a070-ad2ba740732f" returned: 0 in 0.404s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:14:45 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-72922331-52c8-4b4d-8893-9f8a4843ff19 tempest-VolumesActionsTest-44467744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ad55572c-4fa9-475d-a070-ad2ba740732f {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:14:45 devstack sudo[92874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a83a2102-ae06-4ead-bc8b-85f87cf19545.info Aug 29 01:14:45 devstack sudo[92874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:14:45 devstack sudo[92876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ad55572c-4fa9-475d-a070-ad2ba740732f Aug 29 01:14:45 devstack sudo[92876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:14:45 devstack sudo[92874]: pam_unix(sudo:session): session closed for user root Aug 29 01:14:45 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-f1325f92-670a-4052-bde6-b48678bd1e8c tempest-VolumeSnapshotQuotasNegativeTestJSON-1508612450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a83a2102-ae06-4ead-bc8b-85f87cf19545.info" returned: 0 in 0.264s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:14:45 devstack cinder-volume[86111]: WARNING cinder.volume.drivers.remotefs [None req-f1325f92-670a-4052-bde6-b48678bd1e8c tempest-VolumeSnapshotQuotasNegativeTestJSON-1508612450 None] /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a83a2102-ae06-4ead-bc8b-85f87cf19545.info is being set with open permissions: ugo+rw Aug 29 01:14:45 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-f1325f92-670a-4052-bde6-b48678bd1e8c tempest-VolumeSnapshotQuotasNegativeTestJSON-1508612450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a83a2102-ae06-4ead-bc8b-85f87cf19545.info {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:14:45 devstack sudo[92880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a83a2102-ae06-4ead-bc8b-85f87cf19545.info Aug 29 01:14:45 devstack sudo[92880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:14:45 devstack sudo[92876]: pam_unix(sudo:session): session closed for user root Aug 29 01:14:45 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-72922331-52c8-4b4d-8893-9f8a4843ff19 tempest-VolumesActionsTest-44467744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ad55572c-4fa9-475d-a070-ad2ba740732f" returned: 0 in 0.280s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:14:45 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-72922331-52c8-4b4d-8893-9f8a4843ff19 tempest-VolumesActionsTest-44467744 None] Lock "cinder-quobyte-ad55572c-4fa9-475d-a070-ad2ba740732f" released by "delete_volume" :: held 0.726s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:14:45 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-72922331-52c8-4b4d-8893-9f8a4843ff19 tempest-VolumesActionsTest-44467744 None] Created reservations ['ba079f54-852d-454e-9f60-c22a5bf36e30', '0b8825c6-d4ec-4e0b-9466-78576c64f21c', '7f2d01d8-2ceb-43cb-ad88-f6b904ada396', '620e9786-a9d9-40e9-9680-ece7dd4e7951'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:14:45 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-72922331-52c8-4b4d-8893-9f8a4843ff19 tempest-VolumesActionsTest-44467744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:14:45 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-72922331-52c8-4b4d-8893-9f8a4843ff19 tempest-VolumesActionsTest-44467744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:14:45 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-72922331-52c8-4b4d-8893-9f8a4843ff19 tempest-VolumesActionsTest-44467744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:14:45 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-72922331-52c8-4b4d-8893-9f8a4843ff19 tempest-VolumesActionsTest-44467744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:14:45 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-72922331-52c8-4b4d-8893-9f8a4843ff19 tempest-VolumesActionsTest-44467744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:14:45 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-72922331-52c8-4b4d-8893-9f8a4843ff19 tempest-VolumesActionsTest-44467744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:14:45 devstack sudo[92882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:14:45 devstack sudo[92882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:14:45 devstack sudo[92880]: pam_unix(sudo:session): session closed for user root Aug 29 01:14:45 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-f1325f92-670a-4052-bde6-b48678bd1e8c tempest-VolumeSnapshotQuotasNegativeTestJSON-1508612450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a83a2102-ae06-4ead-bc8b-85f87cf19545.info" returned: 0 in 0.269s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:14:45 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-f1325f92-670a-4052-bde6-b48678bd1e8c tempest-VolumeSnapshotQuotasNegativeTestJSON-1508612450 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.277s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:14:45 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-f1325f92-670a-4052-bde6-b48678bd1e8c tempest-VolumeSnapshotQuotasNegativeTestJSON-1508612450 None] Create snapshot completed successfully Aug 29 01:14:46 devstack sudo[92882]: pam_unix(sudo:session): session closed for user root Aug 29 01:14:46 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-72922331-52c8-4b4d-8893-9f8a4843ff19 tempest-VolumesActionsTest-44467744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.379s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:14:46 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-72922331-52c8-4b4d-8893-9f8a4843ff19 tempest-VolumesActionsTest-44467744 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:14:46 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-72922331-52c8-4b4d-8893-9f8a4843ff19 tempest-VolumesActionsTest-44467744 None] Deleted volume successfully. Aug 29 01:14:46 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-72922331-52c8-4b4d-8893-9f8a4843ff19 tempest-VolumesActionsTest-44467744 None] Lock "cinder-ad55572c-4fa9-475d-a070-ad2ba740732f-delete_volume" released by "delete_volume" :: held 1.343s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:14:46 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f27c975-bd15-458f-9a04-f7df5973a21c tempest-VolumesActionsTest-728309357 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:14:46 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-1f27c975-bd15-458f-9a04-f7df5973a21c tempest-VolumesActionsTest-728309357 None] Flow 'volume_create_manager' (21598ac4-1779-44a1-bdb3-32899a3138c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:14:46 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-1f27c975-bd15-458f-9a04-f7df5973a21c tempest-VolumesActionsTest-728309357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb5089e7-2383-4b88-82a2-93d06133c11c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:14:46 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-1f27c975-bd15-458f-9a04-f7df5973a21c tempest-VolumesActionsTest-728309357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb5089e7-2383-4b88-82a2-93d06133c11c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:14:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1894029795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e35190e-8fa7-41c3-8ef2-5992af2083d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6ee2a844fb74fa88050b13a10c9487f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:14:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:14:47Z,use_quota=True,user_id='d5d10b5589044eaf81e496cca37ae3b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:14:46 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-1f27c975-bd15-458f-9a04-f7df5973a21c tempest-VolumesActionsTest-728309357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f59a98cd-3c01-4174-a564-75e5d4cdee05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:14:46 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-1f27c975-bd15-458f-9a04-f7df5973a21c tempest-VolumesActionsTest-728309357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f59a98cd-3c01-4174-a564-75e5d4cdee05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:14:46 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-1f27c975-bd15-458f-9a04-f7df5973a21c tempest-VolumesActionsTest-728309357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa56c827-841f-4e26-ad73-6a43e670da7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:14:46 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-1f27c975-bd15-458f-9a04-f7df5973a21c tempest-VolumesActionsTest-728309357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa56c827-841f-4e26-ad73-6a43e670da7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e35190e-8fa7-41c3-8ef2-5992af2083d1', 'volume_name': 'volume-7e35190e-8fa7-41c3-8ef2-5992af2083d1', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:14:46 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-1f27c975-bd15-458f-9a04-f7df5973a21c tempest-VolumesActionsTest-728309357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a527964-59ba-4a2f-956e-10a7611e69fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:14:46 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-1f27c975-bd15-458f-9a04-f7df5973a21c tempest-VolumesActionsTest-728309357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a527964-59ba-4a2f-956e-10a7611e69fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:14:46 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-1f27c975-bd15-458f-9a04-f7df5973a21c tempest-VolumesActionsTest-728309357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4dc6a5aa-8ce0-4e8d-bf9f-11c2f3574d98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:14:46 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-1f27c975-bd15-458f-9a04-f7df5973a21c tempest-VolumesActionsTest-728309357 None] Volume 7e35190e-8fa7-41c3-8ef2-5992af2083d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e35190e-8fa7-41c3-8ef2-5992af2083d1', 'volume_size': 1} Aug 29 01:14:46 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-1f27c975-bd15-458f-9a04-f7df5973a21c tempest-VolumesActionsTest-728309357 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:14:46 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-1f27c975-bd15-458f-9a04-f7df5973a21c tempest-VolumesActionsTest-728309357 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:14:46 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-1f27c975-bd15-458f-9a04-f7df5973a21c tempest-VolumesActionsTest-728309357 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:14:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1894029795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e35190e-8fa7-41c3-8ef2-5992af2083d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6ee2a844fb74fa88050b13a10c9487f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:14:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:14:47Z,use_quota=True,user_id='d5d10b5589044eaf81e496cca37ae3b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:14:46 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-1f27c975-bd15-458f-9a04-f7df5973a21c tempest-VolumesActionsTest-728309357 None] Creating volume 7e35190e-8fa7-41c3-8ef2-5992af2083d1 {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:14:46 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-1f27c975-bd15-458f-9a04-f7df5973a21c tempest-VolumesActionsTest-728309357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:14:46 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-1f27c975-bd15-458f-9a04-f7df5973a21c tempest-VolumesActionsTest-728309357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:14:46 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-1f27c975-bd15-458f-9a04-f7df5973a21c tempest-VolumesActionsTest-728309357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:14:46 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-1f27c975-bd15-458f-9a04-f7df5973a21c tempest-VolumesActionsTest-728309357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:14:46 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-1f27c975-bd15-458f-9a04-f7df5973a21c tempest-VolumesActionsTest-728309357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:14:46 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-1f27c975-bd15-458f-9a04-f7df5973a21c tempest-VolumesActionsTest-728309357 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:14:46 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-1f27c975-bd15-458f-9a04-f7df5973a21c tempest-VolumesActionsTest-728309357 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:14:46 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-1f27c975-bd15-458f-9a04-f7df5973a21c tempest-VolumesActionsTest-728309357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-7e35190e-8fa7-41c3-8ef2-5992af2083d1 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:14:46 devstack sudo[92886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-7e35190e-8fa7-41c3-8ef2-5992af2083d1 1073741824 Aug 29 01:14:46 devstack sudo[92886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:14:47 devstack sudo[92886]: pam_unix(sudo:session): session closed for user root Aug 29 01:14:47 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-1f27c975-bd15-458f-9a04-f7df5973a21c tempest-VolumesActionsTest-728309357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-7e35190e-8fa7-41c3-8ef2-5992af2083d1 1073741824" returned: 0 in 0.542s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:14:47 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-1f27c975-bd15-458f-9a04-f7df5973a21c tempest-VolumesActionsTest-728309357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-7e35190e-8fa7-41c3-8ef2-5992af2083d1 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:14:47 devstack sudo[92892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-7e35190e-8fa7-41c3-8ef2-5992af2083d1 Aug 29 01:14:47 devstack sudo[92892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:14:47 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-ae9eae22-c7f0-4dd5-bbf6-0a8bb21fc508 tempest-VolumeSnapshotQuotasNegativeTestJSON-1508612450 None] Acquiring lock "cinder-88fb5153-ab87-4bbe-bc0d-cc72da303e38-delete_snapshot" by "delete_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:14:47 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-ae9eae22-c7f0-4dd5-bbf6-0a8bb21fc508 tempest-VolumeSnapshotQuotasNegativeTestJSON-1508612450 None] Lock "cinder-88fb5153-ab87-4bbe-bc0d-cc72da303e38-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:14:47 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-ae9eae22-c7f0-4dd5-bbf6-0a8bb21fc508 tempest-VolumeSnapshotQuotasNegativeTestJSON-1508612450 None] Acquiring lock "cinder-quobyte-a83a2102-ae06-4ead-bc8b-85f87cf19545" by "delete_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:14:47 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-ae9eae22-c7f0-4dd5-bbf6-0a8bb21fc508 tempest-VolumeSnapshotQuotasNegativeTestJSON-1508612450 None] Lock "cinder-quobyte-a83a2102-ae06-4ead-bc8b-85f87cf19545" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:14:47 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-ae9eae22-c7f0-4dd5-bbf6-0a8bb21fc508 tempest-VolumeSnapshotQuotasNegativeTestJSON-1508612450 None] Acquiring lock "cinder-quobyte-88fb5153-ab87-4bbe-bc0d-cc72da303e38" by "_delete_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:14:47 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-ae9eae22-c7f0-4dd5-bbf6-0a8bb21fc508 tempest-VolumeSnapshotQuotasNegativeTestJSON-1508612450 None] Lock "cinder-quobyte-88fb5153-ab87-4bbe-bc0d-cc72da303e38" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:14:47 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-ae9eae22-c7f0-4dd5-bbf6-0a8bb21fc508 tempest-VolumeSnapshotQuotasNegativeTestJSON-1508612450 None] Deleting offline snapshot 88fb5153-ab87-4bbe-bc0d-cc72da303e38 of volume a83a2102-ae06-4ead-bc8b-85f87cf19545 {{(pid=86111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 29 01:14:47 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-ae9eae22-c7f0-4dd5-bbf6-0a8bb21fc508 tempest-VolumeSnapshotQuotasNegativeTestJSON-1508612450 None] snapshot_file for this snap is: volume-a83a2102-ae06-4ead-bc8b-85f87cf19545.88fb5153-ab87-4bbe-bc0d-cc72da303e38 {{(pid=86111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 29 01:14:47 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2ad623b-15ae-4f09-8d60-8bf662ac6ee3]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:14:47 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-ae9eae22-c7f0-4dd5-bbf6-0a8bb21fc508 tempest-VolumeSnapshotQuotasNegativeTestJSON-1508612450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a83a2102-ae06-4ead-bc8b-85f87cf19545.88fb5153-ab87-4bbe-bc0d-cc72da303e38 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:14:47 devstack sudo[92892]: pam_unix(sudo:session): session closed for user root Aug 29 01:14:47 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-1f27c975-bd15-458f-9a04-f7df5973a21c tempest-VolumesActionsTest-728309357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-7e35190e-8fa7-41c3-8ef2-5992af2083d1" returned: 0 in 0.380s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:14:47 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-1f27c975-bd15-458f-9a04-f7df5973a21c tempest-VolumesActionsTest-728309357 None] <== create_volume: return (988ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:14:47 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-1f27c975-bd15-458f-9a04-f7df5973a21c tempest-VolumesActionsTest-728309357 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.991s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:14:47 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-1f27c975-bd15-458f-9a04-f7df5973a21c tempest-VolumesActionsTest-728309357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4dc6a5aa-8ce0-4e8d-bf9f-11c2f3574d98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e35190e-8fa7-41c3-8ef2-5992af2083d1', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:14:47 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-1f27c975-bd15-458f-9a04-f7df5973a21c tempest-VolumesActionsTest-728309357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94679070-629a-409b-851b-f63aefd8e6e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:14:47 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-1f27c975-bd15-458f-9a04-f7df5973a21c tempest-VolumesActionsTest-728309357 None] Volume volume-7e35190e-8fa7-41c3-8ef2-5992af2083d1 (7e35190e-8fa7-41c3-8ef2-5992af2083d1): created successfully Aug 29 01:14:47 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-1f27c975-bd15-458f-9a04-f7df5973a21c tempest-VolumesActionsTest-728309357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94679070-629a-409b-851b-f63aefd8e6e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:14:47 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-1f27c975-bd15-458f-9a04-f7df5973a21c tempest-VolumesActionsTest-728309357 None] Flow 'volume_create_manager' (21598ac4-1779-44a1-bdb3-32899a3138c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:14:47 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-1f27c975-bd15-458f-9a04-f7df5973a21c tempest-VolumesActionsTest-728309357 None] Created volume successfully. Aug 29 01:14:47 devstack sudo[92895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a83a2102-ae06-4ead-bc8b-85f87cf19545.88fb5153-ab87-4bbe-bc0d-cc72da303e38 Aug 29 01:14:47 devstack sudo[92895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:14:48 devstack sudo[92895]: pam_unix(sudo:session): session closed for user root Aug 29 01:14:48 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-ae9eae22-c7f0-4dd5-bbf6-0a8bb21fc508 tempest-VolumeSnapshotQuotasNegativeTestJSON-1508612450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a83a2102-ae06-4ead-bc8b-85f87cf19545.88fb5153-ab87-4bbe-bc0d-cc72da303e38" returned: 0 in 0.449s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:14:48 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-ae9eae22-c7f0-4dd5-bbf6-0a8bb21fc508 tempest-VolumeSnapshotQuotasNegativeTestJSON-1508612450 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a83a2102-ae06-4ead-bc8b-85f87cf19545(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 29 01:14:48 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ff8ab51-9b09-4936-871e-e3973ff76d77]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:14:48 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-ae9eae22-c7f0-4dd5-bbf6-0a8bb21fc508 tempest-VolumeSnapshotQuotasNegativeTestJSON-1508612450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a83a2102-ae06-4ead-bc8b-85f87cf19545 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:14:48 devstack sudo[92900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a83a2102-ae06-4ead-bc8b-85f87cf19545 Aug 29 01:14:48 devstack sudo[92900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:14:48 devstack sudo[92900]: pam_unix(sudo:session): session closed for user root Aug 29 01:14:48 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-ae9eae22-c7f0-4dd5-bbf6-0a8bb21fc508 tempest-VolumeSnapshotQuotasNegativeTestJSON-1508612450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a83a2102-ae06-4ead-bc8b-85f87cf19545" returned: 0 in 0.417s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:14:48 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-ae9eae22-c7f0-4dd5-bbf6-0a8bb21fc508 tempest-VolumeSnapshotQuotasNegativeTestJSON-1508612450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a83a2102-ae06-4ead-bc8b-85f87cf19545.88fb5153-ab87-4bbe-bc0d-cc72da303e38 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:14:48 devstack sudo[92907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a83a2102-ae06-4ead-bc8b-85f87cf19545.88fb5153-ab87-4bbe-bc0d-cc72da303e38 Aug 29 01:14:48 devstack sudo[92907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:14:48 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-83a603c7-01f2-44b5-8314-c3826adb5a18 tempest-VolumesActionsTest-44467744 None] Acquiring lock "cinder-7e35190e-8fa7-41c3-8ef2-5992af2083d1-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:14:49 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-83a603c7-01f2-44b5-8314-c3826adb5a18 tempest-VolumesActionsTest-44467744 None] Lock "cinder-7e35190e-8fa7-41c3-8ef2-5992af2083d1-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:14:49 devstack sudo[92907]: pam_unix(sudo:session): session closed for user root Aug 29 01:14:49 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-83a603c7-01f2-44b5-8314-c3826adb5a18 tempest-VolumesActionsTest-44467744 None] Acquiring lock "cinder-quobyte-7e35190e-8fa7-41c3-8ef2-5992af2083d1" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:14:49 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-ae9eae22-c7f0-4dd5-bbf6-0a8bb21fc508 tempest-VolumeSnapshotQuotasNegativeTestJSON-1508612450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a83a2102-ae06-4ead-bc8b-85f87cf19545.88fb5153-ab87-4bbe-bc0d-cc72da303e38" returned: 0 in 0.483s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:14:49 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-ae9eae22-c7f0-4dd5-bbf6-0a8bb21fc508 tempest-VolumeSnapshotQuotasNegativeTestJSON-1508612450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a83a2102-ae06-4ead-bc8b-85f87cf19545.88fb5153-ab87-4bbe-bc0d-cc72da303e38 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:14:49 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-83a603c7-01f2-44b5-8314-c3826adb5a18 tempest-VolumesActionsTest-44467744 None] Lock "cinder-quobyte-7e35190e-8fa7-41c3-8ef2-5992af2083d1" acquired by "delete_volume" :: waited 0.030s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:14:49 devstack sudo[92912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a83a2102-ae06-4ead-bc8b-85f87cf19545.88fb5153-ab87-4bbe-bc0d-cc72da303e38 Aug 29 01:14:49 devstack sudo[92912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:14:49 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cda9ea5-a808-453e-b843-d2f493743cd9]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:14:49 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-83a603c7-01f2-44b5-8314-c3826adb5a18 tempest-VolumesActionsTest-44467744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-7e35190e-8fa7-41c3-8ef2-5992af2083d1 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:14:49 devstack sudo[92914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-7e35190e-8fa7-41c3-8ef2-5992af2083d1 Aug 29 01:14:49 devstack sudo[92914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:14:49 devstack sudo[92912]: pam_unix(sudo:session): session closed for user root Aug 29 01:14:49 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-ae9eae22-c7f0-4dd5-bbf6-0a8bb21fc508 tempest-VolumeSnapshotQuotasNegativeTestJSON-1508612450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a83a2102-ae06-4ead-bc8b-85f87cf19545.88fb5153-ab87-4bbe-bc0d-cc72da303e38" returned: 0 in 0.295s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:14:49 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-ae9eae22-c7f0-4dd5-bbf6-0a8bb21fc508 tempest-VolumeSnapshotQuotasNegativeTestJSON-1508612450 None] Lock "cinder-quobyte-88fb5153-ab87-4bbe-bc0d-cc72da303e38" released by "_delete_snapshot" :: held 1.800s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:14:49 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-ae9eae22-c7f0-4dd5-bbf6-0a8bb21fc508 tempest-VolumeSnapshotQuotasNegativeTestJSON-1508612450 None] Lock "cinder-quobyte-a83a2102-ae06-4ead-bc8b-85f87cf19545" released by "delete_snapshot" :: held 1.835s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:14:49 devstack cinder-volume[86111]: WARNING cinder.quota [None req-ae9eae22-c7f0-4dd5-bbf6-0a8bb21fc508 tempest-VolumeSnapshotQuotasNegativeTestJSON-1508612450 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Aug 29 01:14:49 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-ae9eae22-c7f0-4dd5-bbf6-0a8bb21fc508 tempest-VolumeSnapshotQuotasNegativeTestJSON-1508612450 None] Created reservations ['fd0fd291-d022-4460-942f-ee6b64fa28d5', '91bdf8ac-3c40-40a0-98e2-ce1a479f86b0', 'd44e7045-5ad4-44c0-ab57-f71c552cbb5b', '8a5720ed-1b5c-41d3-a24c-a07f5e1c8043'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:14:49 devstack sudo[92914]: pam_unix(sudo:session): session closed for user root Aug 29 01:14:49 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-83a603c7-01f2-44b5-8314-c3826adb5a18 tempest-VolumesActionsTest-44467744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-7e35190e-8fa7-41c3-8ef2-5992af2083d1" returned: 0 in 0.397s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:14:49 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-83a603c7-01f2-44b5-8314-c3826adb5a18 tempest-VolumesActionsTest-44467744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-7e35190e-8fa7-41c3-8ef2-5992af2083d1 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:14:49 devstack sudo[92920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-7e35190e-8fa7-41c3-8ef2-5992af2083d1 Aug 29 01:14:49 devstack sudo[92920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:14:49 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-ae9eae22-c7f0-4dd5-bbf6-0a8bb21fc508 tempest-VolumeSnapshotQuotasNegativeTestJSON-1508612450 None] Delete snapshot completed successfully. Aug 29 01:14:49 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-ae9eae22-c7f0-4dd5-bbf6-0a8bb21fc508 tempest-VolumeSnapshotQuotasNegativeTestJSON-1508612450 None] Lock "cinder-88fb5153-ab87-4bbe-bc0d-cc72da303e38-delete_snapshot" released by "delete_snapshot" :: held 2.024s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:14:49 devstack sudo[92920]: pam_unix(sudo:session): session closed for user root Aug 29 01:14:49 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-83a603c7-01f2-44b5-8314-c3826adb5a18 tempest-VolumesActionsTest-44467744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-7e35190e-8fa7-41c3-8ef2-5992af2083d1" returned: 0 in 0.256s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:14:49 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-8664d0f0-8b21-41d4-b142-f6c49e0bfcd9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1508612450 None] Acquiring lock "cinder-a83a2102-ae06-4ead-bc8b-85f87cf19545-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:14:49 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-83a603c7-01f2-44b5-8314-c3826adb5a18 tempest-VolumesActionsTest-44467744 None] Lock "cinder-quobyte-7e35190e-8fa7-41c3-8ef2-5992af2083d1" released by "delete_volume" :: held 0.709s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:14:49 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-8664d0f0-8b21-41d4-b142-f6c49e0bfcd9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1508612450 None] Lock "cinder-a83a2102-ae06-4ead-bc8b-85f87cf19545-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:14:49 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-8664d0f0-8b21-41d4-b142-f6c49e0bfcd9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1508612450 None] Acquiring lock "cinder-quobyte-a83a2102-ae06-4ead-bc8b-85f87cf19545" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:14:49 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-83a603c7-01f2-44b5-8314-c3826adb5a18 tempest-VolumesActionsTest-44467744 None] Created reservations ['2c0e962e-a377-473a-a173-e8b0bdc223b6', '008e3cc5-0e96-4924-8efb-621ee84d37d1', 'a770cb38-75cd-4697-ac3e-bcd5fd441a30', 'f0f906ce-8b91-41f4-92e4-ad0c2704fd76'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:14:49 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-8664d0f0-8b21-41d4-b142-f6c49e0bfcd9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1508612450 None] Lock "cinder-quobyte-a83a2102-ae06-4ead-bc8b-85f87cf19545" acquired by "delete_volume" :: waited 0.023s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:14:49 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d9d76a6-63d4-4330-99e6-d154e8c852ea]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:14:49 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8664d0f0-8b21-41d4-b142-f6c49e0bfcd9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1508612450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a83a2102-ae06-4ead-bc8b-85f87cf19545 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:14:50 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-83a603c7-01f2-44b5-8314-c3826adb5a18 tempest-VolumesActionsTest-44467744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:14:50 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-83a603c7-01f2-44b5-8314-c3826adb5a18 tempest-VolumesActionsTest-44467744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:14:50 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-83a603c7-01f2-44b5-8314-c3826adb5a18 tempest-VolumesActionsTest-44467744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:14:50 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-83a603c7-01f2-44b5-8314-c3826adb5a18 tempest-VolumesActionsTest-44467744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:14:50 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-83a603c7-01f2-44b5-8314-c3826adb5a18 tempest-VolumesActionsTest-44467744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:14:50 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-83a603c7-01f2-44b5-8314-c3826adb5a18 tempest-VolumesActionsTest-44467744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:14:50 devstack sudo[92924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:14:50 devstack sudo[92924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:14:50 devstack sudo[92923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a83a2102-ae06-4ead-bc8b-85f87cf19545 Aug 29 01:14:50 devstack sudo[92923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:14:50 devstack sudo[92924]: pam_unix(sudo:session): session closed for user root Aug 29 01:14:50 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-83a603c7-01f2-44b5-8314-c3826adb5a18 tempest-VolumesActionsTest-44467744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.326s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:14:50 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-83a603c7-01f2-44b5-8314-c3826adb5a18 tempest-VolumesActionsTest-44467744 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:14:50 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-83a603c7-01f2-44b5-8314-c3826adb5a18 tempest-VolumesActionsTest-44467744 None] Deleted volume successfully. Aug 29 01:14:50 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-83a603c7-01f2-44b5-8314-c3826adb5a18 tempest-VolumesActionsTest-44467744 None] Lock "cinder-7e35190e-8fa7-41c3-8ef2-5992af2083d1-delete_volume" released by "delete_volume" :: held 1.397s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:14:50 devstack sudo[92923]: pam_unix(sudo:session): session closed for user root Aug 29 01:14:50 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8664d0f0-8b21-41d4-b142-f6c49e0bfcd9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1508612450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a83a2102-ae06-4ead-bc8b-85f87cf19545" returned: 0 in 0.449s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:14:50 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8664d0f0-8b21-41d4-b142-f6c49e0bfcd9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1508612450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a83a2102-ae06-4ead-bc8b-85f87cf19545 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:14:50 devstack sudo[92931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a83a2102-ae06-4ead-bc8b-85f87cf19545 Aug 29 01:14:50 devstack sudo[92931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:14:50 devstack sudo[92931]: pam_unix(sudo:session): session closed for user root Aug 29 01:14:50 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8664d0f0-8b21-41d4-b142-f6c49e0bfcd9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1508612450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a83a2102-ae06-4ead-bc8b-85f87cf19545" returned: 0 in 0.427s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:14:50 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-8664d0f0-8b21-41d4-b142-f6c49e0bfcd9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1508612450 None] Lock "cinder-quobyte-a83a2102-ae06-4ead-bc8b-85f87cf19545" released by "delete_volume" :: held 0.948s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:14:50 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-8664d0f0-8b21-41d4-b142-f6c49e0bfcd9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1508612450 None] Created reservations ['44dd83c4-87a7-4835-a088-795de7a3e0b7', 'ec128e4d-8f28-4499-8663-b5900c180bb8', '03a02eaf-1a46-4cee-81b2-77839821173e', '439d8378-7adf-4f16-848d-3fac1b65ad79'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:14:50 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ae5c564-2999-4e13-9918-ffb701b6e0b8 tempest-VolumesActionsTest-728309357 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:14:50 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-3ae5c564-2999-4e13-9918-ffb701b6e0b8 tempest-VolumesActionsTest-728309357 None] Flow 'volume_create_manager' (d3d01b2d-8227-40b1-86e2-928df04d7a51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:14:50 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-3ae5c564-2999-4e13-9918-ffb701b6e0b8 tempest-VolumesActionsTest-728309357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30c56bc5-98a6-42df-9af7-28f6832d3b22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:14:51 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-3ae5c564-2999-4e13-9918-ffb701b6e0b8 tempest-VolumesActionsTest-728309357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30c56bc5-98a6-42df-9af7-28f6832d3b22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:14:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-483080075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42d712b5-4f6e-493c-a236-7a79b8a3802e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6ee2a844fb74fa88050b13a10c9487f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:14:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:14:51Z,use_quota=True,user_id='d5d10b5589044eaf81e496cca37ae3b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:14:51 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-3ae5c564-2999-4e13-9918-ffb701b6e0b8 tempest-VolumesActionsTest-728309357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cfe0869-74b6-43e8-a22b-3792cfbd7e49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:14:51 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-3ae5c564-2999-4e13-9918-ffb701b6e0b8 tempest-VolumesActionsTest-728309357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cfe0869-74b6-43e8-a22b-3792cfbd7e49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:14:51 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-3ae5c564-2999-4e13-9918-ffb701b6e0b8 tempest-VolumesActionsTest-728309357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f55e0d80-e329-452a-9066-db7b752f6397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:14:51 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-3ae5c564-2999-4e13-9918-ffb701b6e0b8 tempest-VolumesActionsTest-728309357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f55e0d80-e329-452a-9066-db7b752f6397) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42d712b5-4f6e-493c-a236-7a79b8a3802e', 'volume_name': 'volume-42d712b5-4f6e-493c-a236-7a79b8a3802e', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:14:51 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-3ae5c564-2999-4e13-9918-ffb701b6e0b8 tempest-VolumesActionsTest-728309357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae8f62c4-18b7-45c4-b26e-64229ac45ad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:14:51 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-3ae5c564-2999-4e13-9918-ffb701b6e0b8 tempest-VolumesActionsTest-728309357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae8f62c4-18b7-45c4-b26e-64229ac45ad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:14:51 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-3ae5c564-2999-4e13-9918-ffb701b6e0b8 tempest-VolumesActionsTest-728309357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03818f37-75ef-45af-b9ee-cf7cbf73b9fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:14:51 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-3ae5c564-2999-4e13-9918-ffb701b6e0b8 tempest-VolumesActionsTest-728309357 None] Volume 42d712b5-4f6e-493c-a236-7a79b8a3802e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42d712b5-4f6e-493c-a236-7a79b8a3802e', 'volume_size': 1} Aug 29 01:14:51 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-3ae5c564-2999-4e13-9918-ffb701b6e0b8 tempest-VolumesActionsTest-728309357 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:14:51 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-3ae5c564-2999-4e13-9918-ffb701b6e0b8 tempest-VolumesActionsTest-728309357 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:14:51 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-3ae5c564-2999-4e13-9918-ffb701b6e0b8 tempest-VolumesActionsTest-728309357 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:14:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-483080075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42d712b5-4f6e-493c-a236-7a79b8a3802e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6ee2a844fb74fa88050b13a10c9487f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:14:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:14:51Z,use_quota=True,user_id='d5d10b5589044eaf81e496cca37ae3b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:14:51 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-3ae5c564-2999-4e13-9918-ffb701b6e0b8 tempest-VolumesActionsTest-728309357 None] Creating volume 42d712b5-4f6e-493c-a236-7a79b8a3802e {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:14:51 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-3ae5c564-2999-4e13-9918-ffb701b6e0b8 tempest-VolumesActionsTest-728309357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:14:51 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-3ae5c564-2999-4e13-9918-ffb701b6e0b8 tempest-VolumesActionsTest-728309357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:14:51 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-3ae5c564-2999-4e13-9918-ffb701b6e0b8 tempest-VolumesActionsTest-728309357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:14:51 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-3ae5c564-2999-4e13-9918-ffb701b6e0b8 tempest-VolumesActionsTest-728309357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:14:51 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-3ae5c564-2999-4e13-9918-ffb701b6e0b8 tempest-VolumesActionsTest-728309357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:14:51 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-3ae5c564-2999-4e13-9918-ffb701b6e0b8 tempest-VolumesActionsTest-728309357 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:14:51 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-3ae5c564-2999-4e13-9918-ffb701b6e0b8 tempest-VolumesActionsTest-728309357 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:14:51 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-3ae5c564-2999-4e13-9918-ffb701b6e0b8 tempest-VolumesActionsTest-728309357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-42d712b5-4f6e-493c-a236-7a79b8a3802e 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:14:51 devstack sudo[92934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-42d712b5-4f6e-493c-a236-7a79b8a3802e 1073741824 Aug 29 01:14:51 devstack sudo[92934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:14:51 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-8664d0f0-8b21-41d4-b142-f6c49e0bfcd9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1508612450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:14:51 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-8664d0f0-8b21-41d4-b142-f6c49e0bfcd9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1508612450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:14:51 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-8664d0f0-8b21-41d4-b142-f6c49e0bfcd9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1508612450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:14:51 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-8664d0f0-8b21-41d4-b142-f6c49e0bfcd9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1508612450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:14:51 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-8664d0f0-8b21-41d4-b142-f6c49e0bfcd9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1508612450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:14:51 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8664d0f0-8b21-41d4-b142-f6c49e0bfcd9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1508612450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:14:51 devstack sudo[92936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:14:51 devstack sudo[92936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:14:51 devstack sudo[92936]: pam_unix(sudo:session): session closed for user root Aug 29 01:14:51 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8664d0f0-8b21-41d4-b142-f6c49e0bfcd9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1508612450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.313s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:14:51 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-8664d0f0-8b21-41d4-b142-f6c49e0bfcd9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1508612450 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:14:51 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-8664d0f0-8b21-41d4-b142-f6c49e0bfcd9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1508612450 None] Deleted volume successfully. Aug 29 01:14:51 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-8664d0f0-8b21-41d4-b142-f6c49e0bfcd9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1508612450 None] Lock "cinder-a83a2102-ae06-4ead-bc8b-85f87cf19545-delete_volume" released by "delete_volume" :: held 1.686s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:14:51 devstack sudo[92934]: pam_unix(sudo:session): session closed for user root Aug 29 01:14:51 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-3ae5c564-2999-4e13-9918-ffb701b6e0b8 tempest-VolumesActionsTest-728309357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-42d712b5-4f6e-493c-a236-7a79b8a3802e 1073741824" returned: 0 in 0.631s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:14:51 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-3ae5c564-2999-4e13-9918-ffb701b6e0b8 tempest-VolumesActionsTest-728309357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-42d712b5-4f6e-493c-a236-7a79b8a3802e {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:14:51 devstack sudo[92943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-42d712b5-4f6e-493c-a236-7a79b8a3802e Aug 29 01:14:51 devstack sudo[92943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:14:52 devstack sudo[92943]: pam_unix(sudo:session): session closed for user root Aug 29 01:14:52 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-3ae5c564-2999-4e13-9918-ffb701b6e0b8 tempest-VolumesActionsTest-728309357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-42d712b5-4f6e-493c-a236-7a79b8a3802e" returned: 0 in 0.310s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:14:52 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-3ae5c564-2999-4e13-9918-ffb701b6e0b8 tempest-VolumesActionsTest-728309357 None] <== create_volume: return (1012ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:14:52 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-3ae5c564-2999-4e13-9918-ffb701b6e0b8 tempest-VolumesActionsTest-728309357 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.014s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:14:52 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-3ae5c564-2999-4e13-9918-ffb701b6e0b8 tempest-VolumesActionsTest-728309357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03818f37-75ef-45af-b9ee-cf7cbf73b9fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42d712b5-4f6e-493c-a236-7a79b8a3802e', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:14:52 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-3ae5c564-2999-4e13-9918-ffb701b6e0b8 tempest-VolumesActionsTest-728309357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3b3071d-04aa-40da-b024-10751089accb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:14:52 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-3ae5c564-2999-4e13-9918-ffb701b6e0b8 tempest-VolumesActionsTest-728309357 None] Volume volume-42d712b5-4f6e-493c-a236-7a79b8a3802e (42d712b5-4f6e-493c-a236-7a79b8a3802e): created successfully Aug 29 01:14:52 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-3ae5c564-2999-4e13-9918-ffb701b6e0b8 tempest-VolumesActionsTest-728309357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3b3071d-04aa-40da-b024-10751089accb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:14:52 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-3ae5c564-2999-4e13-9918-ffb701b6e0b8 tempest-VolumesActionsTest-728309357 None] Flow 'volume_create_manager' (d3d01b2d-8227-40b1-86e2-928df04d7a51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:14:52 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-3ae5c564-2999-4e13-9918-ffb701b6e0b8 tempest-VolumesActionsTest-728309357 None] Created volume successfully. Aug 29 01:14:53 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-185fd85d-4410-430a-a46d-9ac9b60c5558 tempest-VolumesActionsTest-44467744 None] Acquiring lock "cinder-42d712b5-4f6e-493c-a236-7a79b8a3802e-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:14:53 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-185fd85d-4410-430a-a46d-9ac9b60c5558 tempest-VolumesActionsTest-44467744 None] Lock "cinder-42d712b5-4f6e-493c-a236-7a79b8a3802e-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:14:53 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-185fd85d-4410-430a-a46d-9ac9b60c5558 tempest-VolumesActionsTest-44467744 None] Acquiring lock "cinder-quobyte-42d712b5-4f6e-493c-a236-7a79b8a3802e" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:14:53 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-185fd85d-4410-430a-a46d-9ac9b60c5558 tempest-VolumesActionsTest-44467744 None] Lock "cinder-quobyte-42d712b5-4f6e-493c-a236-7a79b8a3802e" acquired by "delete_volume" :: waited 0.016s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:14:53 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[90d6a7de-bd81-461e-bda1-3bc078bf6aed]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:14:53 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-185fd85d-4410-430a-a46d-9ac9b60c5558 tempest-VolumesActionsTest-44467744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-42d712b5-4f6e-493c-a236-7a79b8a3802e {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:14:53 devstack sudo[92946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-42d712b5-4f6e-493c-a236-7a79b8a3802e Aug 29 01:14:53 devstack sudo[92946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:14:53 devstack sudo[92946]: pam_unix(sudo:session): session closed for user root Aug 29 01:14:53 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-185fd85d-4410-430a-a46d-9ac9b60c5558 tempest-VolumesActionsTest-44467744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-42d712b5-4f6e-493c-a236-7a79b8a3802e" returned: 0 in 0.433s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:14:53 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-185fd85d-4410-430a-a46d-9ac9b60c5558 tempest-VolumesActionsTest-44467744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-42d712b5-4f6e-493c-a236-7a79b8a3802e {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:14:53 devstack sudo[92951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-42d712b5-4f6e-493c-a236-7a79b8a3802e Aug 29 01:14:53 devstack sudo[92951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:14:54 devstack sudo[92951]: pam_unix(sudo:session): session closed for user root Aug 29 01:14:54 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-185fd85d-4410-430a-a46d-9ac9b60c5558 tempest-VolumesActionsTest-44467744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-42d712b5-4f6e-493c-a236-7a79b8a3802e" returned: 0 in 0.314s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:14:54 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-185fd85d-4410-430a-a46d-9ac9b60c5558 tempest-VolumesActionsTest-44467744 None] Lock "cinder-quobyte-42d712b5-4f6e-493c-a236-7a79b8a3802e" released by "delete_volume" :: held 0.817s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:14:54 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-185fd85d-4410-430a-a46d-9ac9b60c5558 tempest-VolumesActionsTest-44467744 None] Created reservations ['f4146a7c-b4c9-454a-8553-624e844b2a5a', 'bf269979-5af7-4442-a52e-b91159b8bf27', '063fe1f9-11c6-47ac-a997-a851048437da', '82cad53d-4fb0-41fc-89db-f10923ec64af'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:14:54 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-185fd85d-4410-430a-a46d-9ac9b60c5558 tempest-VolumesActionsTest-44467744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:14:54 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-185fd85d-4410-430a-a46d-9ac9b60c5558 tempest-VolumesActionsTest-44467744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:14:54 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-185fd85d-4410-430a-a46d-9ac9b60c5558 tempest-VolumesActionsTest-44467744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:14:54 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-185fd85d-4410-430a-a46d-9ac9b60c5558 tempest-VolumesActionsTest-44467744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:14:54 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-185fd85d-4410-430a-a46d-9ac9b60c5558 tempest-VolumesActionsTest-44467744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:14:54 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-185fd85d-4410-430a-a46d-9ac9b60c5558 tempest-VolumesActionsTest-44467744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:14:54 devstack sudo[92954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:14:54 devstack sudo[92954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:14:54 devstack sudo[92954]: pam_unix(sudo:session): session closed for user root Aug 29 01:14:54 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-185fd85d-4410-430a-a46d-9ac9b60c5558 tempest-VolumesActionsTest-44467744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.333s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:14:54 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-185fd85d-4410-430a-a46d-9ac9b60c5558 tempest-VolumesActionsTest-44467744 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:14:54 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-185fd85d-4410-430a-a46d-9ac9b60c5558 tempest-VolumesActionsTest-44467744 None] Deleted volume successfully. Aug 29 01:14:54 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-185fd85d-4410-430a-a46d-9ac9b60c5558 tempest-VolumesActionsTest-44467744 None] Lock "cinder-42d712b5-4f6e-493c-a236-7a79b8a3802e-delete_volume" released by "delete_volume" :: held 1.403s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:14:55 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c566a95-b5d6-475c-8bca-2ce533af36ef tempest-VolumesActionsTest-728309357 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:14:55 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-5c566a95-b5d6-475c-8bca-2ce533af36ef tempest-VolumesActionsTest-728309357 None] Flow 'volume_create_manager' (c0a53619-cdea-4a5c-a62c-0a0b90354e9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:14:55 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-5c566a95-b5d6-475c-8bca-2ce533af36ef tempest-VolumesActionsTest-728309357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (606fc637-9fe7-463e-a8d6-017f84948527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:14:55 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-5c566a95-b5d6-475c-8bca-2ce533af36ef tempest-VolumesActionsTest-728309357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (606fc637-9fe7-463e-a8d6-017f84948527) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:14:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1383251308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6af68b69-e714-48a0-943f-da4799acc499,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6ee2a844fb74fa88050b13a10c9487f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:14:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:14:55Z,use_quota=True,user_id='d5d10b5589044eaf81e496cca37ae3b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:14:55 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-5c566a95-b5d6-475c-8bca-2ce533af36ef tempest-VolumesActionsTest-728309357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90d17da6-aabd-4ced-a61c-b464afff8b45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:14:55 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-5c566a95-b5d6-475c-8bca-2ce533af36ef tempest-VolumesActionsTest-728309357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90d17da6-aabd-4ced-a61c-b464afff8b45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:14:55 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-5c566a95-b5d6-475c-8bca-2ce533af36ef tempest-VolumesActionsTest-728309357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a41af942-947a-4202-ae10-4cef594df6a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:14:55 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-5c566a95-b5d6-475c-8bca-2ce533af36ef tempest-VolumesActionsTest-728309357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a41af942-947a-4202-ae10-4cef594df6a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6af68b69-e714-48a0-943f-da4799acc499', 'volume_name': 'volume-6af68b69-e714-48a0-943f-da4799acc499', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:14:55 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-5c566a95-b5d6-475c-8bca-2ce533af36ef tempest-VolumesActionsTest-728309357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af77a9c7-8026-4000-82ed-8c512cb663c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:14:55 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-5c566a95-b5d6-475c-8bca-2ce533af36ef tempest-VolumesActionsTest-728309357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af77a9c7-8026-4000-82ed-8c512cb663c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:14:55 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-5c566a95-b5d6-475c-8bca-2ce533af36ef tempest-VolumesActionsTest-728309357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a08c1a8a-b666-4339-8172-758f23b1371a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:14:55 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-5c566a95-b5d6-475c-8bca-2ce533af36ef tempest-VolumesActionsTest-728309357 None] Volume 6af68b69-e714-48a0-943f-da4799acc499: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6af68b69-e714-48a0-943f-da4799acc499', 'volume_size': 1} Aug 29 01:14:55 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-5c566a95-b5d6-475c-8bca-2ce533af36ef tempest-VolumesActionsTest-728309357 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:14:55 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-5c566a95-b5d6-475c-8bca-2ce533af36ef tempest-VolumesActionsTest-728309357 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:14:55 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-5c566a95-b5d6-475c-8bca-2ce533af36ef tempest-VolumesActionsTest-728309357 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:14:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1383251308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6af68b69-e714-48a0-943f-da4799acc499,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6ee2a844fb74fa88050b13a10c9487f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:14:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:14:55Z,use_quota=True,user_id='d5d10b5589044eaf81e496cca37ae3b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:14:55 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-5c566a95-b5d6-475c-8bca-2ce533af36ef tempest-VolumesActionsTest-728309357 None] Creating volume 6af68b69-e714-48a0-943f-da4799acc499 {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:14:55 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-5c566a95-b5d6-475c-8bca-2ce533af36ef tempest-VolumesActionsTest-728309357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:14:55 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-5c566a95-b5d6-475c-8bca-2ce533af36ef tempest-VolumesActionsTest-728309357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:14:55 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-5c566a95-b5d6-475c-8bca-2ce533af36ef tempest-VolumesActionsTest-728309357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:14:55 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-5c566a95-b5d6-475c-8bca-2ce533af36ef tempest-VolumesActionsTest-728309357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:14:55 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-5c566a95-b5d6-475c-8bca-2ce533af36ef tempest-VolumesActionsTest-728309357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:14:55 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-5c566a95-b5d6-475c-8bca-2ce533af36ef tempest-VolumesActionsTest-728309357 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:14:55 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-5c566a95-b5d6-475c-8bca-2ce533af36ef tempest-VolumesActionsTest-728309357 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:14:55 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-5c566a95-b5d6-475c-8bca-2ce533af36ef tempest-VolumesActionsTest-728309357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-6af68b69-e714-48a0-943f-da4799acc499 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:14:55 devstack sudo[92957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-6af68b69-e714-48a0-943f-da4799acc499 1073741824 Aug 29 01:14:55 devstack sudo[92957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:14:55 devstack sudo[92957]: pam_unix(sudo:session): session closed for user root Aug 29 01:14:55 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-5c566a95-b5d6-475c-8bca-2ce533af36ef tempest-VolumesActionsTest-728309357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-6af68b69-e714-48a0-943f-da4799acc499 1073741824" returned: 0 in 0.499s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:14:55 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-5c566a95-b5d6-475c-8bca-2ce533af36ef tempest-VolumesActionsTest-728309357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-6af68b69-e714-48a0-943f-da4799acc499 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:14:55 devstack sudo[92963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-6af68b69-e714-48a0-943f-da4799acc499 Aug 29 01:14:55 devstack sudo[92963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:14:55 devstack sudo[92963]: pam_unix(sudo:session): session closed for user root Aug 29 01:14:55 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-5c566a95-b5d6-475c-8bca-2ce533af36ef tempest-VolumesActionsTest-728309357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-6af68b69-e714-48a0-943f-da4799acc499" returned: 0 in 0.323s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:14:55 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-5c566a95-b5d6-475c-8bca-2ce533af36ef tempest-VolumesActionsTest-728309357 None] <== create_volume: return (882ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:14:55 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-5c566a95-b5d6-475c-8bca-2ce533af36ef tempest-VolumesActionsTest-728309357 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.884s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:14:56 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-5c566a95-b5d6-475c-8bca-2ce533af36ef tempest-VolumesActionsTest-728309357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a08c1a8a-b666-4339-8172-758f23b1371a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6af68b69-e714-48a0-943f-da4799acc499', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:14:56 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-5c566a95-b5d6-475c-8bca-2ce533af36ef tempest-VolumesActionsTest-728309357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7b8573d-955a-4e40-9359-944d33e7b9eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:14:56 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-5c566a95-b5d6-475c-8bca-2ce533af36ef tempest-VolumesActionsTest-728309357 None] Volume volume-6af68b69-e714-48a0-943f-da4799acc499 (6af68b69-e714-48a0-943f-da4799acc499): created successfully Aug 29 01:14:56 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-5c566a95-b5d6-475c-8bca-2ce533af36ef tempest-VolumesActionsTest-728309357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7b8573d-955a-4e40-9359-944d33e7b9eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:14:56 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-5c566a95-b5d6-475c-8bca-2ce533af36ef tempest-VolumesActionsTest-728309357 None] Flow 'volume_create_manager' (c0a53619-cdea-4a5c-a62c-0a0b90354e9e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:14:56 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-5c566a95-b5d6-475c-8bca-2ce533af36ef tempest-VolumesActionsTest-728309357 None] Created volume successfully. Aug 29 01:14:57 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-26adc94d-fa91-4ffd-80a2-98875ffa6853 tempest-VolumesActionsTest-44467744 None] Acquiring lock "cinder-6af68b69-e714-48a0-943f-da4799acc499-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:14:57 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-26adc94d-fa91-4ffd-80a2-98875ffa6853 tempest-VolumesActionsTest-44467744 None] Lock "cinder-6af68b69-e714-48a0-943f-da4799acc499-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:14:57 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-26adc94d-fa91-4ffd-80a2-98875ffa6853 tempest-VolumesActionsTest-44467744 None] Acquiring lock "cinder-quobyte-6af68b69-e714-48a0-943f-da4799acc499" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:14:57 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-26adc94d-fa91-4ffd-80a2-98875ffa6853 tempest-VolumesActionsTest-44467744 None] Lock "cinder-quobyte-6af68b69-e714-48a0-943f-da4799acc499" acquired by "delete_volume" :: waited 0.025s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:14:57 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aa5ef12-34a6-4b0c-831e-a01ca4059827]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:14:57 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-26adc94d-fa91-4ffd-80a2-98875ffa6853 tempest-VolumesActionsTest-44467744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-6af68b69-e714-48a0-943f-da4799acc499 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:14:57 devstack sudo[92970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-6af68b69-e714-48a0-943f-da4799acc499 Aug 29 01:14:57 devstack sudo[92970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:14:58 devstack sudo[92970]: pam_unix(sudo:session): session closed for user root Aug 29 01:14:58 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-26adc94d-fa91-4ffd-80a2-98875ffa6853 tempest-VolumesActionsTest-44467744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-6af68b69-e714-48a0-943f-da4799acc499" returned: 0 in 0.491s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:14:58 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-26adc94d-fa91-4ffd-80a2-98875ffa6853 tempest-VolumesActionsTest-44467744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-6af68b69-e714-48a0-943f-da4799acc499 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:14:58 devstack sudo[92979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-6af68b69-e714-48a0-943f-da4799acc499 Aug 29 01:14:58 devstack sudo[92979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:14:58 devstack sudo[92979]: pam_unix(sudo:session): session closed for user root Aug 29 01:14:58 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-26adc94d-fa91-4ffd-80a2-98875ffa6853 tempest-VolumesActionsTest-44467744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-6af68b69-e714-48a0-943f-da4799acc499" returned: 0 in 0.325s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:14:58 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-26adc94d-fa91-4ffd-80a2-98875ffa6853 tempest-VolumesActionsTest-44467744 None] Lock "cinder-quobyte-6af68b69-e714-48a0-943f-da4799acc499" released by "delete_volume" :: held 0.893s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:14:58 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-26adc94d-fa91-4ffd-80a2-98875ffa6853 tempest-VolumesActionsTest-44467744 None] Created reservations ['9cd49733-56c6-44cc-bb53-21fe2bbf772f', '0d02e11d-15e4-4a76-8fcb-61493a645781', '90094521-3fb8-48b1-b947-1917607cb2c5', 'e7224b53-cd01-4117-b187-3c633e406edd'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:14:58 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-26adc94d-fa91-4ffd-80a2-98875ffa6853 tempest-VolumesActionsTest-44467744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:14:58 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-26adc94d-fa91-4ffd-80a2-98875ffa6853 tempest-VolumesActionsTest-44467744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:14:58 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-26adc94d-fa91-4ffd-80a2-98875ffa6853 tempest-VolumesActionsTest-44467744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:14:58 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-26adc94d-fa91-4ffd-80a2-98875ffa6853 tempest-VolumesActionsTest-44467744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:14:58 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-26adc94d-fa91-4ffd-80a2-98875ffa6853 tempest-VolumesActionsTest-44467744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:14:58 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-26adc94d-fa91-4ffd-80a2-98875ffa6853 tempest-VolumesActionsTest-44467744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:14:58 devstack sudo[92992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:14:58 devstack sudo[92992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:14:58 devstack sudo[92992]: pam_unix(sudo:session): session closed for user root Aug 29 01:14:58 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-26adc94d-fa91-4ffd-80a2-98875ffa6853 tempest-VolumesActionsTest-44467744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.290s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:14:58 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-26adc94d-fa91-4ffd-80a2-98875ffa6853 tempest-VolumesActionsTest-44467744 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:14:58 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-26adc94d-fa91-4ffd-80a2-98875ffa6853 tempest-VolumesActionsTest-44467744 None] Deleted volume successfully. Aug 29 01:14:58 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-26adc94d-fa91-4ffd-80a2-98875ffa6853 tempest-VolumesActionsTest-44467744 None] Lock "cinder-6af68b69-e714-48a0-943f-da4799acc499-delete_volume" released by "delete_volume" :: held 1.564s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:15:00 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-728f3786-ac0d-455d-90e3-8ba5b89f20b9 tempest-VolumesActionsTest-728309357 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:15:00 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-728f3786-ac0d-455d-90e3-8ba5b89f20b9 tempest-VolumesActionsTest-728309357 None] Flow 'volume_create_manager' (33fdf558-f641-43e8-9f1c-283e0b46d7c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:15:00 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-728f3786-ac0d-455d-90e3-8ba5b89f20b9 tempest-VolumesActionsTest-728309357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (009f1fd8-d844-497f-ba7b-24c01bb26630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:15:00 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-728f3786-ac0d-455d-90e3-8ba5b89f20b9 tempest-VolumesActionsTest-728309357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (009f1fd8-d844-497f-ba7b-24c01bb26630) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:15:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1217317928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d02143c2-d3fb-4fa6-a472-98ed609fee27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6ee2a844fb74fa88050b13a10c9487f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:15:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:15:00Z,use_quota=True,user_id='d5d10b5589044eaf81e496cca37ae3b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:15:00 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-728f3786-ac0d-455d-90e3-8ba5b89f20b9 tempest-VolumesActionsTest-728309357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff88b0e7-ed5b-41b9-ab44-5bba5ac2aa3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:15:00 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-728f3786-ac0d-455d-90e3-8ba5b89f20b9 tempest-VolumesActionsTest-728309357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff88b0e7-ed5b-41b9-ab44-5bba5ac2aa3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:15:00 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-728f3786-ac0d-455d-90e3-8ba5b89f20b9 tempest-VolumesActionsTest-728309357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9fa02f1-320e-48ed-a9bb-fb42263d86bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:15:00 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-728f3786-ac0d-455d-90e3-8ba5b89f20b9 tempest-VolumesActionsTest-728309357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9fa02f1-320e-48ed-a9bb-fb42263d86bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd02143c2-d3fb-4fa6-a472-98ed609fee27', 'volume_name': 'volume-d02143c2-d3fb-4fa6-a472-98ed609fee27', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:15:00 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-728f3786-ac0d-455d-90e3-8ba5b89f20b9 tempest-VolumesActionsTest-728309357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6260b8f-2822-4789-926a-c2b182e6d671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:15:00 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-728f3786-ac0d-455d-90e3-8ba5b89f20b9 tempest-VolumesActionsTest-728309357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6260b8f-2822-4789-926a-c2b182e6d671) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:15:00 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-728f3786-ac0d-455d-90e3-8ba5b89f20b9 tempest-VolumesActionsTest-728309357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f57f7e7-e548-4520-b399-d0bacb89ebfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:15:00 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-728f3786-ac0d-455d-90e3-8ba5b89f20b9 tempest-VolumesActionsTest-728309357 None] Volume d02143c2-d3fb-4fa6-a472-98ed609fee27: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d02143c2-d3fb-4fa6-a472-98ed609fee27', 'volume_size': 1} Aug 29 01:15:00 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-728f3786-ac0d-455d-90e3-8ba5b89f20b9 tempest-VolumesActionsTest-728309357 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:15:00 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-728f3786-ac0d-455d-90e3-8ba5b89f20b9 tempest-VolumesActionsTest-728309357 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:15:00 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-728f3786-ac0d-455d-90e3-8ba5b89f20b9 tempest-VolumesActionsTest-728309357 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:15:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1217317928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d02143c2-d3fb-4fa6-a472-98ed609fee27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6ee2a844fb74fa88050b13a10c9487f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:15:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:15:00Z,use_quota=True,user_id='d5d10b5589044eaf81e496cca37ae3b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:15:00 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-728f3786-ac0d-455d-90e3-8ba5b89f20b9 tempest-VolumesActionsTest-728309357 None] Creating volume d02143c2-d3fb-4fa6-a472-98ed609fee27 {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:15:00 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-728f3786-ac0d-455d-90e3-8ba5b89f20b9 tempest-VolumesActionsTest-728309357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:15:00 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-728f3786-ac0d-455d-90e3-8ba5b89f20b9 tempest-VolumesActionsTest-728309357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:15:00 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-728f3786-ac0d-455d-90e3-8ba5b89f20b9 tempest-VolumesActionsTest-728309357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:15:00 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-728f3786-ac0d-455d-90e3-8ba5b89f20b9 tempest-VolumesActionsTest-728309357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:15:00 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-728f3786-ac0d-455d-90e3-8ba5b89f20b9 tempest-VolumesActionsTest-728309357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:15:00 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-728f3786-ac0d-455d-90e3-8ba5b89f20b9 tempest-VolumesActionsTest-728309357 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:15:00 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-728f3786-ac0d-455d-90e3-8ba5b89f20b9 tempest-VolumesActionsTest-728309357 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:15:00 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-728f3786-ac0d-455d-90e3-8ba5b89f20b9 tempest-VolumesActionsTest-728309357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-d02143c2-d3fb-4fa6-a472-98ed609fee27 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:15:00 devstack sudo[92999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-d02143c2-d3fb-4fa6-a472-98ed609fee27 1073741824 Aug 29 01:15:00 devstack sudo[92999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:15:01 devstack sudo[92999]: pam_unix(sudo:session): session closed for user root Aug 29 01:15:01 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-728f3786-ac0d-455d-90e3-8ba5b89f20b9 tempest-VolumesActionsTest-728309357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-d02143c2-d3fb-4fa6-a472-98ed609fee27 1073741824" returned: 0 in 0.988s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:15:01 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-728f3786-ac0d-455d-90e3-8ba5b89f20b9 tempest-VolumesActionsTest-728309357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-d02143c2-d3fb-4fa6-a472-98ed609fee27 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:15:01 devstack sudo[93067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-d02143c2-d3fb-4fa6-a472-98ed609fee27 Aug 29 01:15:01 devstack sudo[93067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:15:02 devstack sudo[93067]: pam_unix(sudo:session): session closed for user root Aug 29 01:15:02 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-728f3786-ac0d-455d-90e3-8ba5b89f20b9 tempest-VolumesActionsTest-728309357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-d02143c2-d3fb-4fa6-a472-98ed609fee27" returned: 0 in 0.476s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:15:02 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-728f3786-ac0d-455d-90e3-8ba5b89f20b9 tempest-VolumesActionsTest-728309357 None] <== create_volume: return (1552ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:15:02 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-728f3786-ac0d-455d-90e3-8ba5b89f20b9 tempest-VolumesActionsTest-728309357 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.556s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:15:02 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-728f3786-ac0d-455d-90e3-8ba5b89f20b9 tempest-VolumesActionsTest-728309357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f57f7e7-e548-4520-b399-d0bacb89ebfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d02143c2-d3fb-4fa6-a472-98ed609fee27', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:15:02 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-728f3786-ac0d-455d-90e3-8ba5b89f20b9 tempest-VolumesActionsTest-728309357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65cc907e-f02e-4b3d-8baa-7b41e0fee023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:15:02 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-728f3786-ac0d-455d-90e3-8ba5b89f20b9 tempest-VolumesActionsTest-728309357 None] Volume volume-d02143c2-d3fb-4fa6-a472-98ed609fee27 (d02143c2-d3fb-4fa6-a472-98ed609fee27): created successfully Aug 29 01:15:02 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-728f3786-ac0d-455d-90e3-8ba5b89f20b9 tempest-VolumesActionsTest-728309357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65cc907e-f02e-4b3d-8baa-7b41e0fee023) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:15:02 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-728f3786-ac0d-455d-90e3-8ba5b89f20b9 tempest-VolumesActionsTest-728309357 None] Flow 'volume_create_manager' (33fdf558-f641-43e8-9f1c-283e0b46d7c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:15:02 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-728f3786-ac0d-455d-90e3-8ba5b89f20b9 tempest-VolumesActionsTest-728309357 None] Created volume successfully. Aug 29 01:15:03 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-d039fddc-a234-45b6-b119-951c0d77f9f8 tempest-VolumesActionsTest-728309357 None] Acquiring lock "cinder-d02143c2-d3fb-4fa6-a472-98ed609fee27-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:15:03 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-d039fddc-a234-45b6-b119-951c0d77f9f8 tempest-VolumesActionsTest-728309357 None] Lock "cinder-d02143c2-d3fb-4fa6-a472-98ed609fee27-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:15:03 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-d039fddc-a234-45b6-b119-951c0d77f9f8 tempest-VolumesActionsTest-728309357 None] Acquiring lock "cinder-quobyte-d02143c2-d3fb-4fa6-a472-98ed609fee27" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:15:03 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-d039fddc-a234-45b6-b119-951c0d77f9f8 tempest-VolumesActionsTest-728309357 None] Lock "cinder-quobyte-d02143c2-d3fb-4fa6-a472-98ed609fee27" acquired by "delete_volume" :: waited 0.026s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:15:03 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e8fef99-5258-49cf-a3a6-2e734da3252f]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:15:03 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d039fddc-a234-45b6-b119-951c0d77f9f8 tempest-VolumesActionsTest-728309357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-d02143c2-d3fb-4fa6-a472-98ed609fee27 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:15:03 devstack sudo[93078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-d02143c2-d3fb-4fa6-a472-98ed609fee27 Aug 29 01:15:03 devstack sudo[93078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:15:04 devstack sudo[93078]: pam_unix(sudo:session): session closed for user root Aug 29 01:15:04 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d039fddc-a234-45b6-b119-951c0d77f9f8 tempest-VolumesActionsTest-728309357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-d02143c2-d3fb-4fa6-a472-98ed609fee27" returned: 0 in 0.538s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:15:04 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d039fddc-a234-45b6-b119-951c0d77f9f8 tempest-VolumesActionsTest-728309357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-d02143c2-d3fb-4fa6-a472-98ed609fee27 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:15:04 devstack sudo[93083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-d02143c2-d3fb-4fa6-a472-98ed609fee27 Aug 29 01:15:04 devstack sudo[93083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:15:04 devstack sudo[93083]: pam_unix(sudo:session): session closed for user root Aug 29 01:15:04 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d039fddc-a234-45b6-b119-951c0d77f9f8 tempest-VolumesActionsTest-728309357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-d02143c2-d3fb-4fa6-a472-98ed609fee27" returned: 0 in 0.305s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:15:04 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-d039fddc-a234-45b6-b119-951c0d77f9f8 tempest-VolumesActionsTest-728309357 None] Lock "cinder-quobyte-d02143c2-d3fb-4fa6-a472-98ed609fee27" released by "delete_volume" :: held 0.900s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:15:04 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-d039fddc-a234-45b6-b119-951c0d77f9f8 tempest-VolumesActionsTest-728309357 None] Created reservations ['4b6680b2-4fff-4d7f-b883-dcf0c379b238', 'b971acfb-43c9-4e43-80f0-5364df1034db', '099eda1a-8ba9-4939-bc6d-e95427c2a3e8', 'a161cb9f-b69d-46aa-a45d-646f33387d41'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:15:04 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-d039fddc-a234-45b6-b119-951c0d77f9f8 tempest-VolumesActionsTest-728309357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:15:04 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-d039fddc-a234-45b6-b119-951c0d77f9f8 tempest-VolumesActionsTest-728309357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:15:04 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-d039fddc-a234-45b6-b119-951c0d77f9f8 tempest-VolumesActionsTest-728309357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:15:04 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-d039fddc-a234-45b6-b119-951c0d77f9f8 tempest-VolumesActionsTest-728309357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:15:04 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-d039fddc-a234-45b6-b119-951c0d77f9f8 tempest-VolumesActionsTest-728309357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:15:04 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d039fddc-a234-45b6-b119-951c0d77f9f8 tempest-VolumesActionsTest-728309357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:15:04 devstack sudo[93087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:15:04 devstack sudo[93087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:15:05 devstack sudo[93087]: pam_unix(sudo:session): session closed for user root Aug 29 01:15:05 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d039fddc-a234-45b6-b119-951c0d77f9f8 tempest-VolumesActionsTest-728309357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.399s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:15:05 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-d039fddc-a234-45b6-b119-951c0d77f9f8 tempest-VolumesActionsTest-728309357 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:15:05 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-d039fddc-a234-45b6-b119-951c0d77f9f8 tempest-VolumesActionsTest-728309357 None] Deleted volume successfully. Aug 29 01:15:05 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-d039fddc-a234-45b6-b119-951c0d77f9f8 tempest-VolumesActionsTest-728309357 None] Lock "cinder-d02143c2-d3fb-4fa6-a472-98ed609fee27-delete_volume" released by "delete_volume" :: held 1.727s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:15:06 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-02810298-cc95-4986-9251-3c82a3064822 tempest-VolumesListAdminTestJSON-442426175 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:15:06 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-02810298-cc95-4986-9251-3c82a3064822 tempest-VolumesListAdminTestJSON-442426175 None] Flow 'volume_create_manager' (ea41dc3b-d46a-42d5-a894-0e61f1cff0f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:15:06 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-02810298-cc95-4986-9251-3c82a3064822 tempest-VolumesListAdminTestJSON-442426175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fca0d5b6-4d44-4ead-a364-7362d28c90de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:15:06 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-02810298-cc95-4986-9251-3c82a3064822 tempest-VolumesListAdminTestJSON-442426175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fca0d5b6-4d44-4ead-a364-7362d28c90de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:15:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1013085729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b579d6b-d92d-4056-9189-d9f86b9247a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f370c4f27364a5b84cf743cf69171c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:15:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:15:07Z,use_quota=True,user_id='0526716c091340b5b0a5c66bdab63eb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:15:06 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-02810298-cc95-4986-9251-3c82a3064822 tempest-VolumesListAdminTestJSON-442426175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b57d6dd-96ae-4ed8-b7b4-86f38abcf18f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:15:06 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-02810298-cc95-4986-9251-3c82a3064822 tempest-VolumesListAdminTestJSON-442426175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b57d6dd-96ae-4ed8-b7b4-86f38abcf18f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:15:06 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-02810298-cc95-4986-9251-3c82a3064822 tempest-VolumesListAdminTestJSON-442426175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54f581c9-2641-4506-bbe5-7f71fd7ebbf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:15:06 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-02810298-cc95-4986-9251-3c82a3064822 tempest-VolumesListAdminTestJSON-442426175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54f581c9-2641-4506-bbe5-7f71fd7ebbf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b579d6b-d92d-4056-9189-d9f86b9247a1', 'volume_name': 'volume-0b579d6b-d92d-4056-9189-d9f86b9247a1', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:15:06 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-02810298-cc95-4986-9251-3c82a3064822 tempest-VolumesListAdminTestJSON-442426175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86b7df2b-5a51-43d0-9e1e-24c82af3a253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:15:06 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-02810298-cc95-4986-9251-3c82a3064822 tempest-VolumesListAdminTestJSON-442426175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86b7df2b-5a51-43d0-9e1e-24c82af3a253) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:15:06 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-02810298-cc95-4986-9251-3c82a3064822 tempest-VolumesListAdminTestJSON-442426175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98a13901-a793-47dd-91a2-13b1cfdae9cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:15:06 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-02810298-cc95-4986-9251-3c82a3064822 tempest-VolumesListAdminTestJSON-442426175 None] Volume 0b579d6b-d92d-4056-9189-d9f86b9247a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b579d6b-d92d-4056-9189-d9f86b9247a1', 'volume_size': 1} Aug 29 01:15:06 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-02810298-cc95-4986-9251-3c82a3064822 tempest-VolumesListAdminTestJSON-442426175 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:15:06 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-02810298-cc95-4986-9251-3c82a3064822 tempest-VolumesListAdminTestJSON-442426175 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:15:06 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-02810298-cc95-4986-9251-3c82a3064822 tempest-VolumesListAdminTestJSON-442426175 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:15:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1013085729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b579d6b-d92d-4056-9189-d9f86b9247a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f370c4f27364a5b84cf743cf69171c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:15:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:15:07Z,use_quota=True,user_id='0526716c091340b5b0a5c66bdab63eb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:15:06 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-02810298-cc95-4986-9251-3c82a3064822 tempest-VolumesListAdminTestJSON-442426175 None] Creating volume 0b579d6b-d92d-4056-9189-d9f86b9247a1 {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:15:06 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-02810298-cc95-4986-9251-3c82a3064822 tempest-VolumesListAdminTestJSON-442426175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:15:06 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-02810298-cc95-4986-9251-3c82a3064822 tempest-VolumesListAdminTestJSON-442426175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:15:06 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-02810298-cc95-4986-9251-3c82a3064822 tempest-VolumesListAdminTestJSON-442426175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:15:06 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-02810298-cc95-4986-9251-3c82a3064822 tempest-VolumesListAdminTestJSON-442426175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:15:06 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-02810298-cc95-4986-9251-3c82a3064822 tempest-VolumesListAdminTestJSON-442426175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:15:06 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-02810298-cc95-4986-9251-3c82a3064822 tempest-VolumesListAdminTestJSON-442426175 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:15:06 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-02810298-cc95-4986-9251-3c82a3064822 tempest-VolumesListAdminTestJSON-442426175 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:15:06 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-02810298-cc95-4986-9251-3c82a3064822 tempest-VolumesListAdminTestJSON-442426175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-0b579d6b-d92d-4056-9189-d9f86b9247a1 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:15:06 devstack sudo[93093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-0b579d6b-d92d-4056-9189-d9f86b9247a1 1073741824 Aug 29 01:15:06 devstack sudo[93093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:15:07 devstack sudo[93093]: pam_unix(sudo:session): session closed for user root Aug 29 01:15:07 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-02810298-cc95-4986-9251-3c82a3064822 tempest-VolumesListAdminTestJSON-442426175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-0b579d6b-d92d-4056-9189-d9f86b9247a1 1073741824" returned: 0 in 0.671s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:15:07 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-02810298-cc95-4986-9251-3c82a3064822 tempest-VolumesListAdminTestJSON-442426175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-0b579d6b-d92d-4056-9189-d9f86b9247a1 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:15:07 devstack sudo[93101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-0b579d6b-d92d-4056-9189-d9f86b9247a1 Aug 29 01:15:07 devstack sudo[93101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:15:08 devstack sudo[93101]: pam_unix(sudo:session): session closed for user root Aug 29 01:15:08 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-02810298-cc95-4986-9251-3c82a3064822 tempest-VolumesListAdminTestJSON-442426175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-0b579d6b-d92d-4056-9189-d9f86b9247a1" returned: 0 in 0.549s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:15:08 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-02810298-cc95-4986-9251-3c82a3064822 tempest-VolumesListAdminTestJSON-442426175 None] <== create_volume: return (1290ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:15:08 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-02810298-cc95-4986-9251-3c82a3064822 tempest-VolumesListAdminTestJSON-442426175 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.297s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:15:08 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-02810298-cc95-4986-9251-3c82a3064822 tempest-VolumesListAdminTestJSON-442426175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98a13901-a793-47dd-91a2-13b1cfdae9cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b579d6b-d92d-4056-9189-d9f86b9247a1', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:15:08 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-02810298-cc95-4986-9251-3c82a3064822 tempest-VolumesListAdminTestJSON-442426175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (347f2dd5-ccfa-4de0-a427-c154c5a6d94d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:15:08 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-02810298-cc95-4986-9251-3c82a3064822 tempest-VolumesListAdminTestJSON-442426175 None] Volume volume-0b579d6b-d92d-4056-9189-d9f86b9247a1 (0b579d6b-d92d-4056-9189-d9f86b9247a1): created successfully Aug 29 01:15:08 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-02810298-cc95-4986-9251-3c82a3064822 tempest-VolumesListAdminTestJSON-442426175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (347f2dd5-ccfa-4de0-a427-c154c5a6d94d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:15:08 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-02810298-cc95-4986-9251-3c82a3064822 tempest-VolumesListAdminTestJSON-442426175 None] Flow 'volume_create_manager' (ea41dc3b-d46a-42d5-a894-0e61f1cff0f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:15:08 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-02810298-cc95-4986-9251-3c82a3064822 tempest-VolumesListAdminTestJSON-442426175 None] Created volume successfully. Aug 29 01:15:09 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-11ea4aa0-943b-4ad7-94a3-5be544ef0559 tempest-VolumesListAdminTestJSON-442426175 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:15:09 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-11ea4aa0-943b-4ad7-94a3-5be544ef0559 tempest-VolumesListAdminTestJSON-442426175 None] Flow 'volume_create_manager' (7ca74b86-b0b3-4448-9fde-11790d0a10ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:15:09 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-11ea4aa0-943b-4ad7-94a3-5be544ef0559 tempest-VolumesListAdminTestJSON-442426175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff12615a-a8b9-4abb-9022-591756779fdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:15:09 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-11ea4aa0-943b-4ad7-94a3-5be544ef0559 tempest-VolumesListAdminTestJSON-442426175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff12615a-a8b9-4abb-9022-591756779fdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:15:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1267435653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6799e7b3-c1e8-476c-b9fa-0da6e1a35a3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f370c4f27364a5b84cf743cf69171c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:15:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:15:10Z,use_quota=True,user_id='0526716c091340b5b0a5c66bdab63eb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:15:09 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-11ea4aa0-943b-4ad7-94a3-5be544ef0559 tempest-VolumesListAdminTestJSON-442426175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dda4e385-fccc-4c0a-8bca-689180ca645e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:15:09 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-11ea4aa0-943b-4ad7-94a3-5be544ef0559 tempest-VolumesListAdminTestJSON-442426175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dda4e385-fccc-4c0a-8bca-689180ca645e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:15:09 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-11ea4aa0-943b-4ad7-94a3-5be544ef0559 tempest-VolumesListAdminTestJSON-442426175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f255dff6-7f70-4dcc-a420-68297c5ccf6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:15:09 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-11ea4aa0-943b-4ad7-94a3-5be544ef0559 tempest-VolumesListAdminTestJSON-442426175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f255dff6-7f70-4dcc-a420-68297c5ccf6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6799e7b3-c1e8-476c-b9fa-0da6e1a35a3b', 'volume_name': 'volume-6799e7b3-c1e8-476c-b9fa-0da6e1a35a3b', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:15:09 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-11ea4aa0-943b-4ad7-94a3-5be544ef0559 tempest-VolumesListAdminTestJSON-442426175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70c0e0c8-b5bb-46dc-9160-49c6e712bd27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:15:09 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-11ea4aa0-943b-4ad7-94a3-5be544ef0559 tempest-VolumesListAdminTestJSON-442426175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70c0e0c8-b5bb-46dc-9160-49c6e712bd27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:15:09 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-11ea4aa0-943b-4ad7-94a3-5be544ef0559 tempest-VolumesListAdminTestJSON-442426175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36a067e1-b1dd-4b04-8296-53073932821f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:15:09 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-11ea4aa0-943b-4ad7-94a3-5be544ef0559 tempest-VolumesListAdminTestJSON-442426175 None] Volume 6799e7b3-c1e8-476c-b9fa-0da6e1a35a3b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6799e7b3-c1e8-476c-b9fa-0da6e1a35a3b', 'volume_size': 1} Aug 29 01:15:09 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-11ea4aa0-943b-4ad7-94a3-5be544ef0559 tempest-VolumesListAdminTestJSON-442426175 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:15:09 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-11ea4aa0-943b-4ad7-94a3-5be544ef0559 tempest-VolumesListAdminTestJSON-442426175 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:15:09 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-11ea4aa0-943b-4ad7-94a3-5be544ef0559 tempest-VolumesListAdminTestJSON-442426175 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:15:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1267435653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6799e7b3-c1e8-476c-b9fa-0da6e1a35a3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f370c4f27364a5b84cf743cf69171c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:15:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:15:10Z,use_quota=True,user_id='0526716c091340b5b0a5c66bdab63eb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:15:09 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-11ea4aa0-943b-4ad7-94a3-5be544ef0559 tempest-VolumesListAdminTestJSON-442426175 None] Creating volume 6799e7b3-c1e8-476c-b9fa-0da6e1a35a3b {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:15:09 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-11ea4aa0-943b-4ad7-94a3-5be544ef0559 tempest-VolumesListAdminTestJSON-442426175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:15:09 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-11ea4aa0-943b-4ad7-94a3-5be544ef0559 tempest-VolumesListAdminTestJSON-442426175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:15:09 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-11ea4aa0-943b-4ad7-94a3-5be544ef0559 tempest-VolumesListAdminTestJSON-442426175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:15:09 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-11ea4aa0-943b-4ad7-94a3-5be544ef0559 tempest-VolumesListAdminTestJSON-442426175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:15:09 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-11ea4aa0-943b-4ad7-94a3-5be544ef0559 tempest-VolumesListAdminTestJSON-442426175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:15:09 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-11ea4aa0-943b-4ad7-94a3-5be544ef0559 tempest-VolumesListAdminTestJSON-442426175 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:15:09 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-11ea4aa0-943b-4ad7-94a3-5be544ef0559 tempest-VolumesListAdminTestJSON-442426175 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:15:09 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-11ea4aa0-943b-4ad7-94a3-5be544ef0559 tempest-VolumesListAdminTestJSON-442426175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-6799e7b3-c1e8-476c-b9fa-0da6e1a35a3b 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:15:09 devstack sudo[93129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-6799e7b3-c1e8-476c-b9fa-0da6e1a35a3b 1073741824 Aug 29 01:15:09 devstack sudo[93129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:15:10 devstack sudo[93129]: pam_unix(sudo:session): session closed for user root Aug 29 01:15:10 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-11ea4aa0-943b-4ad7-94a3-5be544ef0559 tempest-VolumesListAdminTestJSON-442426175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-6799e7b3-c1e8-476c-b9fa-0da6e1a35a3b 1073741824" returned: 0 in 0.535s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:15:10 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-11ea4aa0-943b-4ad7-94a3-5be544ef0559 tempest-VolumesListAdminTestJSON-442426175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-6799e7b3-c1e8-476c-b9fa-0da6e1a35a3b {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:15:10 devstack sudo[93135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-6799e7b3-c1e8-476c-b9fa-0da6e1a35a3b Aug 29 01:15:10 devstack sudo[93135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:15:10 devstack sudo[93135]: pam_unix(sudo:session): session closed for user root Aug 29 01:15:10 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-11ea4aa0-943b-4ad7-94a3-5be544ef0559 tempest-VolumesListAdminTestJSON-442426175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-6799e7b3-c1e8-476c-b9fa-0da6e1a35a3b" returned: 0 in 0.264s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:15:10 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-11ea4aa0-943b-4ad7-94a3-5be544ef0559 tempest-VolumesListAdminTestJSON-442426175 None] <== create_volume: return (852ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:15:10 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-11ea4aa0-943b-4ad7-94a3-5be544ef0559 tempest-VolumesListAdminTestJSON-442426175 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.855s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:15:10 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-11ea4aa0-943b-4ad7-94a3-5be544ef0559 tempest-VolumesListAdminTestJSON-442426175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36a067e1-b1dd-4b04-8296-53073932821f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6799e7b3-c1e8-476c-b9fa-0da6e1a35a3b', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:15:10 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-11ea4aa0-943b-4ad7-94a3-5be544ef0559 tempest-VolumesListAdminTestJSON-442426175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a3d1d0b-19fb-444d-98f3-83c0fbe9f84b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:15:10 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-11ea4aa0-943b-4ad7-94a3-5be544ef0559 tempest-VolumesListAdminTestJSON-442426175 None] Volume volume-6799e7b3-c1e8-476c-b9fa-0da6e1a35a3b (6799e7b3-c1e8-476c-b9fa-0da6e1a35a3b): created successfully Aug 29 01:15:10 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-11ea4aa0-943b-4ad7-94a3-5be544ef0559 tempest-VolumesListAdminTestJSON-442426175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a3d1d0b-19fb-444d-98f3-83c0fbe9f84b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:15:10 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-11ea4aa0-943b-4ad7-94a3-5be544ef0559 tempest-VolumesListAdminTestJSON-442426175 None] Flow 'volume_create_manager' (7ca74b86-b0b3-4448-9fde-11790d0a10ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:15:10 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-11ea4aa0-943b-4ad7-94a3-5be544ef0559 tempest-VolumesListAdminTestJSON-442426175 None] Created volume successfully. Aug 29 01:15:12 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-82139368-80ea-458c-9419-7a7f8f306d9d tempest-VolumesListAdminTestJSON-442426175 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:15:12 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-82139368-80ea-458c-9419-7a7f8f306d9d tempest-VolumesListAdminTestJSON-442426175 None] Flow 'volume_create_manager' (d766851c-7f75-46cb-b595-6f88898b3626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:15:12 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-82139368-80ea-458c-9419-7a7f8f306d9d tempest-VolumesListAdminTestJSON-442426175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff4e7d21-cb89-4419-83d8-c23c07e3d85e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:15:12 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-82139368-80ea-458c-9419-7a7f8f306d9d tempest-VolumesListAdminTestJSON-442426175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff4e7d21-cb89-4419-83d8-c23c07e3d85e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:15:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-156955817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50741e26-5d33-47bb-a05e-3c30af4343cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f370c4f27364a5b84cf743cf69171c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:15:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:15:13Z,use_quota=True,user_id='0526716c091340b5b0a5c66bdab63eb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:15:12 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-82139368-80ea-458c-9419-7a7f8f306d9d tempest-VolumesListAdminTestJSON-442426175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebcf379e-f448-4ed6-af0f-af087e59e822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:15:12 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-82139368-80ea-458c-9419-7a7f8f306d9d tempest-VolumesListAdminTestJSON-442426175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebcf379e-f448-4ed6-af0f-af087e59e822) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:15:12 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-82139368-80ea-458c-9419-7a7f8f306d9d tempest-VolumesListAdminTestJSON-442426175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7b27e7b-8457-4fe0-b304-2ab09b1a8210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:15:12 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-82139368-80ea-458c-9419-7a7f8f306d9d tempest-VolumesListAdminTestJSON-442426175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7b27e7b-8457-4fe0-b304-2ab09b1a8210) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50741e26-5d33-47bb-a05e-3c30af4343cf', 'volume_name': 'volume-50741e26-5d33-47bb-a05e-3c30af4343cf', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:15:12 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-82139368-80ea-458c-9419-7a7f8f306d9d tempest-VolumesListAdminTestJSON-442426175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b677d298-51fd-4469-adbb-caebdeeaa339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:15:12 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-82139368-80ea-458c-9419-7a7f8f306d9d tempest-VolumesListAdminTestJSON-442426175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b677d298-51fd-4469-adbb-caebdeeaa339) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:15:12 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-82139368-80ea-458c-9419-7a7f8f306d9d tempest-VolumesListAdminTestJSON-442426175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9773d9b-2fff-4269-b0c0-d727d8f4bdb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:15:12 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-82139368-80ea-458c-9419-7a7f8f306d9d tempest-VolumesListAdminTestJSON-442426175 None] Volume 50741e26-5d33-47bb-a05e-3c30af4343cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50741e26-5d33-47bb-a05e-3c30af4343cf', 'volume_size': 1} Aug 29 01:15:12 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-82139368-80ea-458c-9419-7a7f8f306d9d tempest-VolumesListAdminTestJSON-442426175 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:15:12 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-82139368-80ea-458c-9419-7a7f8f306d9d tempest-VolumesListAdminTestJSON-442426175 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:15:12 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-82139368-80ea-458c-9419-7a7f8f306d9d tempest-VolumesListAdminTestJSON-442426175 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:15:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-156955817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50741e26-5d33-47bb-a05e-3c30af4343cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f370c4f27364a5b84cf743cf69171c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:15:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:15:13Z,use_quota=True,user_id='0526716c091340b5b0a5c66bdab63eb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:15:12 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-82139368-80ea-458c-9419-7a7f8f306d9d tempest-VolumesListAdminTestJSON-442426175 None] Creating volume 50741e26-5d33-47bb-a05e-3c30af4343cf {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:15:12 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-82139368-80ea-458c-9419-7a7f8f306d9d tempest-VolumesListAdminTestJSON-442426175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:15:12 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-82139368-80ea-458c-9419-7a7f8f306d9d tempest-VolumesListAdminTestJSON-442426175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:15:12 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-82139368-80ea-458c-9419-7a7f8f306d9d tempest-VolumesListAdminTestJSON-442426175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:15:12 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-82139368-80ea-458c-9419-7a7f8f306d9d tempest-VolumesListAdminTestJSON-442426175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:15:12 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-82139368-80ea-458c-9419-7a7f8f306d9d tempest-VolumesListAdminTestJSON-442426175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:15:12 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-82139368-80ea-458c-9419-7a7f8f306d9d tempest-VolumesListAdminTestJSON-442426175 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:15:12 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-82139368-80ea-458c-9419-7a7f8f306d9d tempest-VolumesListAdminTestJSON-442426175 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:15:12 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-82139368-80ea-458c-9419-7a7f8f306d9d tempest-VolumesListAdminTestJSON-442426175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-50741e26-5d33-47bb-a05e-3c30af4343cf 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:15:12 devstack sudo[93139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-50741e26-5d33-47bb-a05e-3c30af4343cf 1073741824 Aug 29 01:15:12 devstack sudo[93139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:15:13 devstack sudo[93139]: pam_unix(sudo:session): session closed for user root Aug 29 01:15:13 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-82139368-80ea-458c-9419-7a7f8f306d9d tempest-VolumesListAdminTestJSON-442426175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-50741e26-5d33-47bb-a05e-3c30af4343cf 1073741824" returned: 0 in 0.695s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:15:13 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-82139368-80ea-458c-9419-7a7f8f306d9d tempest-VolumesListAdminTestJSON-442426175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-50741e26-5d33-47bb-a05e-3c30af4343cf {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:15:13 devstack sudo[93148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-50741e26-5d33-47bb-a05e-3c30af4343cf Aug 29 01:15:13 devstack sudo[93148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:15:13 devstack sudo[93148]: pam_unix(sudo:session): session closed for user root Aug 29 01:15:14 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-82139368-80ea-458c-9419-7a7f8f306d9d tempest-VolumesListAdminTestJSON-442426175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-50741e26-5d33-47bb-a05e-3c30af4343cf" returned: 0 in 0.498s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:15:14 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-82139368-80ea-458c-9419-7a7f8f306d9d tempest-VolumesListAdminTestJSON-442426175 None] <== create_volume: return (1255ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:15:14 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-82139368-80ea-458c-9419-7a7f8f306d9d tempest-VolumesListAdminTestJSON-442426175 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.260s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:15:14 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-82139368-80ea-458c-9419-7a7f8f306d9d tempest-VolumesListAdminTestJSON-442426175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9773d9b-2fff-4269-b0c0-d727d8f4bdb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50741e26-5d33-47bb-a05e-3c30af4343cf', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:15:14 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-82139368-80ea-458c-9419-7a7f8f306d9d tempest-VolumesListAdminTestJSON-442426175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61216cc4-c35b-4226-aa80-a4e82e4702a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:15:14 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-82139368-80ea-458c-9419-7a7f8f306d9d tempest-VolumesListAdminTestJSON-442426175 None] Volume volume-50741e26-5d33-47bb-a05e-3c30af4343cf (50741e26-5d33-47bb-a05e-3c30af4343cf): created successfully Aug 29 01:15:14 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-82139368-80ea-458c-9419-7a7f8f306d9d tempest-VolumesListAdminTestJSON-442426175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61216cc4-c35b-4226-aa80-a4e82e4702a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:15:14 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-82139368-80ea-458c-9419-7a7f8f306d9d tempest-VolumesListAdminTestJSON-442426175 None] Flow 'volume_create_manager' (d766851c-7f75-46cb-b595-6f88898b3626) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:15:14 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-82139368-80ea-458c-9419-7a7f8f306d9d tempest-VolumesListAdminTestJSON-442426175 None] Created volume successfully. Aug 29 01:15:15 devstack cinder-volume[86111]: DEBUG dbcounter [-] [86111] Writing DB stats cinder:SELECT=98,cinder:INSERT=32,cinder:UPDATE=124,cinder:DELETE=12 {{(pid=86111) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 29 01:15:15 devstack cinder-volume[86111]: DEBUG dbcounter [-] [86111] Writing DB stats cinder:SELECT=85,cinder:UPDATE=125,cinder:INSERT=26,cinder:DELETE=10 {{(pid=86111) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 29 01:15:15 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-1df1a0fd-457d-47cd-823e-93de275b9221 tempest-VolumesListAdminTestJSON-1782988063 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:15:15 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-1df1a0fd-457d-47cd-823e-93de275b9221 tempest-VolumesListAdminTestJSON-1782988063 None] Flow 'volume_create_manager' (0d10d482-0226-4485-9dc5-6a9191cdddbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:15:15 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-1df1a0fd-457d-47cd-823e-93de275b9221 tempest-VolumesListAdminTestJSON-1782988063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (347af8cd-580e-4faf-a784-6a13e6cc9bb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:15:15 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-1df1a0fd-457d-47cd-823e-93de275b9221 tempest-VolumesListAdminTestJSON-1782988063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (347af8cd-580e-4faf-a784-6a13e6cc9bb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:15:15Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae4bc47e-6437-447a-8f37-ff8879629544,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fa49e9128144d1ba7c7640ac644ecec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:15:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:15:16Z,use_quota=True,user_id='ae6283dd57b14b61817d83a855f30618',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:15:15 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-1df1a0fd-457d-47cd-823e-93de275b9221 tempest-VolumesListAdminTestJSON-1782988063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4df1306a-300b-44ef-b07b-499144cc3f2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:15:15 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-1df1a0fd-457d-47cd-823e-93de275b9221 tempest-VolumesListAdminTestJSON-1782988063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4df1306a-300b-44ef-b07b-499144cc3f2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:15:15 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-1df1a0fd-457d-47cd-823e-93de275b9221 tempest-VolumesListAdminTestJSON-1782988063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51a09ee6-05b9-4f92-a7a5-8ece4292fa42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:15:15 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-1df1a0fd-457d-47cd-823e-93de275b9221 tempest-VolumesListAdminTestJSON-1782988063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51a09ee6-05b9-4f92-a7a5-8ece4292fa42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae4bc47e-6437-447a-8f37-ff8879629544', 'volume_name': 'volume-ae4bc47e-6437-447a-8f37-ff8879629544', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:15:15 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-1df1a0fd-457d-47cd-823e-93de275b9221 tempest-VolumesListAdminTestJSON-1782988063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fced9b76-7557-4795-a6ba-1c883e5639ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:15:15 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-1df1a0fd-457d-47cd-823e-93de275b9221 tempest-VolumesListAdminTestJSON-1782988063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fced9b76-7557-4795-a6ba-1c883e5639ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:15:15 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-1df1a0fd-457d-47cd-823e-93de275b9221 tempest-VolumesListAdminTestJSON-1782988063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b0ce4a7-eb8c-4f79-aff2-8ee2a23f08d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:15:15 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-1df1a0fd-457d-47cd-823e-93de275b9221 tempest-VolumesListAdminTestJSON-1782988063 None] Volume ae4bc47e-6437-447a-8f37-ff8879629544: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae4bc47e-6437-447a-8f37-ff8879629544', 'volume_size': 1} Aug 29 01:15:15 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-1df1a0fd-457d-47cd-823e-93de275b9221 tempest-VolumesListAdminTestJSON-1782988063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:15:15 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-1df1a0fd-457d-47cd-823e-93de275b9221 tempest-VolumesListAdminTestJSON-1782988063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:15:15 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-1df1a0fd-457d-47cd-823e-93de275b9221 tempest-VolumesListAdminTestJSON-1782988063 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:15:15Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae4bc47e-6437-447a-8f37-ff8879629544,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fa49e9128144d1ba7c7640ac644ecec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:15:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:15:16Z,use_quota=True,user_id='ae6283dd57b14b61817d83a855f30618',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:15:15 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-1df1a0fd-457d-47cd-823e-93de275b9221 tempest-VolumesListAdminTestJSON-1782988063 None] Creating volume ae4bc47e-6437-447a-8f37-ff8879629544 {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:15:15 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-1df1a0fd-457d-47cd-823e-93de275b9221 tempest-VolumesListAdminTestJSON-1782988063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:15:15 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-1df1a0fd-457d-47cd-823e-93de275b9221 tempest-VolumesListAdminTestJSON-1782988063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:15:15 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-1df1a0fd-457d-47cd-823e-93de275b9221 tempest-VolumesListAdminTestJSON-1782988063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:15:15 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-1df1a0fd-457d-47cd-823e-93de275b9221 tempest-VolumesListAdminTestJSON-1782988063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:15:15 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-1df1a0fd-457d-47cd-823e-93de275b9221 tempest-VolumesListAdminTestJSON-1782988063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:15:15 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-1df1a0fd-457d-47cd-823e-93de275b9221 tempest-VolumesListAdminTestJSON-1782988063 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:15:15 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-1df1a0fd-457d-47cd-823e-93de275b9221 tempest-VolumesListAdminTestJSON-1782988063 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:15:15 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-1df1a0fd-457d-47cd-823e-93de275b9221 tempest-VolumesListAdminTestJSON-1782988063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ae4bc47e-6437-447a-8f37-ff8879629544 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:15:15 devstack sudo[93171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ae4bc47e-6437-447a-8f37-ff8879629544 1073741824 Aug 29 01:15:15 devstack sudo[93171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:15:16 devstack sudo[93171]: pam_unix(sudo:session): session closed for user root Aug 29 01:15:16 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-1df1a0fd-457d-47cd-823e-93de275b9221 tempest-VolumesListAdminTestJSON-1782988063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ae4bc47e-6437-447a-8f37-ff8879629544 1073741824" returned: 0 in 0.545s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:15:16 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-1df1a0fd-457d-47cd-823e-93de275b9221 tempest-VolumesListAdminTestJSON-1782988063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ae4bc47e-6437-447a-8f37-ff8879629544 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:15:16 devstack sudo[93180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ae4bc47e-6437-447a-8f37-ff8879629544 Aug 29 01:15:16 devstack sudo[93180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:15:16 devstack sudo[93180]: pam_unix(sudo:session): session closed for user root Aug 29 01:15:16 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-1df1a0fd-457d-47cd-823e-93de275b9221 tempest-VolumesListAdminTestJSON-1782988063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ae4bc47e-6437-447a-8f37-ff8879629544" returned: 0 in 0.262s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:15:16 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-1df1a0fd-457d-47cd-823e-93de275b9221 tempest-VolumesListAdminTestJSON-1782988063 None] <== create_volume: return (853ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:15:16 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-1df1a0fd-457d-47cd-823e-93de275b9221 tempest-VolumesListAdminTestJSON-1782988063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.855s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:15:16 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-1df1a0fd-457d-47cd-823e-93de275b9221 tempest-VolumesListAdminTestJSON-1782988063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b0ce4a7-eb8c-4f79-aff2-8ee2a23f08d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae4bc47e-6437-447a-8f37-ff8879629544', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:15:16 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-1df1a0fd-457d-47cd-823e-93de275b9221 tempest-VolumesListAdminTestJSON-1782988063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acb53500-794b-4f3b-9826-f11573135c17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:15:16 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-1df1a0fd-457d-47cd-823e-93de275b9221 tempest-VolumesListAdminTestJSON-1782988063 None] Volume volume-ae4bc47e-6437-447a-8f37-ff8879629544 (ae4bc47e-6437-447a-8f37-ff8879629544): created successfully Aug 29 01:15:16 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-1df1a0fd-457d-47cd-823e-93de275b9221 tempest-VolumesListAdminTestJSON-1782988063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acb53500-794b-4f3b-9826-f11573135c17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:15:16 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-1df1a0fd-457d-47cd-823e-93de275b9221 tempest-VolumesListAdminTestJSON-1782988063 None] Flow 'volume_create_manager' (0d10d482-0226-4485-9dc5-6a9191cdddbd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:15:16 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-1df1a0fd-457d-47cd-823e-93de275b9221 tempest-VolumesListAdminTestJSON-1782988063 None] Created volume successfully. Aug 29 01:15:18 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-9c103d63-0fa4-4cd7-b6c4-03598d70655c tempest-VolumesListAdminTestJSON-1782988063 None] Acquiring lock "cinder-ae4bc47e-6437-447a-8f37-ff8879629544-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:15:18 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-9c103d63-0fa4-4cd7-b6c4-03598d70655c tempest-VolumesListAdminTestJSON-1782988063 None] Lock "cinder-ae4bc47e-6437-447a-8f37-ff8879629544-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:15:18 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-9c103d63-0fa4-4cd7-b6c4-03598d70655c tempest-VolumesListAdminTestJSON-1782988063 None] Acquiring lock "cinder-quobyte-ae4bc47e-6437-447a-8f37-ff8879629544" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:15:18 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-9c103d63-0fa4-4cd7-b6c4-03598d70655c tempest-VolumesListAdminTestJSON-1782988063 None] Lock "cinder-quobyte-ae4bc47e-6437-447a-8f37-ff8879629544" acquired by "delete_volume" :: waited 0.023s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:15:18 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d942626-0eb5-4144-bf0f-988b6bad8992]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:15:18 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-9c103d63-0fa4-4cd7-b6c4-03598d70655c tempest-VolumesListAdminTestJSON-1782988063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ae4bc47e-6437-447a-8f37-ff8879629544 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:15:18 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-7b6c7e2a-7de0-4eea-8b83-ede8231321c3 tempest-VolumesListAdminTestJSON-442426175 None] Acquiring lock "cinder-50741e26-5d33-47bb-a05e-3c30af4343cf-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:15:18 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-7b6c7e2a-7de0-4eea-8b83-ede8231321c3 tempest-VolumesListAdminTestJSON-442426175 None] Lock "cinder-50741e26-5d33-47bb-a05e-3c30af4343cf-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:15:18 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-7b6c7e2a-7de0-4eea-8b83-ede8231321c3 tempest-VolumesListAdminTestJSON-442426175 None] Acquiring lock "cinder-quobyte-50741e26-5d33-47bb-a05e-3c30af4343cf" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:15:18 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-7b6c7e2a-7de0-4eea-8b83-ede8231321c3 tempest-VolumesListAdminTestJSON-442426175 None] Lock "cinder-quobyte-50741e26-5d33-47bb-a05e-3c30af4343cf" acquired by "delete_volume" :: waited 0.029s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:15:18 devstack sudo[93200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ae4bc47e-6437-447a-8f37-ff8879629544 Aug 29 01:15:18 devstack sudo[93200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:15:18 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[21af357f-e5fc-42a6-aa8a-f477c9a95ea7]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:15:18 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-7b6c7e2a-7de0-4eea-8b83-ede8231321c3 tempest-VolumesListAdminTestJSON-442426175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-50741e26-5d33-47bb-a05e-3c30af4343cf {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:15:18 devstack sudo[93205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-50741e26-5d33-47bb-a05e-3c30af4343cf Aug 29 01:15:18 devstack sudo[93205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:15:19 devstack sudo[93200]: pam_unix(sudo:session): session closed for user root Aug 29 01:15:19 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-9c103d63-0fa4-4cd7-b6c4-03598d70655c tempest-VolumesListAdminTestJSON-1782988063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ae4bc47e-6437-447a-8f37-ff8879629544" returned: 0 in 0.729s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:15:19 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-9c103d63-0fa4-4cd7-b6c4-03598d70655c tempest-VolumesListAdminTestJSON-1782988063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ae4bc47e-6437-447a-8f37-ff8879629544 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:15:19 devstack sudo[93210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ae4bc47e-6437-447a-8f37-ff8879629544 Aug 29 01:15:19 devstack sudo[93210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:15:19 devstack sudo[93205]: pam_unix(sudo:session): session closed for user root Aug 29 01:15:19 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-7b6c7e2a-7de0-4eea-8b83-ede8231321c3 tempest-VolumesListAdminTestJSON-442426175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-50741e26-5d33-47bb-a05e-3c30af4343cf" returned: 0 in 0.544s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:15:19 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-7b6c7e2a-7de0-4eea-8b83-ede8231321c3 tempest-VolumesListAdminTestJSON-442426175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-50741e26-5d33-47bb-a05e-3c30af4343cf {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:15:19 devstack sudo[93215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-50741e26-5d33-47bb-a05e-3c30af4343cf Aug 29 01:15:19 devstack sudo[93215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:15:19 devstack sudo[93210]: pam_unix(sudo:session): session closed for user root Aug 29 01:15:19 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-9c103d63-0fa4-4cd7-b6c4-03598d70655c tempest-VolumesListAdminTestJSON-1782988063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ae4bc47e-6437-447a-8f37-ff8879629544" returned: 0 in 0.314s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:15:19 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-9c103d63-0fa4-4cd7-b6c4-03598d70655c tempest-VolumesListAdminTestJSON-1782988063 None] Lock "cinder-quobyte-ae4bc47e-6437-447a-8f37-ff8879629544" released by "delete_volume" :: held 1.133s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:15:19 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-9c103d63-0fa4-4cd7-b6c4-03598d70655c tempest-VolumesListAdminTestJSON-1782988063 None] Created reservations ['84c32678-177d-4192-8dc9-11968728d493', '200498c7-4e24-4485-8357-bbda8141fbb1', 'd3789838-cbdc-41e1-8866-23344e8f951d', '52d821b6-02a1-4869-9ae1-62b1b63f35f5'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:15:19 devstack sudo[93215]: pam_unix(sudo:session): session closed for user root Aug 29 01:15:19 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-7b6c7e2a-7de0-4eea-8b83-ede8231321c3 tempest-VolumesListAdminTestJSON-442426175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-50741e26-5d33-47bb-a05e-3c30af4343cf" returned: 0 in 0.306s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:15:19 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-7b6c7e2a-7de0-4eea-8b83-ede8231321c3 tempest-VolumesListAdminTestJSON-442426175 None] Lock "cinder-quobyte-50741e26-5d33-47bb-a05e-3c30af4343cf" released by "delete_volume" :: held 0.961s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:15:19 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-9c103d63-0fa4-4cd7-b6c4-03598d70655c tempest-VolumesListAdminTestJSON-1782988063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:15:19 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-9c103d63-0fa4-4cd7-b6c4-03598d70655c tempest-VolumesListAdminTestJSON-1782988063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:15:19 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-9c103d63-0fa4-4cd7-b6c4-03598d70655c tempest-VolumesListAdminTestJSON-1782988063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:15:19 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-9c103d63-0fa4-4cd7-b6c4-03598d70655c tempest-VolumesListAdminTestJSON-1782988063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:15:19 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-9c103d63-0fa4-4cd7-b6c4-03598d70655c tempest-VolumesListAdminTestJSON-1782988063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:15:19 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-9c103d63-0fa4-4cd7-b6c4-03598d70655c tempest-VolumesListAdminTestJSON-1782988063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:15:19 devstack sudo[93219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:15:19 devstack sudo[93219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:15:19 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-7b6c7e2a-7de0-4eea-8b83-ede8231321c3 tempest-VolumesListAdminTestJSON-442426175 None] Created reservations ['849ad9f7-7a3f-489f-a5b9-7d3b1e523da1', '173bf1e2-da36-4f19-8789-0720b2b4b50d', 'd8d82dcc-6328-4255-8c97-d9feaa67e12f', '11a848c2-2e90-4235-ac96-9d31f49e2cbc'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:15:19 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-7b6c7e2a-7de0-4eea-8b83-ede8231321c3 tempest-VolumesListAdminTestJSON-442426175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:15:19 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-7b6c7e2a-7de0-4eea-8b83-ede8231321c3 tempest-VolumesListAdminTestJSON-442426175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:15:19 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-7b6c7e2a-7de0-4eea-8b83-ede8231321c3 tempest-VolumesListAdminTestJSON-442426175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:15:19 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-7b6c7e2a-7de0-4eea-8b83-ede8231321c3 tempest-VolumesListAdminTestJSON-442426175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:15:19 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-7b6c7e2a-7de0-4eea-8b83-ede8231321c3 tempest-VolumesListAdminTestJSON-442426175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:15:19 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-7b6c7e2a-7de0-4eea-8b83-ede8231321c3 tempest-VolumesListAdminTestJSON-442426175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:15:19 devstack sudo[93221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:15:19 devstack sudo[93221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:15:19 devstack sudo[93219]: pam_unix(sudo:session): session closed for user root Aug 29 01:15:19 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-9c103d63-0fa4-4cd7-b6c4-03598d70655c tempest-VolumesListAdminTestJSON-1782988063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.323s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:15:19 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-9c103d63-0fa4-4cd7-b6c4-03598d70655c tempest-VolumesListAdminTestJSON-1782988063 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:15:19 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-9c103d63-0fa4-4cd7-b6c4-03598d70655c tempest-VolumesListAdminTestJSON-1782988063 None] Deleted volume successfully. Aug 29 01:15:19 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-9c103d63-0fa4-4cd7-b6c4-03598d70655c tempest-VolumesListAdminTestJSON-1782988063 None] Lock "cinder-ae4bc47e-6437-447a-8f37-ff8879629544-delete_volume" released by "delete_volume" :: held 1.824s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:15:20 devstack sudo[93221]: pam_unix(sudo:session): session closed for user root Aug 29 01:15:20 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-7b6c7e2a-7de0-4eea-8b83-ede8231321c3 tempest-VolumesListAdminTestJSON-442426175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.322s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:15:20 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-7b6c7e2a-7de0-4eea-8b83-ede8231321c3 tempest-VolumesListAdminTestJSON-442426175 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:15:20 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-7b6c7e2a-7de0-4eea-8b83-ede8231321c3 tempest-VolumesListAdminTestJSON-442426175 None] Deleted volume successfully. Aug 29 01:15:20 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-7b6c7e2a-7de0-4eea-8b83-ede8231321c3 tempest-VolumesListAdminTestJSON-442426175 None] Lock "cinder-50741e26-5d33-47bb-a05e-3c30af4343cf-delete_volume" released by "delete_volume" :: held 1.668s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:15:20 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-6e216acd-2eff-402f-aa52-9c1f15161537 tempest-VolumesListAdminTestJSON-442426175 None] Acquiring lock "cinder-6799e7b3-c1e8-476c-b9fa-0da6e1a35a3b-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:15:20 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-6e216acd-2eff-402f-aa52-9c1f15161537 tempest-VolumesListAdminTestJSON-442426175 None] Lock "cinder-6799e7b3-c1e8-476c-b9fa-0da6e1a35a3b-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:15:20 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-6e216acd-2eff-402f-aa52-9c1f15161537 tempest-VolumesListAdminTestJSON-442426175 None] Acquiring lock "cinder-quobyte-6799e7b3-c1e8-476c-b9fa-0da6e1a35a3b" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:15:20 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-6e216acd-2eff-402f-aa52-9c1f15161537 tempest-VolumesListAdminTestJSON-442426175 None] Lock "cinder-quobyte-6799e7b3-c1e8-476c-b9fa-0da6e1a35a3b" acquired by "delete_volume" :: waited 0.064s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:15:21 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4cb61f6-2502-4cc2-8464-ffecbcae8aca]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:15:21 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-6e216acd-2eff-402f-aa52-9c1f15161537 tempest-VolumesListAdminTestJSON-442426175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-6799e7b3-c1e8-476c-b9fa-0da6e1a35a3b {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:15:21 devstack sudo[93247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-6799e7b3-c1e8-476c-b9fa-0da6e1a35a3b Aug 29 01:15:21 devstack sudo[93247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:15:21 devstack sudo[93247]: pam_unix(sudo:session): session closed for user root Aug 29 01:15:21 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-6e216acd-2eff-402f-aa52-9c1f15161537 tempest-VolumesListAdminTestJSON-442426175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-6799e7b3-c1e8-476c-b9fa-0da6e1a35a3b" returned: 0 in 0.896s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:15:21 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-6e216acd-2eff-402f-aa52-9c1f15161537 tempest-VolumesListAdminTestJSON-442426175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-6799e7b3-c1e8-476c-b9fa-0da6e1a35a3b {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:15:22 devstack sudo[93301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-6799e7b3-c1e8-476c-b9fa-0da6e1a35a3b Aug 29 01:15:22 devstack sudo[93301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:15:22 devstack sudo[93301]: pam_unix(sudo:session): session closed for user root Aug 29 01:15:22 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-6e216acd-2eff-402f-aa52-9c1f15161537 tempest-VolumesListAdminTestJSON-442426175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-6799e7b3-c1e8-476c-b9fa-0da6e1a35a3b" returned: 0 in 0.431s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:15:22 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-6e216acd-2eff-402f-aa52-9c1f15161537 tempest-VolumesListAdminTestJSON-442426175 None] Lock "cinder-quobyte-6799e7b3-c1e8-476c-b9fa-0da6e1a35a3b" released by "delete_volume" :: held 1.456s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:15:22 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-6e216acd-2eff-402f-aa52-9c1f15161537 tempest-VolumesListAdminTestJSON-442426175 None] Created reservations ['0853a579-6249-4159-8d8d-b411f6e25e3a', 'de4eb858-dd7b-4716-b17b-52ae8287894e', 'fa6c1a66-183b-47a1-944e-73bcac12fe82', '6969eb29-1b91-4639-aadb-aaed0cbfcd6a'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:15:22 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-6e216acd-2eff-402f-aa52-9c1f15161537 tempest-VolumesListAdminTestJSON-442426175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:15:22 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-6e216acd-2eff-402f-aa52-9c1f15161537 tempest-VolumesListAdminTestJSON-442426175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:15:22 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-6e216acd-2eff-402f-aa52-9c1f15161537 tempest-VolumesListAdminTestJSON-442426175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:15:22 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-6e216acd-2eff-402f-aa52-9c1f15161537 tempest-VolumesListAdminTestJSON-442426175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:15:22 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-6e216acd-2eff-402f-aa52-9c1f15161537 tempest-VolumesListAdminTestJSON-442426175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:15:22 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-6e216acd-2eff-402f-aa52-9c1f15161537 tempest-VolumesListAdminTestJSON-442426175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:15:22 devstack sudo[93308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:15:22 devstack sudo[93308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:15:23 devstack sudo[93308]: pam_unix(sudo:session): session closed for user root Aug 29 01:15:23 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-6e216acd-2eff-402f-aa52-9c1f15161537 tempest-VolumesListAdminTestJSON-442426175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.664s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:15:23 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-6e216acd-2eff-402f-aa52-9c1f15161537 tempest-VolumesListAdminTestJSON-442426175 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:15:23 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-6e216acd-2eff-402f-aa52-9c1f15161537 tempest-VolumesListAdminTestJSON-442426175 None] Deleted volume successfully. Aug 29 01:15:23 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-6e216acd-2eff-402f-aa52-9c1f15161537 tempest-VolumesListAdminTestJSON-442426175 None] Lock "cinder-6799e7b3-c1e8-476c-b9fa-0da6e1a35a3b-delete_volume" released by "delete_volume" :: held 2.539s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:15:23 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-45c53558-b7cb-4470-b684-e0494d078cdb tempest-VolumesListAdminTestJSON-442426175 None] Acquiring lock "cinder-0b579d6b-d92d-4056-9189-d9f86b9247a1-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:15:23 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-45c53558-b7cb-4470-b684-e0494d078cdb tempest-VolumesListAdminTestJSON-442426175 None] Lock "cinder-0b579d6b-d92d-4056-9189-d9f86b9247a1-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:15:23 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-45c53558-b7cb-4470-b684-e0494d078cdb tempest-VolumesListAdminTestJSON-442426175 None] Acquiring lock "cinder-quobyte-0b579d6b-d92d-4056-9189-d9f86b9247a1" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:15:23 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-45c53558-b7cb-4470-b684-e0494d078cdb tempest-VolumesListAdminTestJSON-442426175 None] Lock "cinder-quobyte-0b579d6b-d92d-4056-9189-d9f86b9247a1" acquired by "delete_volume" :: waited 0.030s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:15:23 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b901776-86b9-4314-b28f-cdab56c84537]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:15:23 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-45c53558-b7cb-4470-b684-e0494d078cdb tempest-VolumesListAdminTestJSON-442426175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-0b579d6b-d92d-4056-9189-d9f86b9247a1 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:15:23 devstack sudo[93346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-0b579d6b-d92d-4056-9189-d9f86b9247a1 Aug 29 01:15:23 devstack sudo[93346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:15:24 devstack sudo[93346]: pam_unix(sudo:session): session closed for user root Aug 29 01:15:24 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-45c53558-b7cb-4470-b684-e0494d078cdb tempest-VolumesListAdminTestJSON-442426175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-0b579d6b-d92d-4056-9189-d9f86b9247a1" returned: 0 in 0.898s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:15:24 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-45c53558-b7cb-4470-b684-e0494d078cdb tempest-VolumesListAdminTestJSON-442426175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-0b579d6b-d92d-4056-9189-d9f86b9247a1 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:15:24 devstack sudo[93355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-0b579d6b-d92d-4056-9189-d9f86b9247a1 Aug 29 01:15:24 devstack sudo[93355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:15:24 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c19d449-253e-4edc-8ff2-d8bb9629674f tempest-VolumesImageMetadata-1151811968 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:15:24 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-3c19d449-253e-4edc-8ff2-d8bb9629674f tempest-VolumesImageMetadata-1151811968 None] Flow 'volume_create_manager' (c855690d-8641-4aab-b2cd-5650cf145d2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:15:24 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-3c19d449-253e-4edc-8ff2-d8bb9629674f tempest-VolumesImageMetadata-1151811968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6f4090d-36ac-4c09-afec-976905b4317c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:15:24 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-3c19d449-253e-4edc-8ff2-d8bb9629674f tempest-VolumesImageMetadata-1151811968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6f4090d-36ac-4c09-afec-976905b4317c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:15:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1288243080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab66617a-e184-4fcf-a34f-2dc69cf1473c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='905b8105b4e84fe1aaa2fb98db54ae64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:15:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:15:25Z,use_quota=True,user_id='2dc4a9da9c2549748be6607861c4f1d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:15:24 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-3c19d449-253e-4edc-8ff2-d8bb9629674f tempest-VolumesImageMetadata-1151811968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7790145e-bbc6-4f99-b6ad-eb426ab068cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:15:24 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-3c19d449-253e-4edc-8ff2-d8bb9629674f tempest-VolumesImageMetadata-1151811968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7790145e-bbc6-4f99-b6ad-eb426ab068cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:15:24 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-3c19d449-253e-4edc-8ff2-d8bb9629674f tempest-VolumesImageMetadata-1151811968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (140a98c9-238d-40fb-be0b-7e2aeff30ca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:15:24 devstack cinder-volume[86111]: DEBUG cinder.image.glance [None req-3c19d449-253e-4edc-8ff2-d8bb9629674f tempest-VolumesImageMetadata-1151811968 None] Creating Keystone auth plugin from conf {{(pid=86111) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 29 01:15:25 devstack sudo[93355]: pam_unix(sudo:session): session closed for user root Aug 29 01:15:25 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-45c53558-b7cb-4470-b684-e0494d078cdb tempest-VolumesListAdminTestJSON-442426175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-0b579d6b-d92d-4056-9189-d9f86b9247a1" returned: 0 in 0.557s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:15:25 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-45c53558-b7cb-4470-b684-e0494d078cdb tempest-VolumesListAdminTestJSON-442426175 None] Lock "cinder-quobyte-0b579d6b-d92d-4056-9189-d9f86b9247a1" released by "delete_volume" :: held 1.569s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:15:25 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-45c53558-b7cb-4470-b684-e0494d078cdb tempest-VolumesListAdminTestJSON-442426175 None] Created reservations ['6c217ff2-1cc4-4e52-a077-9a9438b93e93', 'b007403a-a53a-4499-9b80-b3be0eb9d39a', 'ec212603-5ed4-42eb-bbe0-01dde3b0a347', '9e72ac00-b289-4f53-929e-155cc1865188'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:15:25 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-45c53558-b7cb-4470-b684-e0494d078cdb tempest-VolumesListAdminTestJSON-442426175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:15:25 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-45c53558-b7cb-4470-b684-e0494d078cdb tempest-VolumesListAdminTestJSON-442426175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:15:25 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-45c53558-b7cb-4470-b684-e0494d078cdb tempest-VolumesListAdminTestJSON-442426175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:15:25 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-45c53558-b7cb-4470-b684-e0494d078cdb tempest-VolumesListAdminTestJSON-442426175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:15:25 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-45c53558-b7cb-4470-b684-e0494d078cdb tempest-VolumesListAdminTestJSON-442426175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:15:25 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-45c53558-b7cb-4470-b684-e0494d078cdb tempest-VolumesListAdminTestJSON-442426175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:15:25 devstack sudo[93358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:15:25 devstack sudo[93358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:15:25 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-3c19d449-253e-4edc-8ff2-d8bb9629674f tempest-VolumesImageMetadata-1151811968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (140a98c9-238d-40fb-be0b-7e2aeff30ca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ab66617a-e184-4fcf-a34f-2dc69cf1473c', 'volume_name': 'volume-ab66617a-e184-4fcf-a34f-2dc69cf1473c', 'volume_size': 1, 'image_id': 'f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8d940113004947258ae710723d273006', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab', 'created_at': datetime.datetime(2026, 8, 28, 23, 3, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 23, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:15:25 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-3c19d449-253e-4edc-8ff2-d8bb9629674f tempest-VolumesImageMetadata-1151811968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0631a9f5-f670-46dc-837d-787ca236c1df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:15:25 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-3c19d449-253e-4edc-8ff2-d8bb9629674f tempest-VolumesImageMetadata-1151811968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0631a9f5-f670-46dc-837d-787ca236c1df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:15:25 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-3c19d449-253e-4edc-8ff2-d8bb9629674f tempest-VolumesImageMetadata-1151811968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c32c8e79-356e-48b4-8e5b-1babf8699c95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:15:25 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-3c19d449-253e-4edc-8ff2-d8bb9629674f tempest-VolumesImageMetadata-1151811968 None] Volume ab66617a-e184-4fcf-a34f-2dc69cf1473c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ab66617a-e184-4fcf-a34f-2dc69cf1473c', 'volume_size': 1, 'image_id': 'f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8d940113004947258ae710723d273006', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab', 'created_at': datetime.datetime(2026, 8, 28, 23, 3, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 23, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 29 01:15:25 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c19d449-253e-4edc-8ff2-d8bb9629674f tempest-VolumesImageMetadata-1151811968 None] Trying to clone ab66617a-e184-4fcf-a34f-2dc69cf1473c from image f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab at location (None, [{'url': 'file:///opt/stack/data/glance/images/f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab', 'metadata': {}}]). {{(pid=86111) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 29 01:15:26 devstack sudo[93358]: pam_unix(sudo:session): session closed for user root Aug 29 01:15:26 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-45c53558-b7cb-4470-b684-e0494d078cdb tempest-VolumesListAdminTestJSON-442426175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.741s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:15:26 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-45c53558-b7cb-4470-b684-e0494d078cdb tempest-VolumesListAdminTestJSON-442426175 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:15:26 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-45c53558-b7cb-4470-b684-e0494d078cdb tempest-VolumesListAdminTestJSON-442426175 None] Deleted volume successfully. Aug 29 01:15:26 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-45c53558-b7cb-4470-b684-e0494d078cdb tempest-VolumesListAdminTestJSON-442426175 None] Lock "cinder-0b579d6b-d92d-4056-9189-d9f86b9247a1-delete_volume" released by "delete_volume" :: held 2.845s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:15:26 devstack cinder-volume[86111]: DEBUG cinder.image.image_utils [None req-3c19d449-253e-4edc-8ff2-d8bb9629674f tempest-VolumesImageMetadata-1151811968 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab_0wj34bsydevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86111) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 29 01:15:26 devstack cinder-volume[86111]: INFO cinder.image.image_utils [None req-3c19d449-253e-4edc-8ff2-d8bb9629674f tempest-VolumesImageMetadata-1151811968 None] Image download 20.69 MB at 20.69 MB/s Aug 29 01:15:26 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[72f86ff2-3ed6-4b1b-9afb-c49babaaa51a]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:15:26 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-3c19d449-253e-4edc-8ff2-d8bb9629674f tempest-VolumesImageMetadata-1151811968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab_0wj34bsydevstack@QuobyteHD {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:15:26 devstack sudo[93363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab_0wj34bsydevstack@QuobyteHD Aug 29 01:15:26 devstack sudo[93363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:15:26 devstack sudo[93363]: pam_unix(sudo:session): session closed for user root Aug 29 01:15:26 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-3c19d449-253e-4edc-8ff2-d8bb9629674f tempest-VolumesImageMetadata-1151811968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab_0wj34bsydevstack@QuobyteHD" returned: 0 in 0.477s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:15:26 devstack cinder-volume[86111]: DEBUG cinder.image.image_utils [None req-3c19d449-253e-4edc-8ff2-d8bb9629674f tempest-VolumesImageMetadata-1151811968 None] Temporary image f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab is fetched for user 2dc4a9da9c2549748be6607861c4f1d9. {{(pid=86111) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 29 01:15:27 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc28ed60-f11c-4cb6-ac6d-fc8c8de2773c]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:15:27 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-3c19d449-253e-4edc-8ff2-d8bb9629674f tempest-VolumesImageMetadata-1151811968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab_0wj34bsydevstack@QuobyteHD {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:15:27 devstack sudo[93369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab_0wj34bsydevstack@QuobyteHD Aug 29 01:15:27 devstack sudo[93369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:15:27 devstack sudo[93369]: pam_unix(sudo:session): session closed for user root Aug 29 01:15:27 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-3c19d449-253e-4edc-8ff2-d8bb9629674f tempest-VolumesImageMetadata-1151811968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab_0wj34bsydevstack@QuobyteHD" returned: 0 in 0.544s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:15:27 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-3c19d449-253e-4edc-8ff2-d8bb9629674f tempest-VolumesImageMetadata-1151811968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:15:27 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-3c19d449-253e-4edc-8ff2-d8bb9629674f tempest-VolumesImageMetadata-1151811968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:15:27 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-3c19d449-253e-4edc-8ff2-d8bb9629674f tempest-VolumesImageMetadata-1151811968 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:15:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1288243080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab66617a-e184-4fcf-a34f-2dc69cf1473c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='905b8105b4e84fe1aaa2fb98db54ae64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:15:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:15:25Z,use_quota=True,user_id='2dc4a9da9c2549748be6607861c4f1d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:15:27 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-3c19d449-253e-4edc-8ff2-d8bb9629674f tempest-VolumesImageMetadata-1151811968 None] Creating volume ab66617a-e184-4fcf-a34f-2dc69cf1473c {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:15:27 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-3c19d449-253e-4edc-8ff2-d8bb9629674f tempest-VolumesImageMetadata-1151811968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:15:27 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-3c19d449-253e-4edc-8ff2-d8bb9629674f tempest-VolumesImageMetadata-1151811968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:15:27 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-3c19d449-253e-4edc-8ff2-d8bb9629674f tempest-VolumesImageMetadata-1151811968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:15:27 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-3c19d449-253e-4edc-8ff2-d8bb9629674f tempest-VolumesImageMetadata-1151811968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:15:27 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-3c19d449-253e-4edc-8ff2-d8bb9629674f tempest-VolumesImageMetadata-1151811968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:15:27 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-3c19d449-253e-4edc-8ff2-d8bb9629674f tempest-VolumesImageMetadata-1151811968 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:15:27 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-3c19d449-253e-4edc-8ff2-d8bb9629674f tempest-VolumesImageMetadata-1151811968 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:15:27 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-3c19d449-253e-4edc-8ff2-d8bb9629674f tempest-VolumesImageMetadata-1151811968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ab66617a-e184-4fcf-a34f-2dc69cf1473c 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:15:27 devstack sudo[93376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ab66617a-e184-4fcf-a34f-2dc69cf1473c 1073741824 Aug 29 01:15:27 devstack sudo[93376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:15:28 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-97accd26-d947-4b2f-8df2-71b6d9bdd8e7 tempest-AttachVolumeShelveTestJSON-1887175045 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:15:28 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-97accd26-d947-4b2f-8df2-71b6d9bdd8e7 tempest-AttachVolumeShelveTestJSON-1887175045 None] Flow 'volume_create_manager' (f2d466c1-9b66-4dee-8df7-26b404c39474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:15:28 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-97accd26-d947-4b2f-8df2-71b6d9bdd8e7 tempest-AttachVolumeShelveTestJSON-1887175045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6fbecdc-b4d3-4fdf-a4ed-9f68ca63391d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:15:28 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-97accd26-d947-4b2f-8df2-71b6d9bdd8e7 tempest-AttachVolumeShelveTestJSON-1887175045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6fbecdc-b4d3-4fdf-a4ed-9f68ca63391d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:15:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1317556527',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa5f0ff0-374f-43b9-bb06-50056a552ad3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d7484eb2c1749f5ade84b3089e44839',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:15:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:15:28Z,use_quota=True,user_id='4ea2487d149244aa8be9d2288dfd13a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:15:28 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-97accd26-d947-4b2f-8df2-71b6d9bdd8e7 tempest-AttachVolumeShelveTestJSON-1887175045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f615e1c-08f5-44f5-aafc-8823b3117087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:15:28 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-97accd26-d947-4b2f-8df2-71b6d9bdd8e7 tempest-AttachVolumeShelveTestJSON-1887175045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f615e1c-08f5-44f5-aafc-8823b3117087) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:15:28 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-97accd26-d947-4b2f-8df2-71b6d9bdd8e7 tempest-AttachVolumeShelveTestJSON-1887175045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d85b3857-c8f0-4f67-a2e3-d10353e6c362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:15:28 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-97accd26-d947-4b2f-8df2-71b6d9bdd8e7 tempest-AttachVolumeShelveTestJSON-1887175045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d85b3857-c8f0-4f67-a2e3-d10353e6c362) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa5f0ff0-374f-43b9-bb06-50056a552ad3', 'volume_name': 'volume-fa5f0ff0-374f-43b9-bb06-50056a552ad3', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:15:28 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-97accd26-d947-4b2f-8df2-71b6d9bdd8e7 tempest-AttachVolumeShelveTestJSON-1887175045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59e40622-8ebd-4a63-99dc-79ece1c055e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:15:28 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-97accd26-d947-4b2f-8df2-71b6d9bdd8e7 tempest-AttachVolumeShelveTestJSON-1887175045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59e40622-8ebd-4a63-99dc-79ece1c055e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:15:28 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-97accd26-d947-4b2f-8df2-71b6d9bdd8e7 tempest-AttachVolumeShelveTestJSON-1887175045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73885a6b-4a74-44c6-acaf-8240e022708e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:15:28 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-97accd26-d947-4b2f-8df2-71b6d9bdd8e7 tempest-AttachVolumeShelveTestJSON-1887175045 None] Volume fa5f0ff0-374f-43b9-bb06-50056a552ad3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa5f0ff0-374f-43b9-bb06-50056a552ad3', 'volume_size': 1} Aug 29 01:15:28 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-97accd26-d947-4b2f-8df2-71b6d9bdd8e7 tempest-AttachVolumeShelveTestJSON-1887175045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:15:28 devstack sudo[93376]: pam_unix(sudo:session): session closed for user root Aug 29 01:15:28 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-3c19d449-253e-4edc-8ff2-d8bb9629674f tempest-VolumesImageMetadata-1151811968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ab66617a-e184-4fcf-a34f-2dc69cf1473c 1073741824" returned: 0 in 0.726s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:15:28 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-3c19d449-253e-4edc-8ff2-d8bb9629674f tempest-VolumesImageMetadata-1151811968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ab66617a-e184-4fcf-a34f-2dc69cf1473c {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:15:28 devstack sudo[93382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ab66617a-e184-4fcf-a34f-2dc69cf1473c Aug 29 01:15:28 devstack sudo[93382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:15:28 devstack sudo[93382]: pam_unix(sudo:session): session closed for user root Aug 29 01:15:28 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-3c19d449-253e-4edc-8ff2-d8bb9629674f tempest-VolumesImageMetadata-1151811968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ab66617a-e184-4fcf-a34f-2dc69cf1473c" returned: 0 in 0.288s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:15:28 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-3c19d449-253e-4edc-8ff2-d8bb9629674f tempest-VolumesImageMetadata-1151811968 None] <== create_volume: return (1076ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:15:28 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-3c19d449-253e-4edc-8ff2-d8bb9629674f tempest-VolumesImageMetadata-1151811968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.082s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:15:28 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-97accd26-d947-4b2f-8df2-71b6d9bdd8e7 tempest-AttachVolumeShelveTestJSON-1887175045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.406s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:15:28 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-97accd26-d947-4b2f-8df2-71b6d9bdd8e7 tempest-AttachVolumeShelveTestJSON-1887175045 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:15:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1317556527',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa5f0ff0-374f-43b9-bb06-50056a552ad3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d7484eb2c1749f5ade84b3089e44839',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:15:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:15:28Z,use_quota=True,user_id='4ea2487d149244aa8be9d2288dfd13a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:15:28 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-97accd26-d947-4b2f-8df2-71b6d9bdd8e7 tempest-AttachVolumeShelveTestJSON-1887175045 None] Creating volume fa5f0ff0-374f-43b9-bb06-50056a552ad3 {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:15:28 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-97accd26-d947-4b2f-8df2-71b6d9bdd8e7 tempest-AttachVolumeShelveTestJSON-1887175045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:15:28 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-97accd26-d947-4b2f-8df2-71b6d9bdd8e7 tempest-AttachVolumeShelveTestJSON-1887175045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:15:28 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-97accd26-d947-4b2f-8df2-71b6d9bdd8e7 tempest-AttachVolumeShelveTestJSON-1887175045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:15:28 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-97accd26-d947-4b2f-8df2-71b6d9bdd8e7 tempest-AttachVolumeShelveTestJSON-1887175045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:15:28 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-97accd26-d947-4b2f-8df2-71b6d9bdd8e7 tempest-AttachVolumeShelveTestJSON-1887175045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:15:28 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-97accd26-d947-4b2f-8df2-71b6d9bdd8e7 tempest-AttachVolumeShelveTestJSON-1887175045 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:15:28 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-97accd26-d947-4b2f-8df2-71b6d9bdd8e7 tempest-AttachVolumeShelveTestJSON-1887175045 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:15:28 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-97accd26-d947-4b2f-8df2-71b6d9bdd8e7 tempest-AttachVolumeShelveTestJSON-1887175045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-fa5f0ff0-374f-43b9-bb06-50056a552ad3 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:15:28 devstack sudo[93386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-fa5f0ff0-374f-43b9-bb06-50056a552ad3 1073741824 Aug 29 01:15:28 devstack sudo[93386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:15:28 devstack cinder-volume[86111]: DEBUG cinder.volume.volume_utils [None req-3c19d449-253e-4edc-8ff2-d8bb9629674f tempest-VolumesImageMetadata-1151811968 None] Attempting download of f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab ((None, [{'url': 'file:///opt/stack/data/glance/images/f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab', 'metadata': {}}])) to volume ab66617a-e184-4fcf-a34f-2dc69cf1473c. {{(pid=86111) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 29 01:15:28 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2cfcb25-3b91-4f8d-b6aa-8ec648d3d06e]: (4, 'raw') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:15:28 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-3c19d449-253e-4edc-8ff2-d8bb9629674f tempest-VolumesImageMetadata-1151811968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab_mbj4s0ih {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:15:29 devstack sudo[93388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab_mbj4s0ih Aug 29 01:15:29 devstack sudo[93388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:15:29 devstack sudo[93388]: pam_unix(sudo:session): session closed for user root Aug 29 01:15:29 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-3c19d449-253e-4edc-8ff2-d8bb9629674f tempest-VolumesImageMetadata-1151811968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab_mbj4s0ih" returned: 0 in 0.472s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:15:29 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-3c19d449-253e-4edc-8ff2-d8bb9629674f tempest-VolumesImageMetadata-1151811968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab_mbj4s0ih {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:15:29 devstack sudo[93386]: pam_unix(sudo:session): session closed for user root Aug 29 01:15:29 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-97accd26-d947-4b2f-8df2-71b6d9bdd8e7 tempest-AttachVolumeShelveTestJSON-1887175045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-fa5f0ff0-374f-43b9-bb06-50056a552ad3 1073741824" returned: 0 in 0.634s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:15:29 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-97accd26-d947-4b2f-8df2-71b6d9bdd8e7 tempest-AttachVolumeShelveTestJSON-1887175045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-fa5f0ff0-374f-43b9-bb06-50056a552ad3 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:15:29 devstack sudo[93397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-fa5f0ff0-374f-43b9-bb06-50056a552ad3 Aug 29 01:15:29 devstack sudo[93396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab_mbj4s0ih Aug 29 01:15:29 devstack sudo[93397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:15:29 devstack sudo[93396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:15:29 devstack sudo[93396]: pam_unix(sudo:session): session closed for user root Aug 29 01:15:29 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-3c19d449-253e-4edc-8ff2-d8bb9629674f tempest-VolumesImageMetadata-1151811968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab_mbj4s0ih" returned: 1 in 0.444s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:15:29 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-3c19d449-253e-4edc-8ff2-d8bb9629674f tempest-VolumesImageMetadata-1151811968 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab_mbj4s0ih' failed. Not Retrying. {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 29 01:15:29 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecc8fc34-73d0-4628-b087-642223621db8]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:15:29 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-3c19d449-253e-4edc-8ff2-d8bb9629674f tempest-VolumesImageMetadata-1151811968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab_0wj34bsydevstack@QuobyteHD {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:15:29 devstack sudo[93397]: pam_unix(sudo:session): session closed for user root Aug 29 01:15:29 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-97accd26-d947-4b2f-8df2-71b6d9bdd8e7 tempest-AttachVolumeShelveTestJSON-1887175045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-fa5f0ff0-374f-43b9-bb06-50056a552ad3" returned: 0 in 0.402s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:15:29 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-97accd26-d947-4b2f-8df2-71b6d9bdd8e7 tempest-AttachVolumeShelveTestJSON-1887175045 None] <== create_volume: return (1099ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:15:29 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-97accd26-d947-4b2f-8df2-71b6d9bdd8e7 tempest-AttachVolumeShelveTestJSON-1887175045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.104s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:15:29 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-97accd26-d947-4b2f-8df2-71b6d9bdd8e7 tempest-AttachVolumeShelveTestJSON-1887175045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73885a6b-4a74-44c6-acaf-8240e022708e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa5f0ff0-374f-43b9-bb06-50056a552ad3', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:15:29 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-97accd26-d947-4b2f-8df2-71b6d9bdd8e7 tempest-AttachVolumeShelveTestJSON-1887175045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42943971-3433-406f-aed3-d2e1662e8a2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:15:29 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-97accd26-d947-4b2f-8df2-71b6d9bdd8e7 tempest-AttachVolumeShelveTestJSON-1887175045 None] Volume volume-fa5f0ff0-374f-43b9-bb06-50056a552ad3 (fa5f0ff0-374f-43b9-bb06-50056a552ad3): created successfully Aug 29 01:15:29 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-97accd26-d947-4b2f-8df2-71b6d9bdd8e7 tempest-AttachVolumeShelveTestJSON-1887175045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42943971-3433-406f-aed3-d2e1662e8a2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:15:29 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-97accd26-d947-4b2f-8df2-71b6d9bdd8e7 tempest-AttachVolumeShelveTestJSON-1887175045 None] Flow 'volume_create_manager' (f2d466c1-9b66-4dee-8df7-26b404c39474) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:15:29 devstack sudo[93403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab_0wj34bsydevstack@QuobyteHD Aug 29 01:15:29 devstack sudo[93403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:15:29 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-97accd26-d947-4b2f-8df2-71b6d9bdd8e7 tempest-AttachVolumeShelveTestJSON-1887175045 None] Created volume successfully. Aug 29 01:15:30 devstack sudo[93403]: pam_unix(sudo:session): session closed for user root Aug 29 01:15:30 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-3c19d449-253e-4edc-8ff2-d8bb9629674f tempest-VolumesImageMetadata-1151811968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab_0wj34bsydevstack@QuobyteHD" returned: 0 in 0.386s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:15:30 devstack cinder-volume[86111]: DEBUG cinder.image.image_utils [None req-3c19d449-253e-4edc-8ff2-d8bb9629674f tempest-VolumesImageMetadata-1151811968 None] f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab was qcow2, converting to qcow2 {{(pid=86111) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 29 01:15:30 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-3c19d449-253e-4edc-8ff2-d8bb9629674f tempest-VolumesImageMetadata-1151811968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab_0wj34bsydevstack@QuobyteHD /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ab66617a-e184-4fcf-a34f-2dc69cf1473c {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:15:30 devstack sudo[93409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab_0wj34bsydevstack@QuobyteHD /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ab66617a-e184-4fcf-a34f-2dc69cf1473c Aug 29 01:15:30 devstack sudo[93409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:15:32 devstack sudo[93409]: pam_unix(sudo:session): session closed for user root Aug 29 01:15:32 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-3c19d449-253e-4edc-8ff2-d8bb9629674f tempest-VolumesImageMetadata-1151811968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab_0wj34bsydevstack@QuobyteHD /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ab66617a-e184-4fcf-a34f-2dc69cf1473c" returned: 0 in 2.501s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:15:32 devstack cinder-volume[86111]: DEBUG cinder.image.image_utils [None req-3c19d449-253e-4edc-8ff2-d8bb9629674f tempest-VolumesImageMetadata-1151811968 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab_0wj34bsydevstack@QuobyteHD, size 112.00 MB, duration 2.50 sec, destination /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ab66617a-e184-4fcf-a34f-2dc69cf1473c {{(pid=86111) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 29 01:15:32 devstack cinder-volume[86111]: INFO cinder.image.image_utils [None req-3c19d449-253e-4edc-8ff2-d8bb9629674f tempest-VolumesImageMetadata-1151811968 None] Converted 112.00 MB image at 44.73 MB/s Aug 29 01:15:32 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-3c19d449-253e-4edc-8ff2-d8bb9629674f tempest-VolumesImageMetadata-1151811968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ab66617a-e184-4fcf-a34f-2dc69cf1473c 1G {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:15:32 devstack sudo[93431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ab66617a-e184-4fcf-a34f-2dc69cf1473c 1G Aug 29 01:15:32 devstack sudo[93431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:15:33 devstack sudo[93431]: pam_unix(sudo:session): session closed for user root Aug 29 01:15:33 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-3c19d449-253e-4edc-8ff2-d8bb9629674f tempest-VolumesImageMetadata-1151811968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ab66617a-e184-4fcf-a34f-2dc69cf1473c 1G" returned: 0 in 0.455s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:15:33 devstack cinder-volume[86111]: DEBUG cinder.volume.volume_utils [None req-3c19d449-253e-4edc-8ff2-d8bb9629674f tempest-VolumesImageMetadata-1151811968 None] Downloaded image f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab ((None, [{'url': 'file:///opt/stack/data/glance/images/f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab', 'metadata': {}}])) to volume ab66617a-e184-4fcf-a34f-2dc69cf1473c successfully. {{(pid=86111) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 29 01:15:33 devstack cinder-volume[86111]: DEBUG cinder.image.image_utils [None req-3c19d449-253e-4edc-8ff2-d8bb9629674f tempest-VolumesImageMetadata-1151811968 None] Temporary image f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab for user 2dc4a9da9c2549748be6607861c4f1d9 is deleted. {{(pid=86111) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 29 01:15:33 devstack cinder-volume[86111]: DEBUG cinder.volume.volume_utils [None req-3c19d449-253e-4edc-8ff2-d8bb9629674f tempest-VolumesImageMetadata-1151811968 None] Marking volume ab66617a-e184-4fcf-a34f-2dc69cf1473c as bootable. {{(pid=86111) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 29 01:15:33 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c19d449-253e-4edc-8ff2-d8bb9629674f tempest-VolumesImageMetadata-1151811968 None] Copying metadata from image f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab to ab66617a-e184-4fcf-a34f-2dc69cf1473c. {{(pid=86111) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 29 01:15:33 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c19d449-253e-4edc-8ff2-d8bb9629674f tempest-VolumesImageMetadata-1151811968 None] Creating volume glance metadata for volume ab66617a-e184-4fcf-a34f-2dc69cf1473c backed by image f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86111) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 29 01:15:33 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-3c19d449-253e-4edc-8ff2-d8bb9629674f tempest-VolumesImageMetadata-1151811968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c32c8e79-356e-48b4-8e5b-1babf8699c95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab66617a-e184-4fcf-a34f-2dc69cf1473c', 'volume_size': 1, 'image_id': 'f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8d940113004947258ae710723d273006', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab', 'created_at': datetime.datetime(2026, 8, 28, 23, 3, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 23, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:15:33 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-3c19d449-253e-4edc-8ff2-d8bb9629674f tempest-VolumesImageMetadata-1151811968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e496ba89-2a48-4909-ac70-e3c798e4e758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:15:33 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-3c19d449-253e-4edc-8ff2-d8bb9629674f tempest-VolumesImageMetadata-1151811968 None] Volume volume-ab66617a-e184-4fcf-a34f-2dc69cf1473c (ab66617a-e184-4fcf-a34f-2dc69cf1473c): created successfully Aug 29 01:15:33 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-3c19d449-253e-4edc-8ff2-d8bb9629674f tempest-VolumesImageMetadata-1151811968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e496ba89-2a48-4909-ac70-e3c798e4e758) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:15:33 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-3c19d449-253e-4edc-8ff2-d8bb9629674f tempest-VolumesImageMetadata-1151811968 None] Flow 'volume_create_manager' (c855690d-8641-4aab-b2cd-5650cf145d2b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:15:33 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-3c19d449-253e-4edc-8ff2-d8bb9629674f tempest-VolumesImageMetadata-1151811968 None] Created volume successfully. Aug 29 01:15:34 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-b4ce0072-2072-49b6-9d20-eed721dc512d tempest-VolumesImageMetadata-1151811968 None] Acquiring lock "cinder-ab66617a-e184-4fcf-a34f-2dc69cf1473c-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:15:34 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-b4ce0072-2072-49b6-9d20-eed721dc512d tempest-VolumesImageMetadata-1151811968 None] Lock "cinder-ab66617a-e184-4fcf-a34f-2dc69cf1473c-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:15:34 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-b4ce0072-2072-49b6-9d20-eed721dc512d tempest-VolumesImageMetadata-1151811968 None] Acquiring lock "cinder-quobyte-ab66617a-e184-4fcf-a34f-2dc69cf1473c" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:15:34 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-b4ce0072-2072-49b6-9d20-eed721dc512d tempest-VolumesImageMetadata-1151811968 None] Lock "cinder-quobyte-ab66617a-e184-4fcf-a34f-2dc69cf1473c" acquired by "delete_volume" :: waited 0.016s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:15:34 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[c92c96e8-c068-40a6-bbdf-da39d58c2567]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:15:34 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-b4ce0072-2072-49b6-9d20-eed721dc512d tempest-VolumesImageMetadata-1151811968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ab66617a-e184-4fcf-a34f-2dc69cf1473c {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:15:34 devstack sudo[93444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ab66617a-e184-4fcf-a34f-2dc69cf1473c Aug 29 01:15:34 devstack sudo[93444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:15:34 devstack sudo[93444]: pam_unix(sudo:session): session closed for user root Aug 29 01:15:34 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-b4ce0072-2072-49b6-9d20-eed721dc512d tempest-VolumesImageMetadata-1151811968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ab66617a-e184-4fcf-a34f-2dc69cf1473c" returned: 0 in 0.422s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:15:34 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-b4ce0072-2072-49b6-9d20-eed721dc512d tempest-VolumesImageMetadata-1151811968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ab66617a-e184-4fcf-a34f-2dc69cf1473c {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:15:34 devstack sudo[93449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ab66617a-e184-4fcf-a34f-2dc69cf1473c Aug 29 01:15:34 devstack sudo[93449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:15:35 devstack sudo[93449]: pam_unix(sudo:session): session closed for user root Aug 29 01:15:35 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-b4ce0072-2072-49b6-9d20-eed721dc512d tempest-VolumesImageMetadata-1151811968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ab66617a-e184-4fcf-a34f-2dc69cf1473c" returned: 0 in 0.309s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:15:35 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-b4ce0072-2072-49b6-9d20-eed721dc512d tempest-VolumesImageMetadata-1151811968 None] Lock "cinder-quobyte-ab66617a-e184-4fcf-a34f-2dc69cf1473c" released by "delete_volume" :: held 0.824s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:15:35 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-b4ce0072-2072-49b6-9d20-eed721dc512d tempest-VolumesImageMetadata-1151811968 None] Created reservations ['b2a3586f-1523-4f81-99b6-d79861c22137', '1ed40035-7f79-4342-a90b-336b569ce150', 'ec4ff608-ae0e-439e-9ce5-531fd79707af', '472e1c49-7d39-4cf6-ae8d-e65ac3842078'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:15:35 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-b4ce0072-2072-49b6-9d20-eed721dc512d tempest-VolumesImageMetadata-1151811968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:15:35 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-b4ce0072-2072-49b6-9d20-eed721dc512d tempest-VolumesImageMetadata-1151811968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:15:35 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-b4ce0072-2072-49b6-9d20-eed721dc512d tempest-VolumesImageMetadata-1151811968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:15:35 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-b4ce0072-2072-49b6-9d20-eed721dc512d tempest-VolumesImageMetadata-1151811968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:15:35 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-b4ce0072-2072-49b6-9d20-eed721dc512d tempest-VolumesImageMetadata-1151811968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:15:35 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-b4ce0072-2072-49b6-9d20-eed721dc512d tempest-VolumesImageMetadata-1151811968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:15:35 devstack sudo[93452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:15:35 devstack sudo[93452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:15:35 devstack sudo[93452]: pam_unix(sudo:session): session closed for user root Aug 29 01:15:35 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-b4ce0072-2072-49b6-9d20-eed721dc512d tempest-VolumesImageMetadata-1151811968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.346s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:15:35 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-b4ce0072-2072-49b6-9d20-eed721dc512d tempest-VolumesImageMetadata-1151811968 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:15:35 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-b4ce0072-2072-49b6-9d20-eed721dc512d tempest-VolumesImageMetadata-1151811968 None] Deleted volume successfully. Aug 29 01:15:35 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-b4ce0072-2072-49b6-9d20-eed721dc512d tempest-VolumesImageMetadata-1151811968 None] Lock "cinder-ab66617a-e184-4fcf-a34f-2dc69cf1473c-delete_volume" released by "delete_volume" :: held 1.497s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:15:37 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6bc6a51-5a9b-4efb-aa60-2730e220bf3c tempest-AbsoluteLimitsTests-490380035 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:15:37 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-a6bc6a51-5a9b-4efb-aa60-2730e220bf3c tempest-AbsoluteLimitsTests-490380035 None] Flow 'volume_create_manager' (c6219540-e41f-424c-9702-16fff77dac17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:15:37 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-a6bc6a51-5a9b-4efb-aa60-2730e220bf3c tempest-AbsoluteLimitsTests-490380035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf06476d-217a-4b8c-8c7b-87c80f4a4a48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:15:37 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-a6bc6a51-5a9b-4efb-aa60-2730e220bf3c tempest-AbsoluteLimitsTests-490380035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf06476d-217a-4b8c-8c7b-87c80f4a4a48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:15:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-81016735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c26f68e6-7354-425a-bbd3-2d6ea3577fc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f2de97f64d94d409b38931d9e81cdf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:15:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:15:37Z,use_quota=True,user_id='b65f92ffe81242c4b6d08938b2ad32a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:15:37 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-a6bc6a51-5a9b-4efb-aa60-2730e220bf3c tempest-AbsoluteLimitsTests-490380035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96665d1d-2d29-4afd-85ee-a59d7874edd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:15:37 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-a6bc6a51-5a9b-4efb-aa60-2730e220bf3c tempest-AbsoluteLimitsTests-490380035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96665d1d-2d29-4afd-85ee-a59d7874edd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:15:37 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-a6bc6a51-5a9b-4efb-aa60-2730e220bf3c tempest-AbsoluteLimitsTests-490380035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3939a31-ecdc-4d7c-b603-69d8d1770f4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:15:37 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-a6bc6a51-5a9b-4efb-aa60-2730e220bf3c tempest-AbsoluteLimitsTests-490380035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3939a31-ecdc-4d7c-b603-69d8d1770f4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c26f68e6-7354-425a-bbd3-2d6ea3577fc5', 'volume_name': 'volume-c26f68e6-7354-425a-bbd3-2d6ea3577fc5', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:15:37 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-a6bc6a51-5a9b-4efb-aa60-2730e220bf3c tempest-AbsoluteLimitsTests-490380035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebd2a28e-6299-4898-b5de-f9895949133a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:15:37 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-a6bc6a51-5a9b-4efb-aa60-2730e220bf3c tempest-AbsoluteLimitsTests-490380035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebd2a28e-6299-4898-b5de-f9895949133a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:15:37 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-a6bc6a51-5a9b-4efb-aa60-2730e220bf3c tempest-AbsoluteLimitsTests-490380035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af406ba7-50a6-490a-b83e-5d6943ccf0e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:15:37 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-a6bc6a51-5a9b-4efb-aa60-2730e220bf3c tempest-AbsoluteLimitsTests-490380035 None] Volume c26f68e6-7354-425a-bbd3-2d6ea3577fc5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c26f68e6-7354-425a-bbd3-2d6ea3577fc5', 'volume_size': 1} Aug 29 01:15:37 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-a6bc6a51-5a9b-4efb-aa60-2730e220bf3c tempest-AbsoluteLimitsTests-490380035 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:15:37 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-a6bc6a51-5a9b-4efb-aa60-2730e220bf3c tempest-AbsoluteLimitsTests-490380035 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:15:37 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-a6bc6a51-5a9b-4efb-aa60-2730e220bf3c tempest-AbsoluteLimitsTests-490380035 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:15:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-81016735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c26f68e6-7354-425a-bbd3-2d6ea3577fc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f2de97f64d94d409b38931d9e81cdf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:15:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:15:37Z,use_quota=True,user_id='b65f92ffe81242c4b6d08938b2ad32a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:15:37 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-a6bc6a51-5a9b-4efb-aa60-2730e220bf3c tempest-AbsoluteLimitsTests-490380035 None] Creating volume c26f68e6-7354-425a-bbd3-2d6ea3577fc5 {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:15:37 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-a6bc6a51-5a9b-4efb-aa60-2730e220bf3c tempest-AbsoluteLimitsTests-490380035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:15:37 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-a6bc6a51-5a9b-4efb-aa60-2730e220bf3c tempest-AbsoluteLimitsTests-490380035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:15:37 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-a6bc6a51-5a9b-4efb-aa60-2730e220bf3c tempest-AbsoluteLimitsTests-490380035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:15:37 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-a6bc6a51-5a9b-4efb-aa60-2730e220bf3c tempest-AbsoluteLimitsTests-490380035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:15:37 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-a6bc6a51-5a9b-4efb-aa60-2730e220bf3c tempest-AbsoluteLimitsTests-490380035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:15:37 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-a6bc6a51-5a9b-4efb-aa60-2730e220bf3c tempest-AbsoluteLimitsTests-490380035 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:15:37 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-a6bc6a51-5a9b-4efb-aa60-2730e220bf3c tempest-AbsoluteLimitsTests-490380035 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:15:37 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-a6bc6a51-5a9b-4efb-aa60-2730e220bf3c tempest-AbsoluteLimitsTests-490380035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-c26f68e6-7354-425a-bbd3-2d6ea3577fc5 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:15:37 devstack sudo[93480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-c26f68e6-7354-425a-bbd3-2d6ea3577fc5 1073741824 Aug 29 01:15:37 devstack sudo[93480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:15:38 devstack sudo[93480]: pam_unix(sudo:session): session closed for user root Aug 29 01:15:38 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-a6bc6a51-5a9b-4efb-aa60-2730e220bf3c tempest-AbsoluteLimitsTests-490380035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-c26f68e6-7354-425a-bbd3-2d6ea3577fc5 1073741824" returned: 0 in 0.544s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:15:38 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-a6bc6a51-5a9b-4efb-aa60-2730e220bf3c tempest-AbsoluteLimitsTests-490380035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-c26f68e6-7354-425a-bbd3-2d6ea3577fc5 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:15:38 devstack sudo[93487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-c26f68e6-7354-425a-bbd3-2d6ea3577fc5 Aug 29 01:15:38 devstack sudo[93487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:15:38 devstack sudo[93487]: pam_unix(sudo:session): session closed for user root Aug 29 01:15:38 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-a6bc6a51-5a9b-4efb-aa60-2730e220bf3c tempest-AbsoluteLimitsTests-490380035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-c26f68e6-7354-425a-bbd3-2d6ea3577fc5" returned: 0 in 0.285s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:15:38 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-a6bc6a51-5a9b-4efb-aa60-2730e220bf3c tempest-AbsoluteLimitsTests-490380035 None] <== create_volume: return (886ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:15:38 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-a6bc6a51-5a9b-4efb-aa60-2730e220bf3c tempest-AbsoluteLimitsTests-490380035 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.891s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:15:38 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-a6bc6a51-5a9b-4efb-aa60-2730e220bf3c tempest-AbsoluteLimitsTests-490380035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af406ba7-50a6-490a-b83e-5d6943ccf0e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c26f68e6-7354-425a-bbd3-2d6ea3577fc5', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:15:38 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-a6bc6a51-5a9b-4efb-aa60-2730e220bf3c tempest-AbsoluteLimitsTests-490380035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ab3c4b8-5b5e-426e-908f-e8762418c2cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:15:38 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-a6bc6a51-5a9b-4efb-aa60-2730e220bf3c tempest-AbsoluteLimitsTests-490380035 None] Volume volume-c26f68e6-7354-425a-bbd3-2d6ea3577fc5 (c26f68e6-7354-425a-bbd3-2d6ea3577fc5): created successfully Aug 29 01:15:38 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-a6bc6a51-5a9b-4efb-aa60-2730e220bf3c tempest-AbsoluteLimitsTests-490380035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ab3c4b8-5b5e-426e-908f-e8762418c2cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:15:38 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-a6bc6a51-5a9b-4efb-aa60-2730e220bf3c tempest-AbsoluteLimitsTests-490380035 None] Flow 'volume_create_manager' (c6219540-e41f-424c-9702-16fff77dac17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:15:38 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-a6bc6a51-5a9b-4efb-aa60-2730e220bf3c tempest-AbsoluteLimitsTests-490380035 None] Created volume successfully. Aug 29 01:15:39 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f2f1671-5916-4709-a90a-02d334196470 tempest-VolumesMetadataTest-1470040385 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:15:39 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-3f2f1671-5916-4709-a90a-02d334196470 tempest-VolumesMetadataTest-1470040385 None] Flow 'volume_create_manager' (daad4d1b-e171-44c9-9bfe-031d4fcd7aa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:15:39 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-3f2f1671-5916-4709-a90a-02d334196470 tempest-VolumesMetadataTest-1470040385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51e79e52-a6cc-448e-8760-e0f3993ef0e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:15:39 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-3f2f1671-5916-4709-a90a-02d334196470 tempest-VolumesMetadataTest-1470040385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51e79e52-a6cc-448e-8760-e0f3993ef0e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:15:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1100438085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=040ea8c9-73b2-4542-a0c1-7f91e404f3c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a53086b2f8242bc97f9b437b6bd09bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:15:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:15:39Z,use_quota=True,user_id='0cde124fb0534ebd860e1257ab8bd683',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:15:39 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-3f2f1671-5916-4709-a90a-02d334196470 tempest-VolumesMetadataTest-1470040385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8930c875-3946-4d9d-a2c7-640cc6f4807c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:15:39 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-3f2f1671-5916-4709-a90a-02d334196470 tempest-VolumesMetadataTest-1470040385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8930c875-3946-4d9d-a2c7-640cc6f4807c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:15:39 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-3f2f1671-5916-4709-a90a-02d334196470 tempest-VolumesMetadataTest-1470040385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abc4bfdd-201e-4902-b568-7e14c6ad816f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:15:39 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-3f2f1671-5916-4709-a90a-02d334196470 tempest-VolumesMetadataTest-1470040385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abc4bfdd-201e-4902-b568-7e14c6ad816f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '040ea8c9-73b2-4542-a0c1-7f91e404f3c7', 'volume_name': 'volume-040ea8c9-73b2-4542-a0c1-7f91e404f3c7', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:15:39 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-3f2f1671-5916-4709-a90a-02d334196470 tempest-VolumesMetadataTest-1470040385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c65d8c3a-7f15-48b3-a38d-7da80b44b5b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:15:39 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-3f2f1671-5916-4709-a90a-02d334196470 tempest-VolumesMetadataTest-1470040385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c65d8c3a-7f15-48b3-a38d-7da80b44b5b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:15:39 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-3f2f1671-5916-4709-a90a-02d334196470 tempest-VolumesMetadataTest-1470040385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19b47298-0f18-4f74-ac1a-819cdb89aab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:15:39 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-3f2f1671-5916-4709-a90a-02d334196470 tempest-VolumesMetadataTest-1470040385 None] Volume 040ea8c9-73b2-4542-a0c1-7f91e404f3c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-040ea8c9-73b2-4542-a0c1-7f91e404f3c7', 'volume_size': 1} Aug 29 01:15:39 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-3f2f1671-5916-4709-a90a-02d334196470 tempest-VolumesMetadataTest-1470040385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:15:39 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-3f2f1671-5916-4709-a90a-02d334196470 tempest-VolumesMetadataTest-1470040385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:15:39 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-3f2f1671-5916-4709-a90a-02d334196470 tempest-VolumesMetadataTest-1470040385 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:15:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1100438085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=040ea8c9-73b2-4542-a0c1-7f91e404f3c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a53086b2f8242bc97f9b437b6bd09bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:15:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:15:39Z,use_quota=True,user_id='0cde124fb0534ebd860e1257ab8bd683',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:15:39 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-3f2f1671-5916-4709-a90a-02d334196470 tempest-VolumesMetadataTest-1470040385 None] Creating volume 040ea8c9-73b2-4542-a0c1-7f91e404f3c7 {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:15:39 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-3f2f1671-5916-4709-a90a-02d334196470 tempest-VolumesMetadataTest-1470040385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:15:39 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-3f2f1671-5916-4709-a90a-02d334196470 tempest-VolumesMetadataTest-1470040385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:15:39 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-3f2f1671-5916-4709-a90a-02d334196470 tempest-VolumesMetadataTest-1470040385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:15:39 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-3f2f1671-5916-4709-a90a-02d334196470 tempest-VolumesMetadataTest-1470040385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:15:39 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-3f2f1671-5916-4709-a90a-02d334196470 tempest-VolumesMetadataTest-1470040385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:15:39 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-3f2f1671-5916-4709-a90a-02d334196470 tempest-VolumesMetadataTest-1470040385 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:15:39 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-3f2f1671-5916-4709-a90a-02d334196470 tempest-VolumesMetadataTest-1470040385 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:15:39 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-3f2f1671-5916-4709-a90a-02d334196470 tempest-VolumesMetadataTest-1470040385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-040ea8c9-73b2-4542-a0c1-7f91e404f3c7 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:15:39 devstack sudo[93510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-040ea8c9-73b2-4542-a0c1-7f91e404f3c7 1073741824 Aug 29 01:15:39 devstack sudo[93510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:15:39 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-dcb4744d-da3b-46eb-a7fa-e185685b2b1c tempest-AbsoluteLimitsTests-490380035 None] Acquiring lock "cinder-c26f68e6-7354-425a-bbd3-2d6ea3577fc5-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:15:39 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-dcb4744d-da3b-46eb-a7fa-e185685b2b1c tempest-AbsoluteLimitsTests-490380035 None] Lock "cinder-c26f68e6-7354-425a-bbd3-2d6ea3577fc5-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:15:39 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-dcb4744d-da3b-46eb-a7fa-e185685b2b1c tempest-AbsoluteLimitsTests-490380035 None] Acquiring lock "cinder-quobyte-c26f68e6-7354-425a-bbd3-2d6ea3577fc5" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:15:39 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-dcb4744d-da3b-46eb-a7fa-e185685b2b1c tempest-AbsoluteLimitsTests-490380035 None] Lock "cinder-quobyte-c26f68e6-7354-425a-bbd3-2d6ea3577fc5" acquired by "delete_volume" :: waited 0.030s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:15:39 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[78fa643a-27ea-41a5-9844-3fcb77cbef7c]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:15:39 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-dcb4744d-da3b-46eb-a7fa-e185685b2b1c tempest-AbsoluteLimitsTests-490380035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-c26f68e6-7354-425a-bbd3-2d6ea3577fc5 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:15:40 devstack sudo[93515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-c26f68e6-7354-425a-bbd3-2d6ea3577fc5 Aug 29 01:15:40 devstack sudo[93515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:15:40 devstack sudo[93510]: pam_unix(sudo:session): session closed for user root Aug 29 01:15:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-3f2f1671-5916-4709-a90a-02d334196470 tempest-VolumesMetadataTest-1470040385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-040ea8c9-73b2-4542-a0c1-7f91e404f3c7 1073741824" returned: 0 in 0.567s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:15:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-3f2f1671-5916-4709-a90a-02d334196470 tempest-VolumesMetadataTest-1470040385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-040ea8c9-73b2-4542-a0c1-7f91e404f3c7 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:15:40 devstack sudo[93518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-040ea8c9-73b2-4542-a0c1-7f91e404f3c7 Aug 29 01:15:40 devstack sudo[93518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:15:40 devstack sudo[93515]: pam_unix(sudo:session): session closed for user root Aug 29 01:15:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-dcb4744d-da3b-46eb-a7fa-e185685b2b1c tempest-AbsoluteLimitsTests-490380035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-c26f68e6-7354-425a-bbd3-2d6ea3577fc5" returned: 0 in 0.384s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:15:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-dcb4744d-da3b-46eb-a7fa-e185685b2b1c tempest-AbsoluteLimitsTests-490380035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-c26f68e6-7354-425a-bbd3-2d6ea3577fc5 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:15:40 devstack sudo[93523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-c26f68e6-7354-425a-bbd3-2d6ea3577fc5 Aug 29 01:15:40 devstack sudo[93523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:15:40 devstack sudo[93518]: pam_unix(sudo:session): session closed for user root Aug 29 01:15:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-3f2f1671-5916-4709-a90a-02d334196470 tempest-VolumesMetadataTest-1470040385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-040ea8c9-73b2-4542-a0c1-7f91e404f3c7" returned: 0 in 0.279s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:15:40 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-3f2f1671-5916-4709-a90a-02d334196470 tempest-VolumesMetadataTest-1470040385 None] <== create_volume: return (891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:15:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-3f2f1671-5916-4709-a90a-02d334196470 tempest-VolumesMetadataTest-1470040385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.896s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:15:40 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-3f2f1671-5916-4709-a90a-02d334196470 tempest-VolumesMetadataTest-1470040385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19b47298-0f18-4f74-ac1a-819cdb89aab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-040ea8c9-73b2-4542-a0c1-7f91e404f3c7', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:15:40 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-3f2f1671-5916-4709-a90a-02d334196470 tempest-VolumesMetadataTest-1470040385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4db82b43-90dc-4b61-bfe5-628fc5bec138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:15:40 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-3f2f1671-5916-4709-a90a-02d334196470 tempest-VolumesMetadataTest-1470040385 None] Volume volume-040ea8c9-73b2-4542-a0c1-7f91e404f3c7 (040ea8c9-73b2-4542-a0c1-7f91e404f3c7): created successfully Aug 29 01:15:40 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-3f2f1671-5916-4709-a90a-02d334196470 tempest-VolumesMetadataTest-1470040385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4db82b43-90dc-4b61-bfe5-628fc5bec138) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:15:40 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-3f2f1671-5916-4709-a90a-02d334196470 tempest-VolumesMetadataTest-1470040385 None] Flow 'volume_create_manager' (daad4d1b-e171-44c9-9bfe-031d4fcd7aa9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:15:40 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-3f2f1671-5916-4709-a90a-02d334196470 tempest-VolumesMetadataTest-1470040385 None] Created volume successfully. Aug 29 01:15:40 devstack sudo[93523]: pam_unix(sudo:session): session closed for user root Aug 29 01:15:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-dcb4744d-da3b-46eb-a7fa-e185685b2b1c tempest-AbsoluteLimitsTests-490380035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-c26f68e6-7354-425a-bbd3-2d6ea3577fc5" returned: 0 in 0.264s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:15:40 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-dcb4744d-da3b-46eb-a7fa-e185685b2b1c tempest-AbsoluteLimitsTests-490380035 None] Lock "cinder-quobyte-c26f68e6-7354-425a-bbd3-2d6ea3577fc5" released by "delete_volume" :: held 0.689s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:15:40 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-dcb4744d-da3b-46eb-a7fa-e185685b2b1c tempest-AbsoluteLimitsTests-490380035 None] Created reservations ['e9d71307-207c-432c-8026-25c10fb27c41', '962e91b6-fe34-44c9-8c03-44dd6a83de87', '98942e88-b872-470e-9a03-212072888be8', '49dbd506-80da-4b53-8fb2-51d8cee799f9'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:15:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-dcb4744d-da3b-46eb-a7fa-e185685b2b1c tempest-AbsoluteLimitsTests-490380035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:15:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-dcb4744d-da3b-46eb-a7fa-e185685b2b1c tempest-AbsoluteLimitsTests-490380035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:15:40 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-dcb4744d-da3b-46eb-a7fa-e185685b2b1c tempest-AbsoluteLimitsTests-490380035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:15:40 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-dcb4744d-da3b-46eb-a7fa-e185685b2b1c tempest-AbsoluteLimitsTests-490380035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:15:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-dcb4744d-da3b-46eb-a7fa-e185685b2b1c tempest-AbsoluteLimitsTests-490380035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:15:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-dcb4744d-da3b-46eb-a7fa-e185685b2b1c tempest-AbsoluteLimitsTests-490380035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:15:40 devstack sudo[93527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:15:40 devstack sudo[93527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:15:40 devstack cinder-volume[86111]: DEBUG oslo_service.periodic_task [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86111) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 29 01:15:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:15:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:15:40 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:15:40 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:15:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:15:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:15:40 devstack sudo[93529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:15:40 devstack sudo[93529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:15:40 devstack sudo[93527]: pam_unix(sudo:session): session closed for user root Aug 29 01:15:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-dcb4744d-da3b-46eb-a7fa-e185685b2b1c tempest-AbsoluteLimitsTests-490380035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.275s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:15:41 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-dcb4744d-da3b-46eb-a7fa-e185685b2b1c tempest-AbsoluteLimitsTests-490380035 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:15:41 devstack sudo[93529]: pam_unix(sudo:session): session closed for user root Aug 29 01:15:41 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-dcb4744d-da3b-46eb-a7fa-e185685b2b1c tempest-AbsoluteLimitsTests-490380035 None] Deleted volume successfully. Aug 29 01:15:41 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-de752545-d617-440e-8362-d04fae0901a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.270s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:15:41 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:15:41 devstack cinder-volume[86111]: DEBUG oslo_service.periodic_task [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Running periodic task VolumeManager._thread_info {{(pid=86111) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 29 01:15:41 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-de752545-d617-440e-8362-d04fae0901a5 None None] thread count: 28 {{(pid=86111) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 29 01:15:41 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-de752545-d617-440e-8362-d04fae0901a5 None None] thread info: [<_MainThread(MainThread, started 129173440548992)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86111) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 29 01:15:41 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-dcb4744d-da3b-46eb-a7fa-e185685b2b1c tempest-AbsoluteLimitsTests-490380035 None] Lock "cinder-c26f68e6-7354-425a-bbd3-2d6ea3577fc5-delete_volume" released by "delete_volume" :: held 1.226s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:15:42 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [req-76c63424-6420-427e-8add-0ed29cb3268d req-550543cc-bb43-45a6-aa75-30947306c3eb tempest-AttachVolumeShelveTestJSON-1887175045 None] No connector for attachment 2b4e7f2f-de49-45d9-89ae-76524d4e83c8; skipping storage backend terminate_connection call. {{(pid=86111) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Aug 29 01:15:42 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [req-76c63424-6420-427e-8add-0ed29cb3268d req-550543cc-bb43-45a6-aa75-30947306c3eb tempest-AttachVolumeShelveTestJSON-1887175045 None] Deleting attachment 2b4e7f2f-de49-45d9-89ae-76524d4e83c8. {{(pid=86111) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 29 01:15:42 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-9740e39e-03a9-4377-bce5-8abb1331934b tempest-VolumesMetadataTest-1470040385 None] Acquiring lock "cinder-040ea8c9-73b2-4542-a0c1-7f91e404f3c7-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:15:42 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-9740e39e-03a9-4377-bce5-8abb1331934b tempest-VolumesMetadataTest-1470040385 None] Lock "cinder-040ea8c9-73b2-4542-a0c1-7f91e404f3c7-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:15:42 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-9740e39e-03a9-4377-bce5-8abb1331934b tempest-VolumesMetadataTest-1470040385 None] Acquiring lock "cinder-quobyte-040ea8c9-73b2-4542-a0c1-7f91e404f3c7" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:15:42 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-9740e39e-03a9-4377-bce5-8abb1331934b tempest-VolumesMetadataTest-1470040385 None] Lock "cinder-quobyte-040ea8c9-73b2-4542-a0c1-7f91e404f3c7" acquired by "delete_volume" :: waited 0.021s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:15:42 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[b893007a-218c-460c-8980-98d8e1b93c9f]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:15:42 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-9740e39e-03a9-4377-bce5-8abb1331934b tempest-VolumesMetadataTest-1470040385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-040ea8c9-73b2-4542-a0c1-7f91e404f3c7 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:15:42 devstack sudo[93533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-040ea8c9-73b2-4542-a0c1-7f91e404f3c7 Aug 29 01:15:42 devstack sudo[93533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:15:43 devstack sudo[93533]: pam_unix(sudo:session): session closed for user root Aug 29 01:15:43 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-9740e39e-03a9-4377-bce5-8abb1331934b tempest-VolumesMetadataTest-1470040385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-040ea8c9-73b2-4542-a0c1-7f91e404f3c7" returned: 0 in 0.625s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:15:43 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-9740e39e-03a9-4377-bce5-8abb1331934b tempest-VolumesMetadataTest-1470040385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-040ea8c9-73b2-4542-a0c1-7f91e404f3c7 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:15:43 devstack sudo[93541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-040ea8c9-73b2-4542-a0c1-7f91e404f3c7 Aug 29 01:15:43 devstack sudo[93541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:15:43 devstack sudo[93541]: pam_unix(sudo:session): session closed for user root Aug 29 01:15:43 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-9740e39e-03a9-4377-bce5-8abb1331934b tempest-VolumesMetadataTest-1470040385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-040ea8c9-73b2-4542-a0c1-7f91e404f3c7" returned: 0 in 0.283s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:15:43 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-9740e39e-03a9-4377-bce5-8abb1331934b tempest-VolumesMetadataTest-1470040385 None] Lock "cinder-quobyte-040ea8c9-73b2-4542-a0c1-7f91e404f3c7" released by "delete_volume" :: held 0.972s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:15:43 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-9740e39e-03a9-4377-bce5-8abb1331934b tempest-VolumesMetadataTest-1470040385 None] Created reservations ['a55792a0-6ec6-4f8e-bc9f-c944c1a71efe', 'c1fdcd4a-ea1c-43f2-b4ed-9ad04aa930d9', 'c480efcd-bea5-4c46-bf28-a5de14e6dcf6', 'c6860070-cde0-4c2d-828f-8665033f3157'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:15:43 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-9740e39e-03a9-4377-bce5-8abb1331934b tempest-VolumesMetadataTest-1470040385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:15:43 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-9740e39e-03a9-4377-bce5-8abb1331934b tempest-VolumesMetadataTest-1470040385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:15:43 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-9740e39e-03a9-4377-bce5-8abb1331934b tempest-VolumesMetadataTest-1470040385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:15:43 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-9740e39e-03a9-4377-bce5-8abb1331934b tempest-VolumesMetadataTest-1470040385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:15:43 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-9740e39e-03a9-4377-bce5-8abb1331934b tempest-VolumesMetadataTest-1470040385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:15:43 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-9740e39e-03a9-4377-bce5-8abb1331934b tempest-VolumesMetadataTest-1470040385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:15:43 devstack sudo[93550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:15:43 devstack sudo[93550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:15:43 devstack sudo[93550]: pam_unix(sudo:session): session closed for user root Aug 29 01:15:43 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-9740e39e-03a9-4377-bce5-8abb1331934b tempest-VolumesMetadataTest-1470040385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.307s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:15:43 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-9740e39e-03a9-4377-bce5-8abb1331934b tempest-VolumesMetadataTest-1470040385 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:15:43 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-9740e39e-03a9-4377-bce5-8abb1331934b tempest-VolumesMetadataTest-1470040385 None] Deleted volume successfully. Aug 29 01:15:43 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-9740e39e-03a9-4377-bce5-8abb1331934b tempest-VolumesMetadataTest-1470040385 None] Lock "cinder-040ea8c9-73b2-4542-a0c1-7f91e404f3c7-delete_volume" released by "delete_volume" :: held 1.626s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:15:46 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7787113-0eb1-41db-8969-c593d478fa76 tempest-VolumesDeleteCascade-1603786445 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:15:46 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-e7787113-0eb1-41db-8969-c593d478fa76 tempest-VolumesDeleteCascade-1603786445 None] Flow 'volume_create_manager' (9e51dea3-a2cd-4ad4-a7d1-4518e6a39b7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:15:46 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-e7787113-0eb1-41db-8969-c593d478fa76 tempest-VolumesDeleteCascade-1603786445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4595869-e2aa-4e38-88bd-ba6fb02cf705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:15:46 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-e7787113-0eb1-41db-8969-c593d478fa76 tempest-VolumesDeleteCascade-1603786445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4595869-e2aa-4e38-88bd-ba6fb02cf705) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:15:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-310440125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37a29606-d8fa-4ce0-8dce-df5db7016dcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c0c23720a924389954271f3745c49e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:15:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:15:47Z,use_quota=True,user_id='8a3e23ffec7f480cb629a6d83e7d42ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:15:46 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-e7787113-0eb1-41db-8969-c593d478fa76 tempest-VolumesDeleteCascade-1603786445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e689c45a-5e17-4ab4-bd73-23c29a3ab939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:15:46 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-e7787113-0eb1-41db-8969-c593d478fa76 tempest-VolumesDeleteCascade-1603786445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e689c45a-5e17-4ab4-bd73-23c29a3ab939) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:15:46 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-e7787113-0eb1-41db-8969-c593d478fa76 tempest-VolumesDeleteCascade-1603786445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90ec0a60-4628-40eb-b22a-c17e09672ba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:15:46 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-e7787113-0eb1-41db-8969-c593d478fa76 tempest-VolumesDeleteCascade-1603786445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90ec0a60-4628-40eb-b22a-c17e09672ba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37a29606-d8fa-4ce0-8dce-df5db7016dcc', 'volume_name': 'volume-37a29606-d8fa-4ce0-8dce-df5db7016dcc', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:15:46 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-e7787113-0eb1-41db-8969-c593d478fa76 tempest-VolumesDeleteCascade-1603786445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f72fdeb-0bbb-4666-9929-a0f65f15b5cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:15:46 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-e7787113-0eb1-41db-8969-c593d478fa76 tempest-VolumesDeleteCascade-1603786445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f72fdeb-0bbb-4666-9929-a0f65f15b5cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:15:46 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-e7787113-0eb1-41db-8969-c593d478fa76 tempest-VolumesDeleteCascade-1603786445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (755ae387-92f5-4e1e-b63b-aaf5e074f524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:15:46 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-e7787113-0eb1-41db-8969-c593d478fa76 tempest-VolumesDeleteCascade-1603786445 None] Volume 37a29606-d8fa-4ce0-8dce-df5db7016dcc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37a29606-d8fa-4ce0-8dce-df5db7016dcc', 'volume_size': 1} Aug 29 01:15:46 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-e7787113-0eb1-41db-8969-c593d478fa76 tempest-VolumesDeleteCascade-1603786445 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:15:46 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-e7787113-0eb1-41db-8969-c593d478fa76 tempest-VolumesDeleteCascade-1603786445 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:15:46 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-e7787113-0eb1-41db-8969-c593d478fa76 tempest-VolumesDeleteCascade-1603786445 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:15:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-310440125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37a29606-d8fa-4ce0-8dce-df5db7016dcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c0c23720a924389954271f3745c49e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:15:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:15:47Z,use_quota=True,user_id='8a3e23ffec7f480cb629a6d83e7d42ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:15:46 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-e7787113-0eb1-41db-8969-c593d478fa76 tempest-VolumesDeleteCascade-1603786445 None] Creating volume 37a29606-d8fa-4ce0-8dce-df5db7016dcc {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:15:46 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-e7787113-0eb1-41db-8969-c593d478fa76 tempest-VolumesDeleteCascade-1603786445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:15:46 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-e7787113-0eb1-41db-8969-c593d478fa76 tempest-VolumesDeleteCascade-1603786445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:15:46 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-e7787113-0eb1-41db-8969-c593d478fa76 tempest-VolumesDeleteCascade-1603786445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:15:46 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-e7787113-0eb1-41db-8969-c593d478fa76 tempest-VolumesDeleteCascade-1603786445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:15:46 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-e7787113-0eb1-41db-8969-c593d478fa76 tempest-VolumesDeleteCascade-1603786445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:15:46 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-e7787113-0eb1-41db-8969-c593d478fa76 tempest-VolumesDeleteCascade-1603786445 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:15:46 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-e7787113-0eb1-41db-8969-c593d478fa76 tempest-VolumesDeleteCascade-1603786445 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:15:46 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-e7787113-0eb1-41db-8969-c593d478fa76 tempest-VolumesDeleteCascade-1603786445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-37a29606-d8fa-4ce0-8dce-df5db7016dcc 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:15:47 devstack sudo[93559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-37a29606-d8fa-4ce0-8dce-df5db7016dcc 1073741824 Aug 29 01:15:47 devstack sudo[93559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:15:47 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-6204c022-feac-42da-a70d-d7e3556320bb tempest-AttachVolumeTestJSON-257506515 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:15:47 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6204c022-feac-42da-a70d-d7e3556320bb tempest-AttachVolumeTestJSON-257506515 None] Flow 'volume_create_manager' (1648471b-ad9f-4d3b-bf39-0b966aa0b159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:15:47 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6204c022-feac-42da-a70d-d7e3556320bb tempest-AttachVolumeTestJSON-257506515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6d107b2-bea1-41e2-8721-6ccf1a481c74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:15:47 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6204c022-feac-42da-a70d-d7e3556320bb tempest-AttachVolumeTestJSON-257506515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6d107b2-bea1-41e2-8721-6ccf1a481c74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:15:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-626253818',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e649915-8e98-4734-8957-0e2d2d4351c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1deedd35ed26432a9fe2138a14f3709d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:15:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:15:47Z,use_quota=True,user_id='929bae8a458349cc97fe1423a5c7481a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:15:47 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6204c022-feac-42da-a70d-d7e3556320bb tempest-AttachVolumeTestJSON-257506515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52bb2a34-7708-4e6c-9c0a-ea07330bb9f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:15:47 devstack sudo[93559]: pam_unix(sudo:session): session closed for user root Aug 29 01:15:47 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6204c022-feac-42da-a70d-d7e3556320bb tempest-AttachVolumeTestJSON-257506515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52bb2a34-7708-4e6c-9c0a-ea07330bb9f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:15:47 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6204c022-feac-42da-a70d-d7e3556320bb tempest-AttachVolumeTestJSON-257506515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f9bf11b-d47b-464e-a2fb-75dcb07d2c81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:15:47 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6204c022-feac-42da-a70d-d7e3556320bb tempest-AttachVolumeTestJSON-257506515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f9bf11b-d47b-464e-a2fb-75dcb07d2c81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e649915-8e98-4734-8957-0e2d2d4351c8', 'volume_name': 'volume-0e649915-8e98-4734-8957-0e2d2d4351c8', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:15:47 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6204c022-feac-42da-a70d-d7e3556320bb tempest-AttachVolumeTestJSON-257506515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (905e6ec0-76f8-4ef8-ae48-7f307219c2ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:15:47 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6204c022-feac-42da-a70d-d7e3556320bb tempest-AttachVolumeTestJSON-257506515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (905e6ec0-76f8-4ef8-ae48-7f307219c2ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:15:47 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6204c022-feac-42da-a70d-d7e3556320bb tempest-AttachVolumeTestJSON-257506515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c3668c0-d701-48a7-83c0-b37f7e8cb8b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:15:47 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-6204c022-feac-42da-a70d-d7e3556320bb tempest-AttachVolumeTestJSON-257506515 None] Volume 0e649915-8e98-4734-8957-0e2d2d4351c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e649915-8e98-4734-8957-0e2d2d4351c8', 'volume_size': 1} Aug 29 01:15:47 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-6204c022-feac-42da-a70d-d7e3556320bb tempest-AttachVolumeTestJSON-257506515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:15:47 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-e7787113-0eb1-41db-8969-c593d478fa76 tempest-VolumesDeleteCascade-1603786445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-37a29606-d8fa-4ce0-8dce-df5db7016dcc 1073741824" returned: 0 in 0.784s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:15:47 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-e7787113-0eb1-41db-8969-c593d478fa76 tempest-VolumesDeleteCascade-1603786445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-37a29606-d8fa-4ce0-8dce-df5db7016dcc {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:15:47 devstack sudo[93565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-37a29606-d8fa-4ce0-8dce-df5db7016dcc Aug 29 01:15:47 devstack sudo[93565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:15:48 devstack sudo[93565]: pam_unix(sudo:session): session closed for user root Aug 29 01:15:48 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-e7787113-0eb1-41db-8969-c593d478fa76 tempest-VolumesDeleteCascade-1603786445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-37a29606-d8fa-4ce0-8dce-df5db7016dcc" returned: 0 in 0.285s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:15:48 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-e7787113-0eb1-41db-8969-c593d478fa76 tempest-VolumesDeleteCascade-1603786445 None] <== create_volume: return (1135ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:15:48 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-e7787113-0eb1-41db-8969-c593d478fa76 tempest-VolumesDeleteCascade-1603786445 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.139s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:15:48 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-6204c022-feac-42da-a70d-d7e3556320bb tempest-AttachVolumeTestJSON-257506515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.356s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:15:48 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-6204c022-feac-42da-a70d-d7e3556320bb tempest-AttachVolumeTestJSON-257506515 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:15:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-626253818',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e649915-8e98-4734-8957-0e2d2d4351c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1deedd35ed26432a9fe2138a14f3709d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:15:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:15:47Z,use_quota=True,user_id='929bae8a458349cc97fe1423a5c7481a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:15:48 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-6204c022-feac-42da-a70d-d7e3556320bb tempest-AttachVolumeTestJSON-257506515 None] Creating volume 0e649915-8e98-4734-8957-0e2d2d4351c8 {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:15:48 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-6204c022-feac-42da-a70d-d7e3556320bb tempest-AttachVolumeTestJSON-257506515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:15:48 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-6204c022-feac-42da-a70d-d7e3556320bb tempest-AttachVolumeTestJSON-257506515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:15:48 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-6204c022-feac-42da-a70d-d7e3556320bb tempest-AttachVolumeTestJSON-257506515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:15:48 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-6204c022-feac-42da-a70d-d7e3556320bb tempest-AttachVolumeTestJSON-257506515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:15:48 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-6204c022-feac-42da-a70d-d7e3556320bb tempest-AttachVolumeTestJSON-257506515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:15:48 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-6204c022-feac-42da-a70d-d7e3556320bb tempest-AttachVolumeTestJSON-257506515 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:15:48 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-6204c022-feac-42da-a70d-d7e3556320bb tempest-AttachVolumeTestJSON-257506515 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:15:48 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-6204c022-feac-42da-a70d-d7e3556320bb tempest-AttachVolumeTestJSON-257506515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-0e649915-8e98-4734-8957-0e2d2d4351c8 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:15:48 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-e7787113-0eb1-41db-8969-c593d478fa76 tempest-VolumesDeleteCascade-1603786445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (755ae387-92f5-4e1e-b63b-aaf5e074f524) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37a29606-d8fa-4ce0-8dce-df5db7016dcc', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:15:48 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-e7787113-0eb1-41db-8969-c593d478fa76 tempest-VolumesDeleteCascade-1603786445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55b16475-349d-49e8-8ad2-fe9bcdb8dd65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:15:48 devstack sudo[93568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-0e649915-8e98-4734-8957-0e2d2d4351c8 1073741824 Aug 29 01:15:48 devstack sudo[93568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:15:48 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-e7787113-0eb1-41db-8969-c593d478fa76 tempest-VolumesDeleteCascade-1603786445 None] Volume volume-37a29606-d8fa-4ce0-8dce-df5db7016dcc (37a29606-d8fa-4ce0-8dce-df5db7016dcc): created successfully Aug 29 01:15:48 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-e7787113-0eb1-41db-8969-c593d478fa76 tempest-VolumesDeleteCascade-1603786445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55b16475-349d-49e8-8ad2-fe9bcdb8dd65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:15:48 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-e7787113-0eb1-41db-8969-c593d478fa76 tempest-VolumesDeleteCascade-1603786445 None] Flow 'volume_create_manager' (9e51dea3-a2cd-4ad4-a7d1-4518e6a39b7c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:15:48 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-e7787113-0eb1-41db-8969-c593d478fa76 tempest-VolumesDeleteCascade-1603786445 None] Created volume successfully. Aug 29 01:15:48 devstack sudo[93568]: pam_unix(sudo:session): session closed for user root Aug 29 01:15:48 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-6204c022-feac-42da-a70d-d7e3556320bb tempest-AttachVolumeTestJSON-257506515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-0e649915-8e98-4734-8957-0e2d2d4351c8 1073741824" returned: 0 in 0.591s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:15:48 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-6204c022-feac-42da-a70d-d7e3556320bb tempest-AttachVolumeTestJSON-257506515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-0e649915-8e98-4734-8957-0e2d2d4351c8 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:15:48 devstack sudo[93575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-0e649915-8e98-4734-8957-0e2d2d4351c8 Aug 29 01:15:48 devstack sudo[93575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:15:49 devstack sudo[93575]: pam_unix(sudo:session): session closed for user root Aug 29 01:15:49 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-6204c022-feac-42da-a70d-d7e3556320bb tempest-AttachVolumeTestJSON-257506515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-0e649915-8e98-4734-8957-0e2d2d4351c8" returned: 0 in 0.409s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:15:49 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-6204c022-feac-42da-a70d-d7e3556320bb tempest-AttachVolumeTestJSON-257506515 None] <== create_volume: return (1069ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:15:49 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-6204c022-feac-42da-a70d-d7e3556320bb tempest-AttachVolumeTestJSON-257506515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.073s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:15:49 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6204c022-feac-42da-a70d-d7e3556320bb tempest-AttachVolumeTestJSON-257506515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c3668c0-d701-48a7-83c0-b37f7e8cb8b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e649915-8e98-4734-8957-0e2d2d4351c8', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:15:49 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6204c022-feac-42da-a70d-d7e3556320bb tempest-AttachVolumeTestJSON-257506515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (056e66d5-a017-434d-8703-11f3b2d3be71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:15:49 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-6204c022-feac-42da-a70d-d7e3556320bb tempest-AttachVolumeTestJSON-257506515 None] Volume volume-0e649915-8e98-4734-8957-0e2d2d4351c8 (0e649915-8e98-4734-8957-0e2d2d4351c8): created successfully Aug 29 01:15:49 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6204c022-feac-42da-a70d-d7e3556320bb tempest-AttachVolumeTestJSON-257506515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (056e66d5-a017-434d-8703-11f3b2d3be71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:15:49 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6204c022-feac-42da-a70d-d7e3556320bb tempest-AttachVolumeTestJSON-257506515 None] Flow 'volume_create_manager' (1648471b-ad9f-4d3b-bf39-0b966aa0b159) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:15:49 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-6204c022-feac-42da-a70d-d7e3556320bb tempest-AttachVolumeTestJSON-257506515 None] Created volume successfully. Aug 29 01:15:49 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-1427c708-4f13-4e30-b0b2-677065560d3c tempest-VolumesDeleteCascade-1603786445 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:15:49 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-1427c708-4f13-4e30-b0b2-677065560d3c tempest-VolumesDeleteCascade-1603786445 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:15:49 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-1427c708-4f13-4e30-b0b2-677065560d3c tempest-VolumesDeleteCascade-1603786445 None] Creating offline snapshot d08de025-9fee-47d7-a5cb-07394ec8ace2 of volume 37a29606-d8fa-4ce0-8dce-df5db7016dcc {{(pid=86111) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 29 01:15:49 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[adf12873-9caf-4771-8dd1-07521ee8e778]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:15:49 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-1427c708-4f13-4e30-b0b2-677065560d3c tempest-VolumesDeleteCascade-1603786445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-37a29606-d8fa-4ce0-8dce-df5db7016dcc {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:15:49 devstack sudo[93578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-37a29606-d8fa-4ce0-8dce-df5db7016dcc Aug 29 01:15:49 devstack sudo[93578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:15:49 devstack sudo[93578]: pam_unix(sudo:session): session closed for user root Aug 29 01:15:49 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-1427c708-4f13-4e30-b0b2-677065560d3c tempest-VolumesDeleteCascade-1603786445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-37a29606-d8fa-4ce0-8dce-df5db7016dcc" returned: 0 in 0.496s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:15:49 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-1427c708-4f13-4e30-b0b2-677065560d3c tempest-VolumesDeleteCascade-1603786445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-37a29606-d8fa-4ce0-8dce-df5db7016dcc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-37a29606-d8fa-4ce0-8dce-df5db7016dcc.d08de025-9fee-47d7-a5cb-07394ec8ace2 1G {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:15:49 devstack sudo[93596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-37a29606-d8fa-4ce0-8dce-df5db7016dcc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-37a29606-d8fa-4ce0-8dce-df5db7016dcc.d08de025-9fee-47d7-a5cb-07394ec8ace2 1G Aug 29 01:15:49 devstack sudo[93596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:15:50 devstack sudo[93596]: pam_unix(sudo:session): session closed for user root Aug 29 01:15:50 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-1427c708-4f13-4e30-b0b2-677065560d3c tempest-VolumesDeleteCascade-1603786445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-37a29606-d8fa-4ce0-8dce-df5db7016dcc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-37a29606-d8fa-4ce0-8dce-df5db7016dcc.d08de025-9fee-47d7-a5cb-07394ec8ace2 1G" returned: 0 in 0.573s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:15:50 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-1427c708-4f13-4e30-b0b2-677065560d3c tempest-VolumesDeleteCascade-1603786445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37a29606-d8fa-4ce0-8dce-df5db7016dcc -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-37a29606-d8fa-4ce0-8dce-df5db7016dcc.d08de025-9fee-47d7-a5cb-07394ec8ace2 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:15:50 devstack sudo[93616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37a29606-d8fa-4ce0-8dce-df5db7016dcc -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-37a29606-d8fa-4ce0-8dce-df5db7016dcc.d08de025-9fee-47d7-a5cb-07394ec8ace2 Aug 29 01:15:50 devstack sudo[93616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:15:50 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [req-d4d7c426-e60b-45f8-8ee2-45d1d6d11c54 req-7d4fab8f-4f74-446a-87e3-efb1435f872c tempest-AttachVolumeTestJSON-257506515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:15:50 devstack sudo[93616]: pam_unix(sudo:session): session closed for user root Aug 29 01:15:50 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-1427c708-4f13-4e30-b0b2-677065560d3c tempest-VolumesDeleteCascade-1603786445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37a29606-d8fa-4ce0-8dce-df5db7016dcc -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-37a29606-d8fa-4ce0-8dce-df5db7016dcc.d08de025-9fee-47d7-a5cb-07394ec8ace2" returned: 0 in 0.362s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:15:50 devstack cinder-volume[86111]: WARNING cinder.volume.drivers.remotefs [None req-1427c708-4f13-4e30-b0b2-677065560d3c tempest-VolumesDeleteCascade-1603786445 None] /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-37a29606-d8fa-4ce0-8dce-df5db7016dcc.d08de025-9fee-47d7-a5cb-07394ec8ace2 is being set with open permissions: ugo+rw Aug 29 01:15:50 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-1427c708-4f13-4e30-b0b2-677065560d3c tempest-VolumesDeleteCascade-1603786445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-37a29606-d8fa-4ce0-8dce-df5db7016dcc.d08de025-9fee-47d7-a5cb-07394ec8ace2 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:15:50 devstack sudo[93632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-37a29606-d8fa-4ce0-8dce-df5db7016dcc.d08de025-9fee-47d7-a5cb-07394ec8ace2 Aug 29 01:15:50 devstack sudo[93632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:15:51 devstack sudo[93632]: pam_unix(sudo:session): session closed for user root Aug 29 01:15:51 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-1427c708-4f13-4e30-b0b2-677065560d3c tempest-VolumesDeleteCascade-1603786445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-37a29606-d8fa-4ce0-8dce-df5db7016dcc.d08de025-9fee-47d7-a5cb-07394ec8ace2" returned: 0 in 0.316s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:15:51 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-1427c708-4f13-4e30-b0b2-677065560d3c tempest-VolumesDeleteCascade-1603786445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-37a29606-d8fa-4ce0-8dce-df5db7016dcc.info {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:15:51 devstack sudo[93643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-37a29606-d8fa-4ce0-8dce-df5db7016dcc.info Aug 29 01:15:51 devstack sudo[93643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:15:51 devstack sudo[93643]: pam_unix(sudo:session): session closed for user root Aug 29 01:15:51 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-1427c708-4f13-4e30-b0b2-677065560d3c tempest-VolumesDeleteCascade-1603786445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-37a29606-d8fa-4ce0-8dce-df5db7016dcc.info" returned: 0 in 0.314s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:15:51 devstack cinder-volume[86111]: WARNING cinder.volume.drivers.remotefs [None req-1427c708-4f13-4e30-b0b2-677065560d3c tempest-VolumesDeleteCascade-1603786445 None] /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-37a29606-d8fa-4ce0-8dce-df5db7016dcc.info is being set with open permissions: ugo+rw Aug 29 01:15:51 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-1427c708-4f13-4e30-b0b2-677065560d3c tempest-VolumesDeleteCascade-1603786445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-37a29606-d8fa-4ce0-8dce-df5db7016dcc.info {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:15:51 devstack sudo[93646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-37a29606-d8fa-4ce0-8dce-df5db7016dcc.info Aug 29 01:15:51 devstack sudo[93646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:15:51 devstack sudo[93646]: pam_unix(sudo:session): session closed for user root Aug 29 01:15:51 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-1427c708-4f13-4e30-b0b2-677065560d3c tempest-VolumesDeleteCascade-1603786445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-37a29606-d8fa-4ce0-8dce-df5db7016dcc.info" returned: 0 in 0.281s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:15:51 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-1427c708-4f13-4e30-b0b2-677065560d3c tempest-VolumesDeleteCascade-1603786445 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.464s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:15:51 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [req-d4d7c426-e60b-45f8-8ee2-45d1d6d11c54 req-7d4fab8f-4f74-446a-87e3-efb1435f872c tempest-AttachVolumeTestJSON-257506515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.166s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:15:51 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [req-d4d7c426-e60b-45f8-8ee2-45d1d6d11c54 req-7d4fab8f-4f74-446a-87e3-efb1435f872c tempest-AttachVolumeTestJSON-257506515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.041s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:15:51 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-1427c708-4f13-4e30-b0b2-677065560d3c tempest-VolumesDeleteCascade-1603786445 None] Create snapshot completed successfully Aug 29 01:15:51 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [req-d4d7c426-e60b-45f8-8ee2-45d1d6d11c54 req-7d4fab8f-4f74-446a-87e3-efb1435f872c tempest-AttachVolumeTestJSON-257506515 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630', 'name': 'volume-0e649915-8e98-4734-8957-0e2d2d4351c8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5bed75ab-4c41-43ff-bc6d-3e853360362b', 'enforce_multipath': True} {{(pid=86111) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 29 01:15:52 devstack cinder-volume[86111]: INFO cinder.volume.manager [req-d4d7c426-e60b-45f8-8ee2-45d1d6d11c54 req-7d4fab8f-4f74-446a-87e3-efb1435f872c tempest-AttachVolumeTestJSON-257506515 None] attachment_update completed successfully. Aug 29 01:15:52 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-2388a159-e55d-4ce5-86f9-4ec4b1c38486 tempest-VolumesDeleteCascade-1603786445 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:15:52 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-2388a159-e55d-4ce5-86f9-4ec4b1c38486 tempest-VolumesDeleteCascade-1603786445 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:15:52 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-2388a159-e55d-4ce5-86f9-4ec4b1c38486 tempest-VolumesDeleteCascade-1603786445 None] Creating offline snapshot b46d5c4e-6b37-4c08-a58f-a146fa7690f1 of volume 37a29606-d8fa-4ce0-8dce-df5db7016dcc {{(pid=86111) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 29 01:15:53 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad043d4f-e53f-4fd2-a425-15484f0d0c48]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:15:53 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-2388a159-e55d-4ce5-86f9-4ec4b1c38486 tempest-VolumesDeleteCascade-1603786445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-37a29606-d8fa-4ce0-8dce-df5db7016dcc.d08de025-9fee-47d7-a5cb-07394ec8ace2 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:15:53 devstack sudo[94031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-37a29606-d8fa-4ce0-8dce-df5db7016dcc.d08de025-9fee-47d7-a5cb-07394ec8ace2 Aug 29 01:15:53 devstack sudo[94031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:15:53 devstack sudo[94031]: pam_unix(sudo:session): session closed for user root Aug 29 01:15:53 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-2388a159-e55d-4ce5-86f9-4ec4b1c38486 tempest-VolumesDeleteCascade-1603786445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-37a29606-d8fa-4ce0-8dce-df5db7016dcc.d08de025-9fee-47d7-a5cb-07394ec8ace2" returned: 0 in 0.540s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:15:53 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-2388a159-e55d-4ce5-86f9-4ec4b1c38486 tempest-VolumesDeleteCascade-1603786445 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-37a29606-d8fa-4ce0-8dce-df5db7016dcc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 29 01:15:53 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-2388a159-e55d-4ce5-86f9-4ec4b1c38486 tempest-VolumesDeleteCascade-1603786445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-37a29606-d8fa-4ce0-8dce-df5db7016dcc.d08de025-9fee-47d7-a5cb-07394ec8ace2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-37a29606-d8fa-4ce0-8dce-df5db7016dcc.b46d5c4e-6b37-4c08-a58f-a146fa7690f1 1G {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:15:53 devstack sudo[94036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-37a29606-d8fa-4ce0-8dce-df5db7016dcc.d08de025-9fee-47d7-a5cb-07394ec8ace2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-37a29606-d8fa-4ce0-8dce-df5db7016dcc.b46d5c4e-6b37-4c08-a58f-a146fa7690f1 1G Aug 29 01:15:53 devstack sudo[94036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:15:54 devstack sudo[94036]: pam_unix(sudo:session): session closed for user root Aug 29 01:15:54 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-2388a159-e55d-4ce5-86f9-4ec4b1c38486 tempest-VolumesDeleteCascade-1603786445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-37a29606-d8fa-4ce0-8dce-df5db7016dcc.d08de025-9fee-47d7-a5cb-07394ec8ace2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-37a29606-d8fa-4ce0-8dce-df5db7016dcc.b46d5c4e-6b37-4c08-a58f-a146fa7690f1 1G" returned: 0 in 0.980s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:15:54 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-2388a159-e55d-4ce5-86f9-4ec4b1c38486 tempest-VolumesDeleteCascade-1603786445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37a29606-d8fa-4ce0-8dce-df5db7016dcc.d08de025-9fee-47d7-a5cb-07394ec8ace2 -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-37a29606-d8fa-4ce0-8dce-df5db7016dcc.b46d5c4e-6b37-4c08-a58f-a146fa7690f1 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:15:54 devstack sudo[94098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37a29606-d8fa-4ce0-8dce-df5db7016dcc.d08de025-9fee-47d7-a5cb-07394ec8ace2 -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-37a29606-d8fa-4ce0-8dce-df5db7016dcc.b46d5c4e-6b37-4c08-a58f-a146fa7690f1 Aug 29 01:15:54 devstack sudo[94098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:15:55 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-38aeb31d-505c-4bc1-ab3c-b10d5b2f2753 tempest-AttachVolumeTestJSON-257506515 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:15:55 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-38aeb31d-505c-4bc1-ab3c-b10d5b2f2753 tempest-AttachVolumeTestJSON-257506515 None] Flow 'volume_create_manager' (7975165b-f4ee-4c1d-a39a-7428ab774aef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:15:55 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-38aeb31d-505c-4bc1-ab3c-b10d5b2f2753 tempest-AttachVolumeTestJSON-257506515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cad99fe-305c-4f15-a248-128099ab2c23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:15:55 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-38aeb31d-505c-4bc1-ab3c-b10d5b2f2753 tempest-AttachVolumeTestJSON-257506515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cad99fe-305c-4f15-a248-128099ab2c23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:15:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-756691877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1a24d3f-0bcd-4fee-9378-7430efa40f36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1deedd35ed26432a9fe2138a14f3709d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:15:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:15:55Z,use_quota=True,user_id='929bae8a458349cc97fe1423a5c7481a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:15:55 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-38aeb31d-505c-4bc1-ab3c-b10d5b2f2753 tempest-AttachVolumeTestJSON-257506515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8110640b-b3a3-443a-b309-9fce15806cd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:15:55 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-38aeb31d-505c-4bc1-ab3c-b10d5b2f2753 tempest-AttachVolumeTestJSON-257506515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8110640b-b3a3-443a-b309-9fce15806cd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:15:55 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-38aeb31d-505c-4bc1-ab3c-b10d5b2f2753 tempest-AttachVolumeTestJSON-257506515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76caa143-22f5-4a58-bec8-0c9a5702d488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:15:55 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-38aeb31d-505c-4bc1-ab3c-b10d5b2f2753 tempest-AttachVolumeTestJSON-257506515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76caa143-22f5-4a58-bec8-0c9a5702d488) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1a24d3f-0bcd-4fee-9378-7430efa40f36', 'volume_name': 'volume-a1a24d3f-0bcd-4fee-9378-7430efa40f36', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:15:55 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-38aeb31d-505c-4bc1-ab3c-b10d5b2f2753 tempest-AttachVolumeTestJSON-257506515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df57a987-7735-49e7-8f41-ac3e1ed8d53a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:15:55 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-38aeb31d-505c-4bc1-ab3c-b10d5b2f2753 tempest-AttachVolumeTestJSON-257506515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df57a987-7735-49e7-8f41-ac3e1ed8d53a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:15:55 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-38aeb31d-505c-4bc1-ab3c-b10d5b2f2753 tempest-AttachVolumeTestJSON-257506515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c068314-3ceb-4102-b273-dde4d1be9180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:15:55 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-38aeb31d-505c-4bc1-ab3c-b10d5b2f2753 tempest-AttachVolumeTestJSON-257506515 None] Volume a1a24d3f-0bcd-4fee-9378-7430efa40f36: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1a24d3f-0bcd-4fee-9378-7430efa40f36', 'volume_size': 1} Aug 29 01:15:55 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-38aeb31d-505c-4bc1-ab3c-b10d5b2f2753 tempest-AttachVolumeTestJSON-257506515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:15:55 devstack sudo[94098]: pam_unix(sudo:session): session closed for user root Aug 29 01:15:55 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-2388a159-e55d-4ce5-86f9-4ec4b1c38486 tempest-VolumesDeleteCascade-1603786445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37a29606-d8fa-4ce0-8dce-df5db7016dcc.d08de025-9fee-47d7-a5cb-07394ec8ace2 -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-37a29606-d8fa-4ce0-8dce-df5db7016dcc.b46d5c4e-6b37-4c08-a58f-a146fa7690f1" returned: 0 in 0.795s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:15:55 devstack cinder-volume[86111]: WARNING cinder.volume.drivers.remotefs [None req-2388a159-e55d-4ce5-86f9-4ec4b1c38486 tempest-VolumesDeleteCascade-1603786445 None] /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-37a29606-d8fa-4ce0-8dce-df5db7016dcc.b46d5c4e-6b37-4c08-a58f-a146fa7690f1 is being set with open permissions: ugo+rw Aug 29 01:15:55 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-2388a159-e55d-4ce5-86f9-4ec4b1c38486 tempest-VolumesDeleteCascade-1603786445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-37a29606-d8fa-4ce0-8dce-df5db7016dcc.b46d5c4e-6b37-4c08-a58f-a146fa7690f1 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:15:55 devstack sudo[94109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-37a29606-d8fa-4ce0-8dce-df5db7016dcc.b46d5c4e-6b37-4c08-a58f-a146fa7690f1 Aug 29 01:15:55 devstack sudo[94109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:15:55 devstack sudo[94109]: pam_unix(sudo:session): session closed for user root Aug 29 01:15:55 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-2388a159-e55d-4ce5-86f9-4ec4b1c38486 tempest-VolumesDeleteCascade-1603786445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-37a29606-d8fa-4ce0-8dce-df5db7016dcc.b46d5c4e-6b37-4c08-a58f-a146fa7690f1" returned: 0 in 0.351s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:15:55 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-2388a159-e55d-4ce5-86f9-4ec4b1c38486 tempest-VolumesDeleteCascade-1603786445 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.865s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:15:55 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-38aeb31d-505c-4bc1-ab3c-b10d5b2f2753 tempest-AttachVolumeTestJSON-257506515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.588s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:15:55 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-38aeb31d-505c-4bc1-ab3c-b10d5b2f2753 tempest-AttachVolumeTestJSON-257506515 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:15:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-756691877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1a24d3f-0bcd-4fee-9378-7430efa40f36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1deedd35ed26432a9fe2138a14f3709d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:15:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:15:55Z,use_quota=True,user_id='929bae8a458349cc97fe1423a5c7481a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:15:55 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-38aeb31d-505c-4bc1-ab3c-b10d5b2f2753 tempest-AttachVolumeTestJSON-257506515 None] Creating volume a1a24d3f-0bcd-4fee-9378-7430efa40f36 {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:15:55 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-38aeb31d-505c-4bc1-ab3c-b10d5b2f2753 tempest-AttachVolumeTestJSON-257506515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:15:55 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-38aeb31d-505c-4bc1-ab3c-b10d5b2f2753 tempest-AttachVolumeTestJSON-257506515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:15:55 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-38aeb31d-505c-4bc1-ab3c-b10d5b2f2753 tempest-AttachVolumeTestJSON-257506515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:15:55 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-38aeb31d-505c-4bc1-ab3c-b10d5b2f2753 tempest-AttachVolumeTestJSON-257506515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:15:55 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-38aeb31d-505c-4bc1-ab3c-b10d5b2f2753 tempest-AttachVolumeTestJSON-257506515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:15:55 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-38aeb31d-505c-4bc1-ab3c-b10d5b2f2753 tempest-AttachVolumeTestJSON-257506515 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:15:55 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-38aeb31d-505c-4bc1-ab3c-b10d5b2f2753 tempest-AttachVolumeTestJSON-257506515 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:15:55 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-38aeb31d-505c-4bc1-ab3c-b10d5b2f2753 tempest-AttachVolumeTestJSON-257506515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a1a24d3f-0bcd-4fee-9378-7430efa40f36 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:15:55 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-2388a159-e55d-4ce5-86f9-4ec4b1c38486 tempest-VolumesDeleteCascade-1603786445 None] Create snapshot completed successfully Aug 29 01:15:55 devstack sudo[94115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a1a24d3f-0bcd-4fee-9378-7430efa40f36 1073741824 Aug 29 01:15:55 devstack sudo[94115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:15:56 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-c258c8ad-e164-4e55-980b-1d9435b70ed0 tempest-VolumesDeleteCascade-1603786445 None] Acquiring lock "cinder-37a29606-d8fa-4ce0-8dce-df5db7016dcc-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:15:56 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-c258c8ad-e164-4e55-980b-1d9435b70ed0 tempest-VolumesDeleteCascade-1603786445 None] Lock "cinder-37a29606-d8fa-4ce0-8dce-df5db7016dcc-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:15:56 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-c258c8ad-e164-4e55-980b-1d9435b70ed0 tempest-VolumesDeleteCascade-1603786445 None] Performing cascade delete. {{(pid=86111) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Aug 29 01:15:56 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-c258c8ad-e164-4e55-980b-1d9435b70ed0 tempest-VolumesDeleteCascade-1603786445 None] Acquiring lock "cinder-b46d5c4e-6b37-4c08-a58f-a146fa7690f1-delete_snapshot" by "delete_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:15:56 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-c258c8ad-e164-4e55-980b-1d9435b70ed0 tempest-VolumesDeleteCascade-1603786445 None] Lock "cinder-b46d5c4e-6b37-4c08-a58f-a146fa7690f1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:15:56 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-c258c8ad-e164-4e55-980b-1d9435b70ed0 tempest-VolumesDeleteCascade-1603786445 None] Acquiring lock "cinder-quobyte-37a29606-d8fa-4ce0-8dce-df5db7016dcc" by "delete_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:15:56 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-c258c8ad-e164-4e55-980b-1d9435b70ed0 tempest-VolumesDeleteCascade-1603786445 None] Lock "cinder-quobyte-37a29606-d8fa-4ce0-8dce-df5db7016dcc" acquired by "delete_snapshot" :: waited 0.040s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:15:56 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-c258c8ad-e164-4e55-980b-1d9435b70ed0 tempest-VolumesDeleteCascade-1603786445 None] Acquiring lock "cinder-quobyte-b46d5c4e-6b37-4c08-a58f-a146fa7690f1" by "_delete_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:15:56 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-c258c8ad-e164-4e55-980b-1d9435b70ed0 tempest-VolumesDeleteCascade-1603786445 None] Lock "cinder-quobyte-b46d5c4e-6b37-4c08-a58f-a146fa7690f1" acquired by "_delete_snapshot" :: waited 0.046s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:15:56 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-c258c8ad-e164-4e55-980b-1d9435b70ed0 tempest-VolumesDeleteCascade-1603786445 None] Deleting offline snapshot b46d5c4e-6b37-4c08-a58f-a146fa7690f1 of volume 37a29606-d8fa-4ce0-8dce-df5db7016dcc {{(pid=86111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 29 01:15:56 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-c258c8ad-e164-4e55-980b-1d9435b70ed0 tempest-VolumesDeleteCascade-1603786445 None] snapshot_file for this snap is: volume-37a29606-d8fa-4ce0-8dce-df5db7016dcc.b46d5c4e-6b37-4c08-a58f-a146fa7690f1 {{(pid=86111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 29 01:15:56 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[70c2ffe5-8a84-4336-8580-294701ee464e]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:15:56 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c258c8ad-e164-4e55-980b-1d9435b70ed0 tempest-VolumesDeleteCascade-1603786445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-37a29606-d8fa-4ce0-8dce-df5db7016dcc.b46d5c4e-6b37-4c08-a58f-a146fa7690f1 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:15:56 devstack sudo[94115]: pam_unix(sudo:session): session closed for user root Aug 29 01:15:56 devstack sudo[94121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-37a29606-d8fa-4ce0-8dce-df5db7016dcc.b46d5c4e-6b37-4c08-a58f-a146fa7690f1 Aug 29 01:15:56 devstack sudo[94121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:15:56 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-38aeb31d-505c-4bc1-ab3c-b10d5b2f2753 tempest-AttachVolumeTestJSON-257506515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a1a24d3f-0bcd-4fee-9378-7430efa40f36 1073741824" returned: 0 in 1.140s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:15:57 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-38aeb31d-505c-4bc1-ab3c-b10d5b2f2753 tempest-AttachVolumeTestJSON-257506515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a1a24d3f-0bcd-4fee-9378-7430efa40f36 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:15:57 devstack sudo[94123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a1a24d3f-0bcd-4fee-9378-7430efa40f36 Aug 29 01:15:57 devstack sudo[94123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:15:57 devstack sudo[94121]: pam_unix(sudo:session): session closed for user root Aug 29 01:15:57 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c258c8ad-e164-4e55-980b-1d9435b70ed0 tempest-VolumesDeleteCascade-1603786445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-37a29606-d8fa-4ce0-8dce-df5db7016dcc.b46d5c4e-6b37-4c08-a58f-a146fa7690f1" returned: 0 in 0.640s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:15:57 devstack sudo[94123]: pam_unix(sudo:session): session closed for user root Aug 29 01:15:57 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-c258c8ad-e164-4e55-980b-1d9435b70ed0 tempest-VolumesDeleteCascade-1603786445 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-37a29606-d8fa-4ce0-8dce-df5db7016dcc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 29 01:15:57 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-38aeb31d-505c-4bc1-ab3c-b10d5b2f2753 tempest-AttachVolumeTestJSON-257506515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a1a24d3f-0bcd-4fee-9378-7430efa40f36" returned: 0 in 0.405s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:15:57 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-38aeb31d-505c-4bc1-ab3c-b10d5b2f2753 tempest-AttachVolumeTestJSON-257506515 None] <== create_volume: return (1655ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:15:57 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-38aeb31d-505c-4bc1-ab3c-b10d5b2f2753 tempest-AttachVolumeTestJSON-257506515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.662s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:15:57 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d6b2a59-788b-43bc-b5ac-77220ef16579]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:15:57 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c258c8ad-e164-4e55-980b-1d9435b70ed0 tempest-VolumesDeleteCascade-1603786445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-37a29606-d8fa-4ce0-8dce-df5db7016dcc.d08de025-9fee-47d7-a5cb-07394ec8ace2 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:15:57 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-38aeb31d-505c-4bc1-ab3c-b10d5b2f2753 tempest-AttachVolumeTestJSON-257506515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c068314-3ceb-4102-b273-dde4d1be9180) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1a24d3f-0bcd-4fee-9378-7430efa40f36', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:15:57 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-38aeb31d-505c-4bc1-ab3c-b10d5b2f2753 tempest-AttachVolumeTestJSON-257506515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed57ce55-ef2f-4279-966c-7859fddba37f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:15:57 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-38aeb31d-505c-4bc1-ab3c-b10d5b2f2753 tempest-AttachVolumeTestJSON-257506515 None] Volume volume-a1a24d3f-0bcd-4fee-9378-7430efa40f36 (a1a24d3f-0bcd-4fee-9378-7430efa40f36): created successfully Aug 29 01:15:57 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-38aeb31d-505c-4bc1-ab3c-b10d5b2f2753 tempest-AttachVolumeTestJSON-257506515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed57ce55-ef2f-4279-966c-7859fddba37f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:15:57 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-38aeb31d-505c-4bc1-ab3c-b10d5b2f2753 tempest-AttachVolumeTestJSON-257506515 None] Flow 'volume_create_manager' (7975165b-f4ee-4c1d-a39a-7428ab774aef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:15:57 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-38aeb31d-505c-4bc1-ab3c-b10d5b2f2753 tempest-AttachVolumeTestJSON-257506515 None] Created volume successfully. Aug 29 01:15:57 devstack sudo[94129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-37a29606-d8fa-4ce0-8dce-df5db7016dcc.d08de025-9fee-47d7-a5cb-07394ec8ace2 Aug 29 01:15:57 devstack sudo[94129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:15:58 devstack sudo[94129]: pam_unix(sudo:session): session closed for user root Aug 29 01:15:58 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c258c8ad-e164-4e55-980b-1d9435b70ed0 tempest-VolumesDeleteCascade-1603786445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-37a29606-d8fa-4ce0-8dce-df5db7016dcc.d08de025-9fee-47d7-a5cb-07394ec8ace2" returned: 0 in 0.615s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:15:58 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-c258c8ad-e164-4e55-980b-1d9435b70ed0 tempest-VolumesDeleteCascade-1603786445 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-37a29606-d8fa-4ce0-8dce-df5db7016dcc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 29 01:15:58 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c258c8ad-e164-4e55-980b-1d9435b70ed0 tempest-VolumesDeleteCascade-1603786445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-37a29606-d8fa-4ce0-8dce-df5db7016dcc.b46d5c4e-6b37-4c08-a58f-a146fa7690f1 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:15:58 devstack sudo[94135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-37a29606-d8fa-4ce0-8dce-df5db7016dcc.b46d5c4e-6b37-4c08-a58f-a146fa7690f1 Aug 29 01:15:58 devstack sudo[94135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:15:59 devstack sudo[94135]: pam_unix(sudo:session): session closed for user root Aug 29 01:15:59 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c258c8ad-e164-4e55-980b-1d9435b70ed0 tempest-VolumesDeleteCascade-1603786445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-37a29606-d8fa-4ce0-8dce-df5db7016dcc.b46d5c4e-6b37-4c08-a58f-a146fa7690f1" returned: 0 in 0.924s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:15:59 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c258c8ad-e164-4e55-980b-1d9435b70ed0 tempest-VolumesDeleteCascade-1603786445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-37a29606-d8fa-4ce0-8dce-df5db7016dcc.b46d5c4e-6b37-4c08-a58f-a146fa7690f1 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:15:59 devstack sudo[94146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-37a29606-d8fa-4ce0-8dce-df5db7016dcc.b46d5c4e-6b37-4c08-a58f-a146fa7690f1 Aug 29 01:15:59 devstack sudo[94146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:15:59 devstack sudo[94146]: pam_unix(sudo:session): session closed for user root Aug 29 01:15:59 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c258c8ad-e164-4e55-980b-1d9435b70ed0 tempest-VolumesDeleteCascade-1603786445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-37a29606-d8fa-4ce0-8dce-df5db7016dcc.b46d5c4e-6b37-4c08-a58f-a146fa7690f1" returned: 0 in 0.422s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:15:59 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-c258c8ad-e164-4e55-980b-1d9435b70ed0 tempest-VolumesDeleteCascade-1603786445 None] Lock "cinder-quobyte-b46d5c4e-6b37-4c08-a58f-a146fa7690f1" released by "_delete_snapshot" :: held 2.768s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:15:59 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-c258c8ad-e164-4e55-980b-1d9435b70ed0 tempest-VolumesDeleteCascade-1603786445 None] Lock "cinder-quobyte-37a29606-d8fa-4ce0-8dce-df5db7016dcc" released by "delete_snapshot" :: held 2.825s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:15:59 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-c258c8ad-e164-4e55-980b-1d9435b70ed0 tempest-VolumesDeleteCascade-1603786445 None] Created reservations ['c227b251-3c6b-4425-923f-6b5996c66393', 'fb2af7ce-66db-4133-bb1d-0c5713824140', 'acc3856b-51c4-42c8-9b19-fb460f0982d5', '38382e29-caf6-4d46-b16d-4ebec671a468'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:15:59 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [req-e7c0440a-40c3-4539-82fd-0c1b946ee0e2 req-cd6a1d6d-75f3-449b-92fc-bae4a62651f7 tempest-AttachVolumeTestJSON-257506515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:15:59 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [req-e7c0440a-40c3-4539-82fd-0c1b946ee0e2 req-cd6a1d6d-75f3-449b-92fc-bae4a62651f7 tempest-AttachVolumeTestJSON-257506515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:15:59 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [req-e7c0440a-40c3-4539-82fd-0c1b946ee0e2 req-cd6a1d6d-75f3-449b-92fc-bae4a62651f7 tempest-AttachVolumeTestJSON-257506515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:15:59 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [req-e7c0440a-40c3-4539-82fd-0c1b946ee0e2 req-cd6a1d6d-75f3-449b-92fc-bae4a62651f7 tempest-AttachVolumeTestJSON-257506515 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630', 'name': 'volume-a1a24d3f-0bcd-4fee-9378-7430efa40f36', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '956ba713-1bb7-48b1-bace-4bfad3e117d4', 'enforce_multipath': True} {{(pid=86111) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 29 01:15:59 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-c258c8ad-e164-4e55-980b-1d9435b70ed0 tempest-VolumesDeleteCascade-1603786445 None] Delete snapshot completed successfully. Aug 29 01:15:59 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-c258c8ad-e164-4e55-980b-1d9435b70ed0 tempest-VolumesDeleteCascade-1603786445 None] Lock "cinder-b46d5c4e-6b37-4c08-a58f-a146fa7690f1-delete_snapshot" released by "delete_snapshot" :: held 3.315s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:15:59 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-c258c8ad-e164-4e55-980b-1d9435b70ed0 tempest-VolumesDeleteCascade-1603786445 None] Acquiring lock "cinder-d08de025-9fee-47d7-a5cb-07394ec8ace2-delete_snapshot" by "delete_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:15:59 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-c258c8ad-e164-4e55-980b-1d9435b70ed0 tempest-VolumesDeleteCascade-1603786445 None] Lock "cinder-d08de025-9fee-47d7-a5cb-07394ec8ace2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.064s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:16:00 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-c258c8ad-e164-4e55-980b-1d9435b70ed0 tempest-VolumesDeleteCascade-1603786445 None] Acquiring lock "cinder-quobyte-37a29606-d8fa-4ce0-8dce-df5db7016dcc" by "delete_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:16:00 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-c258c8ad-e164-4e55-980b-1d9435b70ed0 tempest-VolumesDeleteCascade-1603786445 None] Lock "cinder-quobyte-37a29606-d8fa-4ce0-8dce-df5db7016dcc" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:16:00 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-c258c8ad-e164-4e55-980b-1d9435b70ed0 tempest-VolumesDeleteCascade-1603786445 None] Acquiring lock "cinder-quobyte-d08de025-9fee-47d7-a5cb-07394ec8ace2" by "_delete_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:16:00 devstack cinder-volume[86111]: INFO cinder.volume.manager [req-e7c0440a-40c3-4539-82fd-0c1b946ee0e2 req-cd6a1d6d-75f3-449b-92fc-bae4a62651f7 tempest-AttachVolumeTestJSON-257506515 None] attachment_update completed successfully. Aug 29 01:16:00 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-c258c8ad-e164-4e55-980b-1d9435b70ed0 tempest-VolumesDeleteCascade-1603786445 None] Lock "cinder-quobyte-d08de025-9fee-47d7-a5cb-07394ec8ace2" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:16:00 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-c258c8ad-e164-4e55-980b-1d9435b70ed0 tempest-VolumesDeleteCascade-1603786445 None] Deleting offline snapshot d08de025-9fee-47d7-a5cb-07394ec8ace2 of volume 37a29606-d8fa-4ce0-8dce-df5db7016dcc {{(pid=86111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 29 01:16:00 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-c258c8ad-e164-4e55-980b-1d9435b70ed0 tempest-VolumesDeleteCascade-1603786445 None] snapshot_file for this snap is: volume-37a29606-d8fa-4ce0-8dce-df5db7016dcc.d08de025-9fee-47d7-a5cb-07394ec8ace2 {{(pid=86111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 29 01:16:00 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4529bd3-85cc-481f-86d9-2deeda751497]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:16:00 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c258c8ad-e164-4e55-980b-1d9435b70ed0 tempest-VolumesDeleteCascade-1603786445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-37a29606-d8fa-4ce0-8dce-df5db7016dcc.d08de025-9fee-47d7-a5cb-07394ec8ace2 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:16:00 devstack sudo[94157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-37a29606-d8fa-4ce0-8dce-df5db7016dcc.d08de025-9fee-47d7-a5cb-07394ec8ace2 Aug 29 01:16:00 devstack sudo[94157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:16:00 devstack sudo[94157]: pam_unix(sudo:session): session closed for user root Aug 29 01:16:00 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c258c8ad-e164-4e55-980b-1d9435b70ed0 tempest-VolumesDeleteCascade-1603786445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-37a29606-d8fa-4ce0-8dce-df5db7016dcc.d08de025-9fee-47d7-a5cb-07394ec8ace2" returned: 0 in 0.674s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:16:00 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-c258c8ad-e164-4e55-980b-1d9435b70ed0 tempest-VolumesDeleteCascade-1603786445 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-37a29606-d8fa-4ce0-8dce-df5db7016dcc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 29 01:16:00 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cdd9047-b9eb-441d-8f33-14222b0cc90e]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:16:00 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c258c8ad-e164-4e55-980b-1d9435b70ed0 tempest-VolumesDeleteCascade-1603786445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-37a29606-d8fa-4ce0-8dce-df5db7016dcc {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:16:01 devstack sudo[94164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-37a29606-d8fa-4ce0-8dce-df5db7016dcc Aug 29 01:16:01 devstack sudo[94164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:16:01 devstack sudo[94164]: pam_unix(sudo:session): session closed for user root Aug 29 01:16:01 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c258c8ad-e164-4e55-980b-1d9435b70ed0 tempest-VolumesDeleteCascade-1603786445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-37a29606-d8fa-4ce0-8dce-df5db7016dcc" returned: 0 in 0.601s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:16:01 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c258c8ad-e164-4e55-980b-1d9435b70ed0 tempest-VolumesDeleteCascade-1603786445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-37a29606-d8fa-4ce0-8dce-df5db7016dcc.d08de025-9fee-47d7-a5cb-07394ec8ace2 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:16:01 devstack sudo[94170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-37a29606-d8fa-4ce0-8dce-df5db7016dcc.d08de025-9fee-47d7-a5cb-07394ec8ace2 Aug 29 01:16:01 devstack sudo[94170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:16:02 devstack sudo[94170]: pam_unix(sudo:session): session closed for user root Aug 29 01:16:02 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c258c8ad-e164-4e55-980b-1d9435b70ed0 tempest-VolumesDeleteCascade-1603786445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-37a29606-d8fa-4ce0-8dce-df5db7016dcc.d08de025-9fee-47d7-a5cb-07394ec8ace2" returned: 0 in 0.557s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:16:02 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c258c8ad-e164-4e55-980b-1d9435b70ed0 tempest-VolumesDeleteCascade-1603786445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-37a29606-d8fa-4ce0-8dce-df5db7016dcc.d08de025-9fee-47d7-a5cb-07394ec8ace2 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:16:02 devstack sudo[94177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-37a29606-d8fa-4ce0-8dce-df5db7016dcc.d08de025-9fee-47d7-a5cb-07394ec8ace2 Aug 29 01:16:02 devstack sudo[94177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:16:02 devstack sudo[94177]: pam_unix(sudo:session): session closed for user root Aug 29 01:16:02 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c258c8ad-e164-4e55-980b-1d9435b70ed0 tempest-VolumesDeleteCascade-1603786445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-37a29606-d8fa-4ce0-8dce-df5db7016dcc.d08de025-9fee-47d7-a5cb-07394ec8ace2" returned: 0 in 0.428s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:16:02 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-c258c8ad-e164-4e55-980b-1d9435b70ed0 tempest-VolumesDeleteCascade-1603786445 None] Lock "cinder-quobyte-d08de025-9fee-47d7-a5cb-07394ec8ace2" released by "_delete_snapshot" :: held 2.490s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:16:02 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-c258c8ad-e164-4e55-980b-1d9435b70ed0 tempest-VolumesDeleteCascade-1603786445 None] Lock "cinder-quobyte-37a29606-d8fa-4ce0-8dce-df5db7016dcc" released by "delete_snapshot" :: held 2.543s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:16:02 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf7115c1-45cb-4aa6-a66f-2e7f59dadef6 tempest-VolumesActionsTest-258600632 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:16:02 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-bf7115c1-45cb-4aa6-a66f-2e7f59dadef6 tempest-VolumesActionsTest-258600632 None] Flow 'volume_create_manager' (0049865f-ae79-4358-a1b5-f3154d24e705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:16:02 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-bf7115c1-45cb-4aa6-a66f-2e7f59dadef6 tempest-VolumesActionsTest-258600632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa042d10-ca39-42c2-98fa-1d0b386830ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:16:02 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-bf7115c1-45cb-4aa6-a66f-2e7f59dadef6 tempest-VolumesActionsTest-258600632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa042d10-ca39-42c2-98fa-1d0b386830ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:16:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1449380200',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=228ce9ce-1f9a-4453-971c-8dc58400f0ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='012f60cfe5574bce93aa90c4ef7ee3eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:16:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:16:03Z,use_quota=True,user_id='2371f9a4287046278abadbe6a0164cf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:16:02 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-bf7115c1-45cb-4aa6-a66f-2e7f59dadef6 tempest-VolumesActionsTest-258600632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48412986-42ba-408b-b841-99c5d8de1b47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:16:02 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-bf7115c1-45cb-4aa6-a66f-2e7f59dadef6 tempest-VolumesActionsTest-258600632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48412986-42ba-408b-b841-99c5d8de1b47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:16:02 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-bf7115c1-45cb-4aa6-a66f-2e7f59dadef6 tempest-VolumesActionsTest-258600632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (554b4bf2-926a-44ea-a2c5-06514c4c21bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:16:02 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-bf7115c1-45cb-4aa6-a66f-2e7f59dadef6 tempest-VolumesActionsTest-258600632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (554b4bf2-926a-44ea-a2c5-06514c4c21bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '228ce9ce-1f9a-4453-971c-8dc58400f0ec', 'volume_name': 'volume-228ce9ce-1f9a-4453-971c-8dc58400f0ec', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:16:02 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-bf7115c1-45cb-4aa6-a66f-2e7f59dadef6 tempest-VolumesActionsTest-258600632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (770b64be-7dea-4312-a3b5-c01e2833093e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:16:02 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-bf7115c1-45cb-4aa6-a66f-2e7f59dadef6 tempest-VolumesActionsTest-258600632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (770b64be-7dea-4312-a3b5-c01e2833093e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:16:02 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-bf7115c1-45cb-4aa6-a66f-2e7f59dadef6 tempest-VolumesActionsTest-258600632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef5df790-2e4e-45e2-8fe1-85d5a1406760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:16:02 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-bf7115c1-45cb-4aa6-a66f-2e7f59dadef6 tempest-VolumesActionsTest-258600632 None] Volume 228ce9ce-1f9a-4453-971c-8dc58400f0ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-228ce9ce-1f9a-4453-971c-8dc58400f0ec', 'volume_size': 1} Aug 29 01:16:02 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-bf7115c1-45cb-4aa6-a66f-2e7f59dadef6 tempest-VolumesActionsTest-258600632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:16:02 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-bf7115c1-45cb-4aa6-a66f-2e7f59dadef6 tempest-VolumesActionsTest-258600632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:16:02 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-bf7115c1-45cb-4aa6-a66f-2e7f59dadef6 tempest-VolumesActionsTest-258600632 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:16:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1449380200',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=228ce9ce-1f9a-4453-971c-8dc58400f0ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='012f60cfe5574bce93aa90c4ef7ee3eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:16:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:16:03Z,use_quota=True,user_id='2371f9a4287046278abadbe6a0164cf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:16:02 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-bf7115c1-45cb-4aa6-a66f-2e7f59dadef6 tempest-VolumesActionsTest-258600632 None] Creating volume 228ce9ce-1f9a-4453-971c-8dc58400f0ec {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:16:02 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-bf7115c1-45cb-4aa6-a66f-2e7f59dadef6 tempest-VolumesActionsTest-258600632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:16:02 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-bf7115c1-45cb-4aa6-a66f-2e7f59dadef6 tempest-VolumesActionsTest-258600632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:16:02 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-bf7115c1-45cb-4aa6-a66f-2e7f59dadef6 tempest-VolumesActionsTest-258600632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:16:02 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-bf7115c1-45cb-4aa6-a66f-2e7f59dadef6 tempest-VolumesActionsTest-258600632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:16:02 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-bf7115c1-45cb-4aa6-a66f-2e7f59dadef6 tempest-VolumesActionsTest-258600632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:16:02 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-bf7115c1-45cb-4aa6-a66f-2e7f59dadef6 tempest-VolumesActionsTest-258600632 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:16:02 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-bf7115c1-45cb-4aa6-a66f-2e7f59dadef6 tempest-VolumesActionsTest-258600632 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:16:02 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-bf7115c1-45cb-4aa6-a66f-2e7f59dadef6 tempest-VolumesActionsTest-258600632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-228ce9ce-1f9a-4453-971c-8dc58400f0ec 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:16:02 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-c258c8ad-e164-4e55-980b-1d9435b70ed0 tempest-VolumesDeleteCascade-1603786445 None] Created reservations ['71591ab1-56a1-4634-af52-07178349a386', '77c40443-f822-4ef7-8d85-97705a981a36', '6419cfab-c8e7-439d-a8d3-f99f8206e5ab', '2222fb78-3c12-4342-97cb-d484fd66fc01'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:16:02 devstack sudo[94181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-228ce9ce-1f9a-4453-971c-8dc58400f0ec 1073741824 Aug 29 01:16:02 devstack sudo[94181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:16:03 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-c258c8ad-e164-4e55-980b-1d9435b70ed0 tempest-VolumesDeleteCascade-1603786445 None] Delete snapshot completed successfully. Aug 29 01:16:03 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-c258c8ad-e164-4e55-980b-1d9435b70ed0 tempest-VolumesDeleteCascade-1603786445 None] Lock "cinder-d08de025-9fee-47d7-a5cb-07394ec8ace2-delete_snapshot" released by "delete_snapshot" :: held 3.020s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:16:03 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-c258c8ad-e164-4e55-980b-1d9435b70ed0 tempest-VolumesDeleteCascade-1603786445 None] Snapshots deleted, issuing volume delete {{(pid=86111) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Aug 29 01:16:03 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-c258c8ad-e164-4e55-980b-1d9435b70ed0 tempest-VolumesDeleteCascade-1603786445 None] Acquiring lock "cinder-quobyte-37a29606-d8fa-4ce0-8dce-df5db7016dcc" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:16:03 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-c258c8ad-e164-4e55-980b-1d9435b70ed0 tempest-VolumesDeleteCascade-1603786445 None] Lock "cinder-quobyte-37a29606-d8fa-4ce0-8dce-df5db7016dcc" acquired by "delete_volume" :: waited 0.023s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:16:03 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbbb715b-7993-4dff-92ab-e8ea934016e6]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:16:03 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c258c8ad-e164-4e55-980b-1d9435b70ed0 tempest-VolumesDeleteCascade-1603786445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-37a29606-d8fa-4ce0-8dce-df5db7016dcc {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:16:03 devstack cinder-volume[86111]: INFO cinder.volume.manager [req-e5ca7108-718d-4fd9-acaf-0c1e97fd54dd req-2a567a3c-26f0-48ad-a657-017029cea5d2 tempest-AttachVolumeTestJSON-257506515 None] Terminate volume connection completed successfully. Aug 29 01:16:03 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [req-e5ca7108-718d-4fd9-acaf-0c1e97fd54dd req-2a567a3c-26f0-48ad-a657-017029cea5d2 tempest-AttachVolumeTestJSON-257506515 None] Deleting attachment 5bed75ab-4c41-43ff-bc6d-3e853360362b. {{(pid=86111) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 29 01:16:03 devstack sudo[94186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-37a29606-d8fa-4ce0-8dce-df5db7016dcc Aug 29 01:16:03 devstack sudo[94186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:16:03 devstack sudo[94181]: pam_unix(sudo:session): session closed for user root Aug 29 01:16:03 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-bf7115c1-45cb-4aa6-a66f-2e7f59dadef6 tempest-VolumesActionsTest-258600632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-228ce9ce-1f9a-4453-971c-8dc58400f0ec 1073741824" returned: 0 in 0.588s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:16:03 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-bf7115c1-45cb-4aa6-a66f-2e7f59dadef6 tempest-VolumesActionsTest-258600632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-228ce9ce-1f9a-4453-971c-8dc58400f0ec {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:16:03 devstack sudo[94192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-228ce9ce-1f9a-4453-971c-8dc58400f0ec Aug 29 01:16:03 devstack sudo[94192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:16:03 devstack sudo[94186]: pam_unix(sudo:session): session closed for user root Aug 29 01:16:03 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c258c8ad-e164-4e55-980b-1d9435b70ed0 tempest-VolumesDeleteCascade-1603786445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-37a29606-d8fa-4ce0-8dce-df5db7016dcc" returned: 0 in 0.500s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:16:03 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c258c8ad-e164-4e55-980b-1d9435b70ed0 tempest-VolumesDeleteCascade-1603786445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-37a29606-d8fa-4ce0-8dce-df5db7016dcc {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:16:03 devstack sudo[94197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-37a29606-d8fa-4ce0-8dce-df5db7016dcc Aug 29 01:16:03 devstack sudo[94197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:16:03 devstack sudo[94192]: pam_unix(sudo:session): session closed for user root Aug 29 01:16:03 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-bf7115c1-45cb-4aa6-a66f-2e7f59dadef6 tempest-VolumesActionsTest-258600632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-228ce9ce-1f9a-4453-971c-8dc58400f0ec" returned: 0 in 0.290s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:16:03 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-bf7115c1-45cb-4aa6-a66f-2e7f59dadef6 tempest-VolumesActionsTest-258600632 None] <== create_volume: return (936ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:16:03 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-bf7115c1-45cb-4aa6-a66f-2e7f59dadef6 tempest-VolumesActionsTest-258600632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.940s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:16:03 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-bf7115c1-45cb-4aa6-a66f-2e7f59dadef6 tempest-VolumesActionsTest-258600632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef5df790-2e4e-45e2-8fe1-85d5a1406760) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-228ce9ce-1f9a-4453-971c-8dc58400f0ec', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:16:03 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-bf7115c1-45cb-4aa6-a66f-2e7f59dadef6 tempest-VolumesActionsTest-258600632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40cd7a4a-a147-4968-bec4-0171e77d518d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:16:03 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-bf7115c1-45cb-4aa6-a66f-2e7f59dadef6 tempest-VolumesActionsTest-258600632 None] Volume volume-228ce9ce-1f9a-4453-971c-8dc58400f0ec (228ce9ce-1f9a-4453-971c-8dc58400f0ec): created successfully Aug 29 01:16:03 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-bf7115c1-45cb-4aa6-a66f-2e7f59dadef6 tempest-VolumesActionsTest-258600632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40cd7a4a-a147-4968-bec4-0171e77d518d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:16:03 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-bf7115c1-45cb-4aa6-a66f-2e7f59dadef6 tempest-VolumesActionsTest-258600632 None] Flow 'volume_create_manager' (0049865f-ae79-4358-a1b5-f3154d24e705) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:16:03 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-bf7115c1-45cb-4aa6-a66f-2e7f59dadef6 tempest-VolumesActionsTest-258600632 None] Created volume successfully. Aug 29 01:16:03 devstack sudo[94197]: pam_unix(sudo:session): session closed for user root Aug 29 01:16:03 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c258c8ad-e164-4e55-980b-1d9435b70ed0 tempest-VolumesDeleteCascade-1603786445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-37a29606-d8fa-4ce0-8dce-df5db7016dcc" returned: 0 in 0.311s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:16:03 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-c258c8ad-e164-4e55-980b-1d9435b70ed0 tempest-VolumesDeleteCascade-1603786445 None] Lock "cinder-quobyte-37a29606-d8fa-4ce0-8dce-df5db7016dcc" released by "delete_volume" :: held 0.889s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:16:03 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-c258c8ad-e164-4e55-980b-1d9435b70ed0 tempest-VolumesDeleteCascade-1603786445 None] Created reservations ['8ce3fe10-99a6-4ebd-ad61-5560295f7efd', 'f63ab010-653e-4846-af4a-5017fec0539d', '4039b420-2e3d-4f1c-8e31-0c6d39b10cdf', 'f953a5ef-fabe-4759-82dd-453a784a830c'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:16:04 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-c258c8ad-e164-4e55-980b-1d9435b70ed0 tempest-VolumesDeleteCascade-1603786445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:16:04 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-c258c8ad-e164-4e55-980b-1d9435b70ed0 tempest-VolumesDeleteCascade-1603786445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:16:04 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-c258c8ad-e164-4e55-980b-1d9435b70ed0 tempest-VolumesDeleteCascade-1603786445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:16:04 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-c258c8ad-e164-4e55-980b-1d9435b70ed0 tempest-VolumesDeleteCascade-1603786445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:16:04 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-c258c8ad-e164-4e55-980b-1d9435b70ed0 tempest-VolumesDeleteCascade-1603786445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:16:04 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c258c8ad-e164-4e55-980b-1d9435b70ed0 tempest-VolumesDeleteCascade-1603786445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:16:04 devstack sudo[94201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:16:04 devstack sudo[94201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:16:04 devstack sudo[94201]: pam_unix(sudo:session): session closed for user root Aug 29 01:16:04 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c258c8ad-e164-4e55-980b-1d9435b70ed0 tempest-VolumesDeleteCascade-1603786445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.272s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:16:04 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-c258c8ad-e164-4e55-980b-1d9435b70ed0 tempest-VolumesDeleteCascade-1603786445 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:16:04 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-c258c8ad-e164-4e55-980b-1d9435b70ed0 tempest-VolumesDeleteCascade-1603786445 None] Deleted volume successfully. Aug 29 01:16:04 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-c258c8ad-e164-4e55-980b-1d9435b70ed0 tempest-VolumesDeleteCascade-1603786445 None] Lock "cinder-37a29606-d8fa-4ce0-8dce-df5db7016dcc-delete_volume" released by "delete_volume" :: held 7.909s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:16:04 devstack cinder-volume[86111]: INFO cinder.volume.manager [req-b308eca9-21ea-4fac-9d89-2dcb46894727 req-74814586-b0be-485d-9e8e-46437157ed1b tempest-AttachVolumeTestJSON-257506515 None] Terminate volume connection completed successfully. Aug 29 01:16:04 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [req-b308eca9-21ea-4fac-9d89-2dcb46894727 req-74814586-b0be-485d-9e8e-46437157ed1b tempest-AttachVolumeTestJSON-257506515 None] Deleting attachment 956ba713-1bb7-48b1-bace-4bfad3e117d4. {{(pid=86111) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 29 01:16:05 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fde45c8-acc8-4b51-acea-7b01e61f7ec2 tempest-VolumesDeleteCascade-1603786445 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:16:05 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6fde45c8-acc8-4b51-acea-7b01e61f7ec2 tempest-VolumesDeleteCascade-1603786445 None] Flow 'volume_create_manager' (ddc1f1b6-0c8c-402e-98cb-1fd5a89dd8bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:16:05 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6fde45c8-acc8-4b51-acea-7b01e61f7ec2 tempest-VolumesDeleteCascade-1603786445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a2e4ee0-364f-4059-bf0c-118f8ce78659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:16:05 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6fde45c8-acc8-4b51-acea-7b01e61f7ec2 tempest-VolumesDeleteCascade-1603786445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a2e4ee0-364f-4059-bf0c-118f8ce78659) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:16:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1584530592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54187d66-a898-4e03-811c-390763146335,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c0c23720a924389954271f3745c49e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:16:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:16:05Z,use_quota=True,user_id='8a3e23ffec7f480cb629a6d83e7d42ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:16:05 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6fde45c8-acc8-4b51-acea-7b01e61f7ec2 tempest-VolumesDeleteCascade-1603786445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76de9788-4c92-4856-ae78-b362bdfdf380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:16:05 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6fde45c8-acc8-4b51-acea-7b01e61f7ec2 tempest-VolumesDeleteCascade-1603786445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76de9788-4c92-4856-ae78-b362bdfdf380) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:16:05 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6fde45c8-acc8-4b51-acea-7b01e61f7ec2 tempest-VolumesDeleteCascade-1603786445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a9fb266-d2e3-4c1d-97c4-4f9e748d01b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:16:05 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6fde45c8-acc8-4b51-acea-7b01e61f7ec2 tempest-VolumesDeleteCascade-1603786445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a9fb266-d2e3-4c1d-97c4-4f9e748d01b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54187d66-a898-4e03-811c-390763146335', 'volume_name': 'volume-54187d66-a898-4e03-811c-390763146335', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:16:05 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6fde45c8-acc8-4b51-acea-7b01e61f7ec2 tempest-VolumesDeleteCascade-1603786445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (717e7b4d-9cfe-4e1d-934f-6f91d2107615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:16:05 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6fde45c8-acc8-4b51-acea-7b01e61f7ec2 tempest-VolumesDeleteCascade-1603786445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (717e7b4d-9cfe-4e1d-934f-6f91d2107615) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:16:05 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6fde45c8-acc8-4b51-acea-7b01e61f7ec2 tempest-VolumesDeleteCascade-1603786445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d8e1ddb-fb95-4c34-9655-5f6a39baf60b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:16:05 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-6fde45c8-acc8-4b51-acea-7b01e61f7ec2 tempest-VolumesDeleteCascade-1603786445 None] Volume 54187d66-a898-4e03-811c-390763146335: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54187d66-a898-4e03-811c-390763146335', 'volume_size': 1} Aug 29 01:16:05 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-6fde45c8-acc8-4b51-acea-7b01e61f7ec2 tempest-VolumesDeleteCascade-1603786445 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:16:05 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-6fde45c8-acc8-4b51-acea-7b01e61f7ec2 tempest-VolumesDeleteCascade-1603786445 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:16:05 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-6fde45c8-acc8-4b51-acea-7b01e61f7ec2 tempest-VolumesDeleteCascade-1603786445 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:16:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1584530592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54187d66-a898-4e03-811c-390763146335,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c0c23720a924389954271f3745c49e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:16:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:16:05Z,use_quota=True,user_id='8a3e23ffec7f480cb629a6d83e7d42ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:16:05 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-6fde45c8-acc8-4b51-acea-7b01e61f7ec2 tempest-VolumesDeleteCascade-1603786445 None] Creating volume 54187d66-a898-4e03-811c-390763146335 {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:16:05 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-6fde45c8-acc8-4b51-acea-7b01e61f7ec2 tempest-VolumesDeleteCascade-1603786445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:16:05 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-6fde45c8-acc8-4b51-acea-7b01e61f7ec2 tempest-VolumesDeleteCascade-1603786445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:16:05 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-6fde45c8-acc8-4b51-acea-7b01e61f7ec2 tempest-VolumesDeleteCascade-1603786445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:16:05 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-6fde45c8-acc8-4b51-acea-7b01e61f7ec2 tempest-VolumesDeleteCascade-1603786445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:16:05 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-6fde45c8-acc8-4b51-acea-7b01e61f7ec2 tempest-VolumesDeleteCascade-1603786445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:16:05 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-6fde45c8-acc8-4b51-acea-7b01e61f7ec2 tempest-VolumesDeleteCascade-1603786445 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:16:05 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-6fde45c8-acc8-4b51-acea-7b01e61f7ec2 tempest-VolumesDeleteCascade-1603786445 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:16:05 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-6fde45c8-acc8-4b51-acea-7b01e61f7ec2 tempest-VolumesDeleteCascade-1603786445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-54187d66-a898-4e03-811c-390763146335 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:16:05 devstack sudo[94233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-54187d66-a898-4e03-811c-390763146335 1073741824 Aug 29 01:16:05 devstack sudo[94233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:16:06 devstack sudo[94233]: pam_unix(sudo:session): session closed for user root Aug 29 01:16:06 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-6fde45c8-acc8-4b51-acea-7b01e61f7ec2 tempest-VolumesDeleteCascade-1603786445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-54187d66-a898-4e03-811c-390763146335 1073741824" returned: 0 in 0.731s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:16:06 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-6fde45c8-acc8-4b51-acea-7b01e61f7ec2 tempest-VolumesDeleteCascade-1603786445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-54187d66-a898-4e03-811c-390763146335 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:16:06 devstack sudo[94244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-54187d66-a898-4e03-811c-390763146335 Aug 29 01:16:06 devstack sudo[94244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:16:06 devstack sudo[94244]: pam_unix(sudo:session): session closed for user root Aug 29 01:16:06 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-6fde45c8-acc8-4b51-acea-7b01e61f7ec2 tempest-VolumesDeleteCascade-1603786445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-54187d66-a898-4e03-811c-390763146335" returned: 0 in 0.480s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:16:06 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-6fde45c8-acc8-4b51-acea-7b01e61f7ec2 tempest-VolumesDeleteCascade-1603786445 None] <== create_volume: return (1273ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:16:06 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-6fde45c8-acc8-4b51-acea-7b01e61f7ec2 tempest-VolumesDeleteCascade-1603786445 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.280s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:16:06 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6fde45c8-acc8-4b51-acea-7b01e61f7ec2 tempest-VolumesDeleteCascade-1603786445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d8e1ddb-fb95-4c34-9655-5f6a39baf60b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54187d66-a898-4e03-811c-390763146335', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:16:06 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6fde45c8-acc8-4b51-acea-7b01e61f7ec2 tempest-VolumesDeleteCascade-1603786445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (589fd309-4a91-4ce6-b471-4b19ff760469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:16:06 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-6fde45c8-acc8-4b51-acea-7b01e61f7ec2 tempest-VolumesDeleteCascade-1603786445 None] Volume volume-54187d66-a898-4e03-811c-390763146335 (54187d66-a898-4e03-811c-390763146335): created successfully Aug 29 01:16:06 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6fde45c8-acc8-4b51-acea-7b01e61f7ec2 tempest-VolumesDeleteCascade-1603786445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (589fd309-4a91-4ce6-b471-4b19ff760469) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:16:06 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6fde45c8-acc8-4b51-acea-7b01e61f7ec2 tempest-VolumesDeleteCascade-1603786445 None] Flow 'volume_create_manager' (ddc1f1b6-0c8c-402e-98cb-1fd5a89dd8bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:16:07 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-6fde45c8-acc8-4b51-acea-7b01e61f7ec2 tempest-VolumesDeleteCascade-1603786445 None] Created volume successfully. Aug 29 01:16:08 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-bebbd47e-41e8-45bb-bd12-f56a597d9e78 tempest-VolumesDeleteCascade-1603786445 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:16:08 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-bebbd47e-41e8-45bb-bd12-f56a597d9e78 tempest-VolumesDeleteCascade-1603786445 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:16:08 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-bebbd47e-41e8-45bb-bd12-f56a597d9e78 tempest-VolumesDeleteCascade-1603786445 None] Creating offline snapshot ba90f54f-b24f-4afb-81ae-757ecb096dcc of volume 54187d66-a898-4e03-811c-390763146335 {{(pid=86111) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 29 01:16:08 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[95b6b9f5-c414-422f-a6fa-b8a63d701c7f]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:16:08 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-bebbd47e-41e8-45bb-bd12-f56a597d9e78 tempest-VolumesDeleteCascade-1603786445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-54187d66-a898-4e03-811c-390763146335 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:16:08 devstack sudo[94266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-54187d66-a898-4e03-811c-390763146335 Aug 29 01:16:08 devstack sudo[94266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:16:08 devstack sudo[94266]: pam_unix(sudo:session): session closed for user root Aug 29 01:16:08 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-bebbd47e-41e8-45bb-bd12-f56a597d9e78 tempest-VolumesDeleteCascade-1603786445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-54187d66-a898-4e03-811c-390763146335" returned: 0 in 0.637s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:16:08 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-bebbd47e-41e8-45bb-bd12-f56a597d9e78 tempest-VolumesDeleteCascade-1603786445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-54187d66-a898-4e03-811c-390763146335,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-54187d66-a898-4e03-811c-390763146335.ba90f54f-b24f-4afb-81ae-757ecb096dcc 1G {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:16:08 devstack sudo[94277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-54187d66-a898-4e03-811c-390763146335,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-54187d66-a898-4e03-811c-390763146335.ba90f54f-b24f-4afb-81ae-757ecb096dcc 1G Aug 29 01:16:08 devstack sudo[94277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:16:09 devstack sudo[94277]: pam_unix(sudo:session): session closed for user root Aug 29 01:16:09 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-bebbd47e-41e8-45bb-bd12-f56a597d9e78 tempest-VolumesDeleteCascade-1603786445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-54187d66-a898-4e03-811c-390763146335,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-54187d66-a898-4e03-811c-390763146335.ba90f54f-b24f-4afb-81ae-757ecb096dcc 1G" returned: 0 in 0.925s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:16:09 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-bebbd47e-41e8-45bb-bd12-f56a597d9e78 tempest-VolumesDeleteCascade-1603786445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-54187d66-a898-4e03-811c-390763146335 -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-54187d66-a898-4e03-811c-390763146335.ba90f54f-b24f-4afb-81ae-757ecb096dcc {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:16:09 devstack sudo[94300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-54187d66-a898-4e03-811c-390763146335 -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-54187d66-a898-4e03-811c-390763146335.ba90f54f-b24f-4afb-81ae-757ecb096dcc Aug 29 01:16:09 devstack sudo[94300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:16:10 devstack sudo[94300]: pam_unix(sudo:session): session closed for user root Aug 29 01:16:10 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-bebbd47e-41e8-45bb-bd12-f56a597d9e78 tempest-VolumesDeleteCascade-1603786445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-54187d66-a898-4e03-811c-390763146335 -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-54187d66-a898-4e03-811c-390763146335.ba90f54f-b24f-4afb-81ae-757ecb096dcc" returned: 0 in 0.530s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:16:10 devstack cinder-volume[86111]: WARNING cinder.volume.drivers.remotefs [None req-bebbd47e-41e8-45bb-bd12-f56a597d9e78 tempest-VolumesDeleteCascade-1603786445 None] /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-54187d66-a898-4e03-811c-390763146335.ba90f54f-b24f-4afb-81ae-757ecb096dcc is being set with open permissions: ugo+rw Aug 29 01:16:10 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-bebbd47e-41e8-45bb-bd12-f56a597d9e78 tempest-VolumesDeleteCascade-1603786445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-54187d66-a898-4e03-811c-390763146335.ba90f54f-b24f-4afb-81ae-757ecb096dcc {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:16:10 devstack sudo[94309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-54187d66-a898-4e03-811c-390763146335.ba90f54f-b24f-4afb-81ae-757ecb096dcc Aug 29 01:16:10 devstack sudo[94309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:16:10 devstack sudo[94309]: pam_unix(sudo:session): session closed for user root Aug 29 01:16:10 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-bebbd47e-41e8-45bb-bd12-f56a597d9e78 tempest-VolumesDeleteCascade-1603786445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-54187d66-a898-4e03-811c-390763146335.ba90f54f-b24f-4afb-81ae-757ecb096dcc" returned: 0 in 0.262s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:16:10 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-bebbd47e-41e8-45bb-bd12-f56a597d9e78 tempest-VolumesDeleteCascade-1603786445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-54187d66-a898-4e03-811c-390763146335.info {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:16:10 devstack sudo[94312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-54187d66-a898-4e03-811c-390763146335.info Aug 29 01:16:10 devstack sudo[94312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:16:10 devstack sudo[94312]: pam_unix(sudo:session): session closed for user root Aug 29 01:16:10 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-bebbd47e-41e8-45bb-bd12-f56a597d9e78 tempest-VolumesDeleteCascade-1603786445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-54187d66-a898-4e03-811c-390763146335.info" returned: 0 in 0.294s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:16:10 devstack cinder-volume[86111]: WARNING cinder.volume.drivers.remotefs [None req-bebbd47e-41e8-45bb-bd12-f56a597d9e78 tempest-VolumesDeleteCascade-1603786445 None] /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-54187d66-a898-4e03-811c-390763146335.info is being set with open permissions: ugo+rw Aug 29 01:16:10 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-bebbd47e-41e8-45bb-bd12-f56a597d9e78 tempest-VolumesDeleteCascade-1603786445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-54187d66-a898-4e03-811c-390763146335.info {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:16:10 devstack sudo[94315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-54187d66-a898-4e03-811c-390763146335.info Aug 29 01:16:10 devstack sudo[94315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:16:11 devstack sudo[94315]: pam_unix(sudo:session): session closed for user root Aug 29 01:16:11 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-bebbd47e-41e8-45bb-bd12-f56a597d9e78 tempest-VolumesDeleteCascade-1603786445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-54187d66-a898-4e03-811c-390763146335.info" returned: 0 in 0.293s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:16:11 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-bebbd47e-41e8-45bb-bd12-f56a597d9e78 tempest-VolumesDeleteCascade-1603786445 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.054s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:16:11 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-bebbd47e-41e8-45bb-bd12-f56a597d9e78 tempest-VolumesDeleteCascade-1603786445 None] Create snapshot completed successfully Aug 29 01:16:11 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-95f5d553-9314-4e2e-8c55-eef3b7ad79f2 tempest-AttachVolumeTestJSON-257506515 None] Acquiring lock "cinder-a1a24d3f-0bcd-4fee-9378-7430efa40f36-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:16:11 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-95f5d553-9314-4e2e-8c55-eef3b7ad79f2 tempest-AttachVolumeTestJSON-257506515 None] Lock "cinder-a1a24d3f-0bcd-4fee-9378-7430efa40f36-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:16:11 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-95f5d553-9314-4e2e-8c55-eef3b7ad79f2 tempest-AttachVolumeTestJSON-257506515 None] Acquiring lock "cinder-quobyte-a1a24d3f-0bcd-4fee-9378-7430efa40f36" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:16:11 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-95f5d553-9314-4e2e-8c55-eef3b7ad79f2 tempest-AttachVolumeTestJSON-257506515 None] Lock "cinder-quobyte-a1a24d3f-0bcd-4fee-9378-7430efa40f36" acquired by "delete_volume" :: waited 0.021s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:16:11 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[282c1fee-82a9-4d42-bea5-81516325da68]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:16:11 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-95f5d553-9314-4e2e-8c55-eef3b7ad79f2 tempest-AttachVolumeTestJSON-257506515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a1a24d3f-0bcd-4fee-9378-7430efa40f36 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:16:11 devstack sudo[94319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a1a24d3f-0bcd-4fee-9378-7430efa40f36 Aug 29 01:16:11 devstack sudo[94319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:16:12 devstack sudo[94319]: pam_unix(sudo:session): session closed for user root Aug 29 01:16:12 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-95f5d553-9314-4e2e-8c55-eef3b7ad79f2 tempest-AttachVolumeTestJSON-257506515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a1a24d3f-0bcd-4fee-9378-7430efa40f36" returned: 0 in 0.802s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:16:12 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-95f5d553-9314-4e2e-8c55-eef3b7ad79f2 tempest-AttachVolumeTestJSON-257506515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a1a24d3f-0bcd-4fee-9378-7430efa40f36 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:16:12 devstack sudo[94381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a1a24d3f-0bcd-4fee-9378-7430efa40f36 Aug 29 01:16:12 devstack sudo[94381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:16:13 devstack sudo[94381]: pam_unix(sudo:session): session closed for user root Aug 29 01:16:13 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-95f5d553-9314-4e2e-8c55-eef3b7ad79f2 tempest-AttachVolumeTestJSON-257506515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a1a24d3f-0bcd-4fee-9378-7430efa40f36" returned: 0 in 0.766s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:16:13 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-95f5d553-9314-4e2e-8c55-eef3b7ad79f2 tempest-AttachVolumeTestJSON-257506515 None] Lock "cinder-quobyte-a1a24d3f-0bcd-4fee-9378-7430efa40f36" released by "delete_volume" :: held 1.656s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:16:13 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-95f5d553-9314-4e2e-8c55-eef3b7ad79f2 tempest-AttachVolumeTestJSON-257506515 None] Created reservations ['1e88490c-6225-4856-98a4-4c42a4f66500', '8ee4ad17-0ed6-480a-824d-dd14223651da', '821c01b7-c5ef-4a5c-8843-f63aeeafc425', 'dc7dc982-e348-4973-94b1-9f5041ed8faa'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:16:13 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-95f5d553-9314-4e2e-8c55-eef3b7ad79f2 tempest-AttachVolumeTestJSON-257506515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:16:13 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-95f5d553-9314-4e2e-8c55-eef3b7ad79f2 tempest-AttachVolumeTestJSON-257506515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:16:13 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-95f5d553-9314-4e2e-8c55-eef3b7ad79f2 tempest-AttachVolumeTestJSON-257506515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:16:13 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-95f5d553-9314-4e2e-8c55-eef3b7ad79f2 tempest-AttachVolumeTestJSON-257506515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:16:13 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-95f5d553-9314-4e2e-8c55-eef3b7ad79f2 tempest-AttachVolumeTestJSON-257506515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:16:13 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-95f5d553-9314-4e2e-8c55-eef3b7ad79f2 tempest-AttachVolumeTestJSON-257506515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:16:13 devstack sudo[94394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:16:13 devstack sudo[94394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:16:13 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7996f62-f8b8-486b-88b5-84cc0ebfcf6f tempest-VolumesDeleteCascade-1603786445 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:16:13 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-e7996f62-f8b8-486b-88b5-84cc0ebfcf6f tempest-VolumesDeleteCascade-1603786445 None] Flow 'volume_create_manager' (297b08e4-041d-4bb9-be1e-05aa1509f5be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:16:13 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-e7996f62-f8b8-486b-88b5-84cc0ebfcf6f tempest-VolumesDeleteCascade-1603786445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9bfd321-dae6-405e-8657-d2e2cd89f5fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:16:13 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-e7996f62-f8b8-486b-88b5-84cc0ebfcf6f tempest-VolumesDeleteCascade-1603786445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9bfd321-dae6-405e-8657-d2e2cd89f5fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:16:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-89303670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d5d2516-4ca9-40ae-bdf9-94c405abd15f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c0c23720a924389954271f3745c49e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:16:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ba90f54f-b24f-4afb-81ae-757ecb096dcc,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:16:13Z,use_quota=True,user_id='8a3e23ffec7f480cb629a6d83e7d42ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:16:13 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-e7996f62-f8b8-486b-88b5-84cc0ebfcf6f tempest-VolumesDeleteCascade-1603786445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47e5366f-1429-4e8d-bae4-1ac4f6cbde0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:16:13 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-e7996f62-f8b8-486b-88b5-84cc0ebfcf6f tempest-VolumesDeleteCascade-1603786445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47e5366f-1429-4e8d-bae4-1ac4f6cbde0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:16:13 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-e7996f62-f8b8-486b-88b5-84cc0ebfcf6f tempest-VolumesDeleteCascade-1603786445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (025907ff-c716-4ae6-9874-6c8c7a0439a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:16:13 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-e7996f62-f8b8-486b-88b5-84cc0ebfcf6f tempest-VolumesDeleteCascade-1603786445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (025907ff-c716-4ae6-9874-6c8c7a0439a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2d5d2516-4ca9-40ae-bdf9-94c405abd15f', 'volume_name': 'volume-2d5d2516-4ca9-40ae-bdf9-94c405abd15f', 'volume_size': 1, 'snapshot_id': 'ba90f54f-b24f-4afb-81ae-757ecb096dcc'}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:16:13 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-e7996f62-f8b8-486b-88b5-84cc0ebfcf6f tempest-VolumesDeleteCascade-1603786445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1c1a2ed-5515-4f49-922e-ed7a7a60ec20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:16:13 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-e7996f62-f8b8-486b-88b5-84cc0ebfcf6f tempest-VolumesDeleteCascade-1603786445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1c1a2ed-5515-4f49-922e-ed7a7a60ec20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:16:13 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-e7996f62-f8b8-486b-88b5-84cc0ebfcf6f tempest-VolumesDeleteCascade-1603786445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6811d71-07a8-4b92-a355-ff7d6548459f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:16:13 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-e7996f62-f8b8-486b-88b5-84cc0ebfcf6f tempest-VolumesDeleteCascade-1603786445 None] Volume 2d5d2516-4ca9-40ae-bdf9-94c405abd15f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2d5d2516-4ca9-40ae-bdf9-94c405abd15f', 'volume_size': 1, 'snapshot_id': 'ba90f54f-b24f-4afb-81ae-757ecb096dcc'} Aug 29 01:16:13 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-e7996f62-f8b8-486b-88b5-84cc0ebfcf6f tempest-VolumesDeleteCascade-1603786445 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:16:13 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-e7996f62-f8b8-486b-88b5-84cc0ebfcf6f tempest-VolumesDeleteCascade-1603786445 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:16:13 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-e7996f62-f8b8-486b-88b5-84cc0ebfcf6f tempest-VolumesDeleteCascade-1603786445 None] Acquiring lock "cinder-quobyte-ba90f54f-b24f-4afb-81ae-757ecb096dcc-2d5d2516-4ca9-40ae-bdf9-94c405abd15f" by "_create_volume_from_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:16:13 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-e7996f62-f8b8-486b-88b5-84cc0ebfcf6f tempest-VolumesDeleteCascade-1603786445 None] Lock "cinder-quobyte-ba90f54f-b24f-4afb-81ae-757ecb096dcc-2d5d2516-4ca9-40ae-bdf9-94c405abd15f" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:16:13 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-e7996f62-f8b8-486b-88b5-84cc0ebfcf6f tempest-VolumesDeleteCascade-1603786445 None] Creating volume 2d5d2516-4ca9-40ae-bdf9-94c405abd15f from snapshot ba90f54f-b24f-4afb-81ae-757ecb096dcc {{(pid=86111) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Aug 29 01:16:13 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-e7996f62-f8b8-486b-88b5-84cc0ebfcf6f tempest-VolumesDeleteCascade-1603786445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:16:13 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-e7996f62-f8b8-486b-88b5-84cc0ebfcf6f tempest-VolumesDeleteCascade-1603786445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:16:13 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-e7996f62-f8b8-486b-88b5-84cc0ebfcf6f tempest-VolumesDeleteCascade-1603786445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:16:13 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-e7996f62-f8b8-486b-88b5-84cc0ebfcf6f tempest-VolumesDeleteCascade-1603786445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:16:13 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-e7996f62-f8b8-486b-88b5-84cc0ebfcf6f tempest-VolumesDeleteCascade-1603786445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:16:13 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-e7996f62-f8b8-486b-88b5-84cc0ebfcf6f tempest-VolumesDeleteCascade-1603786445 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:16:13 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-e7996f62-f8b8-486b-88b5-84cc0ebfcf6f tempest-VolumesDeleteCascade-1603786445 None] Acquiring lock "cinder-quobyte-2d5d2516-4ca9-40ae-bdf9-94c405abd15f" by "_copy_volume_from_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:16:13 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-e7996f62-f8b8-486b-88b5-84cc0ebfcf6f tempest-VolumesDeleteCascade-1603786445 None] Lock "cinder-quobyte-2d5d2516-4ca9-40ae-bdf9-94c405abd15f" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:16:13 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-e7996f62-f8b8-486b-88b5-84cc0ebfcf6f tempest-VolumesDeleteCascade-1603786445 None] snapshot: ba90f54f-b24f-4afb-81ae-757ecb096dcc, volume: 2d5d2516-4ca9-40ae-bdf9-94c405abd15f, {{(pid=86111) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 29 01:16:13 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-e7996f62-f8b8-486b-88b5-84cc0ebfcf6f tempest-VolumesDeleteCascade-1603786445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:16:13 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-e7996f62-f8b8-486b-88b5-84cc0ebfcf6f tempest-VolumesDeleteCascade-1603786445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:16:13 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-e7996f62-f8b8-486b-88b5-84cc0ebfcf6f tempest-VolumesDeleteCascade-1603786445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:16:13 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-e7996f62-f8b8-486b-88b5-84cc0ebfcf6f tempest-VolumesDeleteCascade-1603786445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:16:13 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-e7996f62-f8b8-486b-88b5-84cc0ebfcf6f tempest-VolumesDeleteCascade-1603786445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:16:13 devstack sudo[94394]: pam_unix(sudo:session): session closed for user root Aug 29 01:16:13 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[947d8139-f5b8-4ba2-a839-f0d959b72903]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:16:13 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-e7996f62-f8b8-486b-88b5-84cc0ebfcf6f tempest-VolumesDeleteCascade-1603786445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-54187d66-a898-4e03-811c-390763146335.ba90f54f-b24f-4afb-81ae-757ecb096dcc {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:16:13 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-95f5d553-9314-4e2e-8c55-eef3b7ad79f2 tempest-AttachVolumeTestJSON-257506515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.392s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:16:13 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-95f5d553-9314-4e2e-8c55-eef3b7ad79f2 tempest-AttachVolumeTestJSON-257506515 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:16:13 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-95f5d553-9314-4e2e-8c55-eef3b7ad79f2 tempest-AttachVolumeTestJSON-257506515 None] Deleted volume successfully. Aug 29 01:16:13 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-95f5d553-9314-4e2e-8c55-eef3b7ad79f2 tempest-AttachVolumeTestJSON-257506515 None] Lock "cinder-a1a24d3f-0bcd-4fee-9378-7430efa40f36-delete_volume" released by "delete_volume" :: held 2.343s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:16:14 devstack sudo[94399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-54187d66-a898-4e03-811c-390763146335.ba90f54f-b24f-4afb-81ae-757ecb096dcc Aug 29 01:16:14 devstack sudo[94399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:16:14 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-04f92014-fb7c-424d-91ef-06cfb36624ec tempest-AttachVolumeTestJSON-257506515 None] Acquiring lock "cinder-0e649915-8e98-4734-8957-0e2d2d4351c8-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:16:14 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-04f92014-fb7c-424d-91ef-06cfb36624ec tempest-AttachVolumeTestJSON-257506515 None] Lock "cinder-0e649915-8e98-4734-8957-0e2d2d4351c8-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:16:14 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-04f92014-fb7c-424d-91ef-06cfb36624ec tempest-AttachVolumeTestJSON-257506515 None] Acquiring lock "cinder-quobyte-0e649915-8e98-4734-8957-0e2d2d4351c8" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:16:14 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-04f92014-fb7c-424d-91ef-06cfb36624ec tempest-AttachVolumeTestJSON-257506515 None] Lock "cinder-quobyte-0e649915-8e98-4734-8957-0e2d2d4351c8" acquired by "delete_volume" :: waited 0.022s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:16:14 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[40e6efe8-73ab-4661-98e5-e2026d5c1af6]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:16:14 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-04f92014-fb7c-424d-91ef-06cfb36624ec tempest-AttachVolumeTestJSON-257506515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-0e649915-8e98-4734-8957-0e2d2d4351c8 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:16:14 devstack sudo[94401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-0e649915-8e98-4734-8957-0e2d2d4351c8 Aug 29 01:16:14 devstack sudo[94401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:16:14 devstack sudo[94399]: pam_unix(sudo:session): session closed for user root Aug 29 01:16:14 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-e7996f62-f8b8-486b-88b5-84cc0ebfcf6f tempest-VolumesDeleteCascade-1603786445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-54187d66-a898-4e03-811c-390763146335.ba90f54f-b24f-4afb-81ae-757ecb096dcc" returned: 0 in 0.521s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:16:14 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-e7996f62-f8b8-486b-88b5-84cc0ebfcf6f tempest-VolumesDeleteCascade-1603786445 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-54187d66-a898-4e03-811c-390763146335(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 29 01:16:14 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0db3edf-c370-4b2f-94f4-0f7efce9df6c]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:16:14 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-e7996f62-f8b8-486b-88b5-84cc0ebfcf6f tempest-VolumesDeleteCascade-1603786445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-54187d66-a898-4e03-811c-390763146335 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:16:14 devstack sudo[94406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-54187d66-a898-4e03-811c-390763146335 Aug 29 01:16:14 devstack sudo[94406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:16:14 devstack sudo[94401]: pam_unix(sudo:session): session closed for user root Aug 29 01:16:14 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-04f92014-fb7c-424d-91ef-06cfb36624ec tempest-AttachVolumeTestJSON-257506515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-0e649915-8e98-4734-8957-0e2d2d4351c8" returned: 0 in 0.458s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:16:14 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-04f92014-fb7c-424d-91ef-06cfb36624ec tempest-AttachVolumeTestJSON-257506515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-0e649915-8e98-4734-8957-0e2d2d4351c8 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:16:14 devstack sudo[94411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-0e649915-8e98-4734-8957-0e2d2d4351c8 Aug 29 01:16:14 devstack sudo[94411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:16:14 devstack sudo[94406]: pam_unix(sudo:session): session closed for user root Aug 29 01:16:14 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-e7996f62-f8b8-486b-88b5-84cc0ebfcf6f tempest-VolumesDeleteCascade-1603786445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-54187d66-a898-4e03-811c-390763146335" returned: 0 in 0.439s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:16:14 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-e7996f62-f8b8-486b-88b5-84cc0ebfcf6f tempest-VolumesDeleteCascade-1603786445 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-54187d66-a898-4e03-811c-390763146335 {{(pid=86111) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 29 01:16:14 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-e7996f62-f8b8-486b-88b5-84cc0ebfcf6f tempest-VolumesDeleteCascade-1603786445 None] Creating direct copy from snapshot {{(pid=86111) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 29 01:16:14 devstack cinder-volume[86111]: DEBUG cinder.utils [None req-e7996f62-f8b8-486b-88b5-84cc0ebfcf6f tempest-VolumesDeleteCascade-1603786445 None] Path /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-2d5d2516-4ca9-40ae-bdf9-94c405abd15f not found in is_blk_device check {{(pid=86111) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 29 01:16:14 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-e7996f62-f8b8-486b-88b5-84cc0ebfcf6f tempest-VolumesDeleteCascade-1603786445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-54187d66-a898-4e03-811c-390763146335 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-2d5d2516-4ca9-40ae-bdf9-94c405abd15f {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:16:14 devstack sudo[94417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-54187d66-a898-4e03-811c-390763146335 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-2d5d2516-4ca9-40ae-bdf9-94c405abd15f Aug 29 01:16:14 devstack sudo[94417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:16:14 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-a4fd0df3-b2d5-4f31-b4de-66b01f6c3f30 tempest-VolumesActionsTest-258600632 None] Acquiring lock "cinder-228ce9ce-1f9a-4453-971c-8dc58400f0ec" by "attach_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:16:14 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-a4fd0df3-b2d5-4f31-b4de-66b01f6c3f30 tempest-VolumesActionsTest-258600632 None] Lock "cinder-228ce9ce-1f9a-4453-971c-8dc58400f0ec" acquired by "attach_volume" :: waited 0.025s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:16:15 devstack sudo[94411]: pam_unix(sudo:session): session closed for user root Aug 29 01:16:15 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-04f92014-fb7c-424d-91ef-06cfb36624ec tempest-AttachVolumeTestJSON-257506515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-0e649915-8e98-4734-8957-0e2d2d4351c8" returned: 0 in 0.343s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:16:15 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-a4fd0df3-b2d5-4f31-b4de-66b01f6c3f30 tempest-VolumesActionsTest-258600632 None] Attaching volume 228ce9ce-1f9a-4453-971c-8dc58400f0ec to instance 00ff231a-fc0a-4594-b025-6642409d1f2d at mountpoint /dev/vdb on host None. Aug 29 01:16:15 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-04f92014-fb7c-424d-91ef-06cfb36624ec tempest-AttachVolumeTestJSON-257506515 None] Lock "cinder-quobyte-0e649915-8e98-4734-8957-0e2d2d4351c8" released by "delete_volume" :: held 0.858s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:16:15 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-a4fd0df3-b2d5-4f31-b4de-66b01f6c3f30 tempest-VolumesActionsTest-258600632 None] Attach volume completed successfully. Aug 29 01:16:15 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-a4fd0df3-b2d5-4f31-b4de-66b01f6c3f30 tempest-VolumesActionsTest-258600632 None] Lock "cinder-228ce9ce-1f9a-4453-971c-8dc58400f0ec" released by "attach_volume" :: held 0.139s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:16:15 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-04f92014-fb7c-424d-91ef-06cfb36624ec tempest-AttachVolumeTestJSON-257506515 None] Created reservations ['861562ce-84c0-42b9-8268-c8b46b2c2e42', '84ea20ea-c4f1-4158-adc1-188569fa3303', 'e739863b-f25f-46c3-8de4-a5689b495150', 'c3567bc3-95c9-43b0-81a1-539727e12f0d'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:16:15 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-04f92014-fb7c-424d-91ef-06cfb36624ec tempest-AttachVolumeTestJSON-257506515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:16:15 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-04f92014-fb7c-424d-91ef-06cfb36624ec tempest-AttachVolumeTestJSON-257506515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:16:15 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-04f92014-fb7c-424d-91ef-06cfb36624ec tempest-AttachVolumeTestJSON-257506515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:16:15 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-04f92014-fb7c-424d-91ef-06cfb36624ec tempest-AttachVolumeTestJSON-257506515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:16:15 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-04f92014-fb7c-424d-91ef-06cfb36624ec tempest-AttachVolumeTestJSON-257506515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:16:15 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-04f92014-fb7c-424d-91ef-06cfb36624ec tempest-AttachVolumeTestJSON-257506515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:16:15 devstack sudo[94424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:16:15 devstack sudo[94424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:16:15 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-7c0efefe-a97b-4eee-8626-667d5dffb3e7 tempest-VolumesActionsTest-258600632 None] Acquiring lock "cinder-228ce9ce-1f9a-4453-971c-8dc58400f0ec-detach_volume" by "detach_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:16:15 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-7c0efefe-a97b-4eee-8626-667d5dffb3e7 tempest-VolumesActionsTest-258600632 None] Lock "cinder-228ce9ce-1f9a-4453-971c-8dc58400f0ec-detach_volume" acquired by "detach_volume" :: waited 0.036s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:16:15 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-7c0efefe-a97b-4eee-8626-667d5dffb3e7 tempest-VolumesActionsTest-258600632 None] Detaching volume 228ce9ce-1f9a-4453-971c-8dc58400f0ec from instance 00ff231a-fc0a-4594-b025-6642409d1f2d. Aug 29 01:16:15 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-7c0efefe-a97b-4eee-8626-667d5dffb3e7 tempest-VolumesActionsTest-258600632 None] Detach volume completed successfully. Aug 29 01:16:15 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-7c0efefe-a97b-4eee-8626-667d5dffb3e7 tempest-VolumesActionsTest-258600632 None] Lock "cinder-228ce9ce-1f9a-4453-971c-8dc58400f0ec-detach_volume" released by "detach_volume" :: held 0.143s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:16:15 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-1fdf3021-15eb-43c8-8697-2c481d3f5e87 tempest-AttachVolumeTestJSON-257506515 None] Acquiring lock "cinder-4600cdee-4116-4eb6-b560-1e63977828f7-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:16:15 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-1fdf3021-15eb-43c8-8697-2c481d3f5e87 tempest-AttachVolumeTestJSON-257506515 None] Lock "cinder-4600cdee-4116-4eb6-b560-1e63977828f7-delete_volume" acquired by "delete_volume" :: waited 0.098s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:16:15 devstack sudo[94424]: pam_unix(sudo:session): session closed for user root Aug 29 01:16:15 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-04f92014-fb7c-424d-91ef-06cfb36624ec tempest-AttachVolumeTestJSON-257506515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.710s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:16:15 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-04f92014-fb7c-424d-91ef-06cfb36624ec tempest-AttachVolumeTestJSON-257506515 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:16:15 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-04f92014-fb7c-424d-91ef-06cfb36624ec tempest-AttachVolumeTestJSON-257506515 None] Deleted volume successfully. Aug 29 01:16:15 devstack cinder-volume[86111]: DEBUG dbcounter [-] [86111] Writing DB stats cinder:SELECT=111,cinder:UPDATE=142,cinder:DELETE=16,cinder:INSERT=36 {{(pid=86111) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 29 01:16:15 devstack cinder-volume[86111]: DEBUG dbcounter [-] [86111] Writing DB stats cinder:SELECT=134,cinder:UPDATE=124,cinder:INSERT=39,cinder:DELETE=7 {{(pid=86111) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 29 01:16:15 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-1fdf3021-15eb-43c8-8697-2c481d3f5e87 tempest-AttachVolumeTestJSON-257506515 None] Acquiring lock "cinder-quobyte-4600cdee-4116-4eb6-b560-1e63977828f7" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:16:16 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-04f92014-fb7c-424d-91ef-06cfb36624ec tempest-AttachVolumeTestJSON-257506515 None] Lock "cinder-0e649915-8e98-4734-8957-0e2d2d4351c8-delete_volume" released by "delete_volume" :: held 1.966s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:16:16 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-1fdf3021-15eb-43c8-8697-2c481d3f5e87 tempest-AttachVolumeTestJSON-257506515 None] Lock "cinder-quobyte-4600cdee-4116-4eb6-b560-1e63977828f7" acquired by "delete_volume" :: waited 0.094s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:16:16 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd627d86-6395-4524-8299-f8fdef66e4cf]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:16:16 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-1fdf3021-15eb-43c8-8697-2c481d3f5e87 tempest-AttachVolumeTestJSON-257506515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-4600cdee-4116-4eb6-b560-1e63977828f7 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:16:16 devstack sudo[94433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-4600cdee-4116-4eb6-b560-1e63977828f7 Aug 29 01:16:16 devstack sudo[94433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:16:17 devstack sudo[94433]: pam_unix(sudo:session): session closed for user root Aug 29 01:16:17 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-1fdf3021-15eb-43c8-8697-2c481d3f5e87 tempest-AttachVolumeTestJSON-257506515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-4600cdee-4116-4eb6-b560-1e63977828f7" returned: 0 in 1.368s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:16:17 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-1fdf3021-15eb-43c8-8697-2c481d3f5e87 tempest-AttachVolumeTestJSON-257506515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-4600cdee-4116-4eb6-b560-1e63977828f7 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:16:17 devstack sudo[94458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-4600cdee-4116-4eb6-b560-1e63977828f7 Aug 29 01:16:17 devstack sudo[94458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:16:18 devstack sudo[94458]: pam_unix(sudo:session): session closed for user root Aug 29 01:16:18 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-1fdf3021-15eb-43c8-8697-2c481d3f5e87 tempest-AttachVolumeTestJSON-257506515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-4600cdee-4116-4eb6-b560-1e63977828f7" returned: 0 in 0.718s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:16:18 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-1fdf3021-15eb-43c8-8697-2c481d3f5e87 tempest-AttachVolumeTestJSON-257506515 None] Lock "cinder-quobyte-4600cdee-4116-4eb6-b560-1e63977828f7" released by "delete_volume" :: held 2.243s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:16:18 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-1fdf3021-15eb-43c8-8697-2c481d3f5e87 tempest-AttachVolumeTestJSON-257506515 None] Created reservations ['4f03d2a7-9ef1-4263-ad85-8e12ff281845', 'e489eabe-25bd-415e-9349-3ea51e7b8484', '57e9fea2-3b77-4788-90cc-11274ac7b911', 'cda048f8-4bf0-468f-a4fc-b934050cb731'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:16:18 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-1fdf3021-15eb-43c8-8697-2c481d3f5e87 tempest-AttachVolumeTestJSON-257506515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:16:18 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-1fdf3021-15eb-43c8-8697-2c481d3f5e87 tempest-AttachVolumeTestJSON-257506515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:16:18 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-1fdf3021-15eb-43c8-8697-2c481d3f5e87 tempest-AttachVolumeTestJSON-257506515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:16:18 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-1fdf3021-15eb-43c8-8697-2c481d3f5e87 tempest-AttachVolumeTestJSON-257506515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:16:18 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-1fdf3021-15eb-43c8-8697-2c481d3f5e87 tempest-AttachVolumeTestJSON-257506515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.052s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:16:18 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-1fdf3021-15eb-43c8-8697-2c481d3f5e87 tempest-AttachVolumeTestJSON-257506515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:16:19 devstack sudo[94467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:16:19 devstack sudo[94467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:16:19 devstack sudo[94467]: pam_unix(sudo:session): session closed for user root Aug 29 01:16:19 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-1fdf3021-15eb-43c8-8697-2c481d3f5e87 tempest-AttachVolumeTestJSON-257506515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.870s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:16:19 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-1fdf3021-15eb-43c8-8697-2c481d3f5e87 tempest-AttachVolumeTestJSON-257506515 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:16:19 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-1fdf3021-15eb-43c8-8697-2c481d3f5e87 tempest-AttachVolumeTestJSON-257506515 None] Deleted volume successfully. Aug 29 01:16:19 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-1fdf3021-15eb-43c8-8697-2c481d3f5e87 tempest-AttachVolumeTestJSON-257506515 None] Lock "cinder-4600cdee-4116-4eb6-b560-1e63977828f7-delete_volume" released by "delete_volume" :: held 4.016s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:16:22 devstack sudo[94417]: pam_unix(sudo:session): session closed for user root Aug 29 01:16:22 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-e7996f62-f8b8-486b-88b5-84cc0ebfcf6f tempest-VolumesDeleteCascade-1603786445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-54187d66-a898-4e03-811c-390763146335 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-2d5d2516-4ca9-40ae-bdf9-94c405abd15f" returned: 0 in 7.489s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:16:22 devstack cinder-volume[86111]: DEBUG cinder.image.image_utils [None req-e7996f62-f8b8-486b-88b5-84cc0ebfcf6f tempest-VolumesDeleteCascade-1603786445 None] Image conversion details: src /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-54187d66-a898-4e03-811c-390763146335, size 1024.00 MB, duration 7.49 sec, destination /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-2d5d2516-4ca9-40ae-bdf9-94c405abd15f {{(pid=86111) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 29 01:16:22 devstack cinder-volume[86111]: INFO cinder.image.image_utils [None req-e7996f62-f8b8-486b-88b5-84cc0ebfcf6f tempest-VolumesDeleteCascade-1603786445 None] Converted 1024.00 MB image at 136.71 MB/s Aug 29 01:16:22 devstack cinder-volume[86111]: WARNING cinder.volume.drivers.remotefs [None req-e7996f62-f8b8-486b-88b5-84cc0ebfcf6f tempest-VolumesDeleteCascade-1603786445 None] /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-2d5d2516-4ca9-40ae-bdf9-94c405abd15f is being set with open permissions: ugo+rw Aug 29 01:16:22 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-e7996f62-f8b8-486b-88b5-84cc0ebfcf6f tempest-VolumesDeleteCascade-1603786445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-2d5d2516-4ca9-40ae-bdf9-94c405abd15f {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:16:22 devstack sudo[94482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-2d5d2516-4ca9-40ae-bdf9-94c405abd15f Aug 29 01:16:22 devstack sudo[94482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:16:22 devstack sudo[94482]: pam_unix(sudo:session): session closed for user root Aug 29 01:16:22 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-e7996f62-f8b8-486b-88b5-84cc0ebfcf6f tempest-VolumesDeleteCascade-1603786445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-2d5d2516-4ca9-40ae-bdf9-94c405abd15f" returned: 0 in 0.326s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:16:22 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-e7996f62-f8b8-486b-88b5-84cc0ebfcf6f tempest-VolumesDeleteCascade-1603786445 None] Lock "cinder-quobyte-2d5d2516-4ca9-40ae-bdf9-94c405abd15f" released by "_copy_volume_from_snapshot" :: held 8.914s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:16:22 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-e7996f62-f8b8-486b-88b5-84cc0ebfcf6f tempest-VolumesDeleteCascade-1603786445 None] Lock "cinder-quobyte-ba90f54f-b24f-4afb-81ae-757ecb096dcc-2d5d2516-4ca9-40ae-bdf9-94c405abd15f" released by "_create_volume_from_snapshot" :: held 9.098s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:16:22 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-e7996f62-f8b8-486b-88b5-84cc0ebfcf6f tempest-VolumesDeleteCascade-1603786445 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.129s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:16:22 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-e7996f62-f8b8-486b-88b5-84cc0ebfcf6f tempest-VolumesDeleteCascade-1603786445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6811d71-07a8-4b92-a355-ff7d6548459f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d5d2516-4ca9-40ae-bdf9-94c405abd15f', 'volume_size': 1, 'snapshot_id': 'ba90f54f-b24f-4afb-81ae-757ecb096dcc'}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:16:22 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-e7996f62-f8b8-486b-88b5-84cc0ebfcf6f tempest-VolumesDeleteCascade-1603786445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c5f5ee4-e9f2-419e-b40e-42f5162e8a28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:16:22 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-e7996f62-f8b8-486b-88b5-84cc0ebfcf6f tempest-VolumesDeleteCascade-1603786445 None] Volume volume-2d5d2516-4ca9-40ae-bdf9-94c405abd15f (2d5d2516-4ca9-40ae-bdf9-94c405abd15f): created successfully Aug 29 01:16:22 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-e7996f62-f8b8-486b-88b5-84cc0ebfcf6f tempest-VolumesDeleteCascade-1603786445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c5f5ee4-e9f2-419e-b40e-42f5162e8a28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:16:23 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-e7996f62-f8b8-486b-88b5-84cc0ebfcf6f tempest-VolumesDeleteCascade-1603786445 None] Flow 'volume_create_manager' (297b08e4-041d-4bb9-be1e-05aa1509f5be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:16:23 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-e7996f62-f8b8-486b-88b5-84cc0ebfcf6f tempest-VolumesDeleteCascade-1603786445 None] Created volume successfully. Aug 29 01:16:24 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-c26fd7e4-4c9d-47be-a4cb-bd60ca714cfd tempest-VolumesDeleteCascade-1603786445 None] Acquiring lock "cinder-54187d66-a898-4e03-811c-390763146335-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:16:24 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-c26fd7e4-4c9d-47be-a4cb-bd60ca714cfd tempest-VolumesDeleteCascade-1603786445 None] Lock "cinder-54187d66-a898-4e03-811c-390763146335-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:16:24 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-c26fd7e4-4c9d-47be-a4cb-bd60ca714cfd tempest-VolumesDeleteCascade-1603786445 None] Performing cascade delete. {{(pid=86111) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Aug 29 01:16:24 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-c26fd7e4-4c9d-47be-a4cb-bd60ca714cfd tempest-VolumesDeleteCascade-1603786445 None] Acquiring lock "cinder-ba90f54f-b24f-4afb-81ae-757ecb096dcc-delete_snapshot" by "delete_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:16:24 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-c26fd7e4-4c9d-47be-a4cb-bd60ca714cfd tempest-VolumesDeleteCascade-1603786445 None] Lock "cinder-ba90f54f-b24f-4afb-81ae-757ecb096dcc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:16:24 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-c26fd7e4-4c9d-47be-a4cb-bd60ca714cfd tempest-VolumesDeleteCascade-1603786445 None] Acquiring lock "cinder-quobyte-54187d66-a898-4e03-811c-390763146335" by "delete_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:16:24 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-c26fd7e4-4c9d-47be-a4cb-bd60ca714cfd tempest-VolumesDeleteCascade-1603786445 None] Lock "cinder-quobyte-54187d66-a898-4e03-811c-390763146335" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:16:24 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-c26fd7e4-4c9d-47be-a4cb-bd60ca714cfd tempest-VolumesDeleteCascade-1603786445 None] Acquiring lock "cinder-quobyte-ba90f54f-b24f-4afb-81ae-757ecb096dcc" by "_delete_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:16:24 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-c26fd7e4-4c9d-47be-a4cb-bd60ca714cfd tempest-VolumesDeleteCascade-1603786445 None] Lock "cinder-quobyte-ba90f54f-b24f-4afb-81ae-757ecb096dcc" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:16:24 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-c26fd7e4-4c9d-47be-a4cb-bd60ca714cfd tempest-VolumesDeleteCascade-1603786445 None] Deleting offline snapshot ba90f54f-b24f-4afb-81ae-757ecb096dcc of volume 54187d66-a898-4e03-811c-390763146335 {{(pid=86111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 29 01:16:24 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-c26fd7e4-4c9d-47be-a4cb-bd60ca714cfd tempest-VolumesDeleteCascade-1603786445 None] snapshot_file for this snap is: volume-54187d66-a898-4e03-811c-390763146335.ba90f54f-b24f-4afb-81ae-757ecb096dcc {{(pid=86111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 29 01:16:24 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[05bd13a2-4329-4a19-b12c-a887c8055346]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:16:24 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c26fd7e4-4c9d-47be-a4cb-bd60ca714cfd tempest-VolumesDeleteCascade-1603786445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-54187d66-a898-4e03-811c-390763146335.ba90f54f-b24f-4afb-81ae-757ecb096dcc {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:16:24 devstack sudo[94525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-54187d66-a898-4e03-811c-390763146335.ba90f54f-b24f-4afb-81ae-757ecb096dcc Aug 29 01:16:24 devstack sudo[94525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:16:24 devstack sudo[94525]: pam_unix(sudo:session): session closed for user root Aug 29 01:16:24 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c26fd7e4-4c9d-47be-a4cb-bd60ca714cfd tempest-VolumesDeleteCascade-1603786445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-54187d66-a898-4e03-811c-390763146335.ba90f54f-b24f-4afb-81ae-757ecb096dcc" returned: 0 in 0.428s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:16:24 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-c26fd7e4-4c9d-47be-a4cb-bd60ca714cfd tempest-VolumesDeleteCascade-1603786445 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-54187d66-a898-4e03-811c-390763146335(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 29 01:16:24 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a4f5947-0e4c-457e-bb0c-b4c5f01e537e]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:16:24 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c26fd7e4-4c9d-47be-a4cb-bd60ca714cfd tempest-VolumesDeleteCascade-1603786445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-54187d66-a898-4e03-811c-390763146335 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:16:24 devstack sudo[94552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-54187d66-a898-4e03-811c-390763146335 Aug 29 01:16:24 devstack sudo[94552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:16:25 devstack sudo[94552]: pam_unix(sudo:session): session closed for user root Aug 29 01:16:25 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c26fd7e4-4c9d-47be-a4cb-bd60ca714cfd tempest-VolumesDeleteCascade-1603786445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-54187d66-a898-4e03-811c-390763146335" returned: 0 in 0.763s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:16:25 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c26fd7e4-4c9d-47be-a4cb-bd60ca714cfd tempest-VolumesDeleteCascade-1603786445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-54187d66-a898-4e03-811c-390763146335.ba90f54f-b24f-4afb-81ae-757ecb096dcc {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:16:25 devstack sudo[94558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-54187d66-a898-4e03-811c-390763146335.ba90f54f-b24f-4afb-81ae-757ecb096dcc Aug 29 01:16:25 devstack sudo[94558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:16:26 devstack sudo[94558]: pam_unix(sudo:session): session closed for user root Aug 29 01:16:26 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c26fd7e4-4c9d-47be-a4cb-bd60ca714cfd tempest-VolumesDeleteCascade-1603786445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-54187d66-a898-4e03-811c-390763146335.ba90f54f-b24f-4afb-81ae-757ecb096dcc" returned: 0 in 0.462s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:16:26 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c26fd7e4-4c9d-47be-a4cb-bd60ca714cfd tempest-VolumesDeleteCascade-1603786445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-54187d66-a898-4e03-811c-390763146335.ba90f54f-b24f-4afb-81ae-757ecb096dcc {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:16:26 devstack sudo[94568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-54187d66-a898-4e03-811c-390763146335.ba90f54f-b24f-4afb-81ae-757ecb096dcc Aug 29 01:16:26 devstack sudo[94568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:16:26 devstack sudo[94568]: pam_unix(sudo:session): session closed for user root Aug 29 01:16:26 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c26fd7e4-4c9d-47be-a4cb-bd60ca714cfd tempest-VolumesDeleteCascade-1603786445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-54187d66-a898-4e03-811c-390763146335.ba90f54f-b24f-4afb-81ae-757ecb096dcc" returned: 0 in 0.301s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:16:26 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-c26fd7e4-4c9d-47be-a4cb-bd60ca714cfd tempest-VolumesDeleteCascade-1603786445 None] Lock "cinder-quobyte-ba90f54f-b24f-4afb-81ae-757ecb096dcc" released by "_delete_snapshot" :: held 2.101s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:16:26 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-c26fd7e4-4c9d-47be-a4cb-bd60ca714cfd tempest-VolumesDeleteCascade-1603786445 None] Lock "cinder-quobyte-54187d66-a898-4e03-811c-390763146335" released by "delete_snapshot" :: held 2.135s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:16:26 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-c26fd7e4-4c9d-47be-a4cb-bd60ca714cfd tempest-VolumesDeleteCascade-1603786445 None] Created reservations ['eb676306-ce15-423a-b52a-2a516ff786ee', 'acd8f035-1f65-49ec-b98c-f147ca93a8ac', '25aea6ee-4b81-4b5b-9de1-715792e58d06', '353852ed-5ba8-4ec1-8cf2-54aced4d1556'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:16:26 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-c26fd7e4-4c9d-47be-a4cb-bd60ca714cfd tempest-VolumesDeleteCascade-1603786445 None] Delete snapshot completed successfully. Aug 29 01:16:26 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-c26fd7e4-4c9d-47be-a4cb-bd60ca714cfd tempest-VolumesDeleteCascade-1603786445 None] Lock "cinder-ba90f54f-b24f-4afb-81ae-757ecb096dcc-delete_snapshot" released by "delete_snapshot" :: held 2.410s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:16:26 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-c26fd7e4-4c9d-47be-a4cb-bd60ca714cfd tempest-VolumesDeleteCascade-1603786445 None] Snapshots deleted, issuing volume delete {{(pid=86111) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Aug 29 01:16:26 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-c26fd7e4-4c9d-47be-a4cb-bd60ca714cfd tempest-VolumesDeleteCascade-1603786445 None] Acquiring lock "cinder-quobyte-54187d66-a898-4e03-811c-390763146335" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:16:26 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-c26fd7e4-4c9d-47be-a4cb-bd60ca714cfd tempest-VolumesDeleteCascade-1603786445 None] Lock "cinder-quobyte-54187d66-a898-4e03-811c-390763146335" acquired by "delete_volume" :: waited 0.036s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:16:26 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd8be28a-f2f8-4dc7-8e7b-cf0f44c5d7b1]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:16:26 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c26fd7e4-4c9d-47be-a4cb-bd60ca714cfd tempest-VolumesDeleteCascade-1603786445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-54187d66-a898-4e03-811c-390763146335 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:16:26 devstack sudo[94572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-54187d66-a898-4e03-811c-390763146335 Aug 29 01:16:26 devstack sudo[94572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:16:27 devstack sudo[94572]: pam_unix(sudo:session): session closed for user root Aug 29 01:16:27 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c26fd7e4-4c9d-47be-a4cb-bd60ca714cfd tempest-VolumesDeleteCascade-1603786445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-54187d66-a898-4e03-811c-390763146335" returned: 0 in 0.514s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:16:27 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c26fd7e4-4c9d-47be-a4cb-bd60ca714cfd tempest-VolumesDeleteCascade-1603786445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-54187d66-a898-4e03-811c-390763146335 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:16:27 devstack sudo[94577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-54187d66-a898-4e03-811c-390763146335 Aug 29 01:16:27 devstack sudo[94577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:16:27 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-fa1543eb-e76e-4107-b321-f6d93f096b51 tempest-AttachVolumeShelveTestJSON-1887175045 None] Acquiring lock "cinder-fa5f0ff0-374f-43b9-bb06-50056a552ad3-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:16:27 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-fa1543eb-e76e-4107-b321-f6d93f096b51 tempest-AttachVolumeShelveTestJSON-1887175045 None] Lock "cinder-fa5f0ff0-374f-43b9-bb06-50056a552ad3-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:16:27 devstack sudo[94577]: pam_unix(sudo:session): session closed for user root Aug 29 01:16:27 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-fa1543eb-e76e-4107-b321-f6d93f096b51 tempest-AttachVolumeShelveTestJSON-1887175045 None] Acquiring lock "cinder-quobyte-fa5f0ff0-374f-43b9-bb06-50056a552ad3" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:16:27 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c26fd7e4-4c9d-47be-a4cb-bd60ca714cfd tempest-VolumesDeleteCascade-1603786445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-54187d66-a898-4e03-811c-390763146335" returned: 0 in 0.595s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:16:27 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-c26fd7e4-4c9d-47be-a4cb-bd60ca714cfd tempest-VolumesDeleteCascade-1603786445 None] Lock "cinder-quobyte-54187d66-a898-4e03-811c-390763146335" released by "delete_volume" :: held 1.229s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:16:27 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-fa1543eb-e76e-4107-b321-f6d93f096b51 tempest-AttachVolumeShelveTestJSON-1887175045 None] Lock "cinder-quobyte-fa5f0ff0-374f-43b9-bb06-50056a552ad3" acquired by "delete_volume" :: waited 0.044s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:16:28 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d0b082d-7fe4-4886-9abf-b776c8dc3feb]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:16:28 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-fa1543eb-e76e-4107-b321-f6d93f096b51 tempest-AttachVolumeShelveTestJSON-1887175045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-fa5f0ff0-374f-43b9-bb06-50056a552ad3 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:16:28 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-c26fd7e4-4c9d-47be-a4cb-bd60ca714cfd tempest-VolumesDeleteCascade-1603786445 None] Created reservations ['a46a689d-f965-4e3a-9b10-bae763d7fa80', 'c1193a20-151a-4de8-ad0e-668ab237f132', '725c6fd9-1c08-4d87-86a3-cada3d3d4242', '24fd1d42-926b-4004-98da-d571b917cc84'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:16:28 devstack sudo[94584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-fa5f0ff0-374f-43b9-bb06-50056a552ad3 Aug 29 01:16:28 devstack sudo[94584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:16:28 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-c26fd7e4-4c9d-47be-a4cb-bd60ca714cfd tempest-VolumesDeleteCascade-1603786445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:16:28 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-c26fd7e4-4c9d-47be-a4cb-bd60ca714cfd tempest-VolumesDeleteCascade-1603786445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:16:28 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-c26fd7e4-4c9d-47be-a4cb-bd60ca714cfd tempest-VolumesDeleteCascade-1603786445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:16:28 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-c26fd7e4-4c9d-47be-a4cb-bd60ca714cfd tempest-VolumesDeleteCascade-1603786445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:16:28 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-c26fd7e4-4c9d-47be-a4cb-bd60ca714cfd tempest-VolumesDeleteCascade-1603786445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:16:28 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c26fd7e4-4c9d-47be-a4cb-bd60ca714cfd tempest-VolumesDeleteCascade-1603786445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:16:28 devstack sudo[94593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:16:28 devstack sudo[94593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:16:28 devstack sudo[94593]: pam_unix(sudo:session): session closed for user root Aug 29 01:16:28 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c26fd7e4-4c9d-47be-a4cb-bd60ca714cfd tempest-VolumesDeleteCascade-1603786445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.260s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:16:28 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-c26fd7e4-4c9d-47be-a4cb-bd60ca714cfd tempest-VolumesDeleteCascade-1603786445 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:16:28 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-c26fd7e4-4c9d-47be-a4cb-bd60ca714cfd tempest-VolumesDeleteCascade-1603786445 None] Deleted volume successfully. Aug 29 01:16:28 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-c26fd7e4-4c9d-47be-a4cb-bd60ca714cfd tempest-VolumesDeleteCascade-1603786445 None] Lock "cinder-54187d66-a898-4e03-811c-390763146335-delete_volume" released by "delete_volume" :: held 4.414s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:16:28 devstack sudo[94584]: pam_unix(sudo:session): session closed for user root Aug 29 01:16:28 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-fa1543eb-e76e-4107-b321-f6d93f096b51 tempest-AttachVolumeShelveTestJSON-1887175045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-fa5f0ff0-374f-43b9-bb06-50056a552ad3" returned: 0 in 0.657s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:16:28 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-fa1543eb-e76e-4107-b321-f6d93f096b51 tempest-AttachVolumeShelveTestJSON-1887175045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-fa5f0ff0-374f-43b9-bb06-50056a552ad3 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:16:28 devstack sudo[94606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-fa5f0ff0-374f-43b9-bb06-50056a552ad3 Aug 29 01:16:28 devstack sudo[94606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:16:28 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-b6c2a7bf-ca15-4ad8-8719-76c4796bf970 tempest-VolumesDeleteCascade-1603786445 None] Acquiring lock "cinder-2d5d2516-4ca9-40ae-bdf9-94c405abd15f-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:16:29 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-b6c2a7bf-ca15-4ad8-8719-76c4796bf970 tempest-VolumesDeleteCascade-1603786445 None] Lock "cinder-2d5d2516-4ca9-40ae-bdf9-94c405abd15f-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:16:29 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-b6c2a7bf-ca15-4ad8-8719-76c4796bf970 tempest-VolumesDeleteCascade-1603786445 None] Acquiring lock "cinder-quobyte-2d5d2516-4ca9-40ae-bdf9-94c405abd15f" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:16:29 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-b6c2a7bf-ca15-4ad8-8719-76c4796bf970 tempest-VolumesDeleteCascade-1603786445 None] Lock "cinder-quobyte-2d5d2516-4ca9-40ae-bdf9-94c405abd15f" acquired by "delete_volume" :: waited 0.028s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:16:29 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[d883d4fe-0803-4f23-8e18-56b5623e653a]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:16:29 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-b6c2a7bf-ca15-4ad8-8719-76c4796bf970 tempest-VolumesDeleteCascade-1603786445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-2d5d2516-4ca9-40ae-bdf9-94c405abd15f {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:16:29 devstack sudo[94606]: pam_unix(sudo:session): session closed for user root Aug 29 01:16:29 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-fa1543eb-e76e-4107-b321-f6d93f096b51 tempest-AttachVolumeShelveTestJSON-1887175045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-fa5f0ff0-374f-43b9-bb06-50056a552ad3" returned: 0 in 0.516s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:16:29 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-fa1543eb-e76e-4107-b321-f6d93f096b51 tempest-AttachVolumeShelveTestJSON-1887175045 None] Lock "cinder-quobyte-fa5f0ff0-374f-43b9-bb06-50056a552ad3" released by "delete_volume" :: held 1.263s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:16:29 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-fa1543eb-e76e-4107-b321-f6d93f096b51 tempest-AttachVolumeShelveTestJSON-1887175045 None] Created reservations ['6bfb88f3-15c8-4dc7-87d1-ad342d7d0729', '1a1940c5-613e-493b-b9c4-7fa207c7db6e', '61dcd5f7-78d7-4f67-8172-c175b51f8f0c', 'ac7fb2ee-5d99-4c6f-97f3-c4abf80dd6c5'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:16:29 devstack sudo[94609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-2d5d2516-4ca9-40ae-bdf9-94c405abd15f Aug 29 01:16:29 devstack sudo[94609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:16:29 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-fa1543eb-e76e-4107-b321-f6d93f096b51 tempest-AttachVolumeShelveTestJSON-1887175045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:16:29 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-fa1543eb-e76e-4107-b321-f6d93f096b51 tempest-AttachVolumeShelveTestJSON-1887175045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:16:29 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-fa1543eb-e76e-4107-b321-f6d93f096b51 tempest-AttachVolumeShelveTestJSON-1887175045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:16:29 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-fa1543eb-e76e-4107-b321-f6d93f096b51 tempest-AttachVolumeShelveTestJSON-1887175045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:16:29 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-fa1543eb-e76e-4107-b321-f6d93f096b51 tempest-AttachVolumeShelveTestJSON-1887175045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:16:29 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-fa1543eb-e76e-4107-b321-f6d93f096b51 tempest-AttachVolumeShelveTestJSON-1887175045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:16:29 devstack sudo[94612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:16:29 devstack sudo[94612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:16:29 devstack sudo[94612]: pam_unix(sudo:session): session closed for user root Aug 29 01:16:29 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-fa1543eb-e76e-4107-b321-f6d93f096b51 tempest-AttachVolumeShelveTestJSON-1887175045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.330s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:16:29 devstack sudo[94609]: pam_unix(sudo:session): session closed for user root Aug 29 01:16:29 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-fa1543eb-e76e-4107-b321-f6d93f096b51 tempest-AttachVolumeShelveTestJSON-1887175045 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:16:29 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-b6c2a7bf-ca15-4ad8-8719-76c4796bf970 tempest-VolumesDeleteCascade-1603786445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-2d5d2516-4ca9-40ae-bdf9-94c405abd15f" returned: 0 in 0.577s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:16:29 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-b6c2a7bf-ca15-4ad8-8719-76c4796bf970 tempest-VolumesDeleteCascade-1603786445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-2d5d2516-4ca9-40ae-bdf9-94c405abd15f {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:16:29 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-fa1543eb-e76e-4107-b321-f6d93f096b51 tempest-AttachVolumeShelveTestJSON-1887175045 None] Deleted volume successfully. Aug 29 01:16:29 devstack sudo[94618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-2d5d2516-4ca9-40ae-bdf9-94c405abd15f Aug 29 01:16:29 devstack sudo[94618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:16:29 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-fa1543eb-e76e-4107-b321-f6d93f096b51 tempest-AttachVolumeShelveTestJSON-1887175045 None] Lock "cinder-fa5f0ff0-374f-43b9-bb06-50056a552ad3-delete_volume" released by "delete_volume" :: held 1.964s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:16:30 devstack sudo[94618]: pam_unix(sudo:session): session closed for user root Aug 29 01:16:30 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-b6c2a7bf-ca15-4ad8-8719-76c4796bf970 tempest-VolumesDeleteCascade-1603786445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-2d5d2516-4ca9-40ae-bdf9-94c405abd15f" returned: 0 in 0.337s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:16:30 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-b6c2a7bf-ca15-4ad8-8719-76c4796bf970 tempest-VolumesDeleteCascade-1603786445 None] Lock "cinder-quobyte-2d5d2516-4ca9-40ae-bdf9-94c405abd15f" released by "delete_volume" :: held 0.981s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:16:30 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-b6c2a7bf-ca15-4ad8-8719-76c4796bf970 tempest-VolumesDeleteCascade-1603786445 None] Created reservations ['52b3d76d-5aa6-4a6c-8a39-3cb21f3341c2', 'caa87b04-e146-4df9-bfd7-2a05ec18a196', '45d4f0f2-6d80-4025-9a52-d644686bbfc9', '69d05847-091c-4b8c-a333-73f2e6bb431f'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:16:30 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-b6c2a7bf-ca15-4ad8-8719-76c4796bf970 tempest-VolumesDeleteCascade-1603786445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:16:30 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-b6c2a7bf-ca15-4ad8-8719-76c4796bf970 tempest-VolumesDeleteCascade-1603786445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:16:30 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-b6c2a7bf-ca15-4ad8-8719-76c4796bf970 tempest-VolumesDeleteCascade-1603786445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:16:30 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-b6c2a7bf-ca15-4ad8-8719-76c4796bf970 tempest-VolumesDeleteCascade-1603786445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:16:30 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-b6c2a7bf-ca15-4ad8-8719-76c4796bf970 tempest-VolumesDeleteCascade-1603786445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:16:30 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-b6c2a7bf-ca15-4ad8-8719-76c4796bf970 tempest-VolumesDeleteCascade-1603786445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:16:30 devstack sudo[94621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:16:30 devstack sudo[94621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:16:30 devstack sudo[94621]: pam_unix(sudo:session): session closed for user root Aug 29 01:16:30 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-b6c2a7bf-ca15-4ad8-8719-76c4796bf970 tempest-VolumesDeleteCascade-1603786445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.277s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:16:30 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-b6c2a7bf-ca15-4ad8-8719-76c4796bf970 tempest-VolumesDeleteCascade-1603786445 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:16:30 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-b6c2a7bf-ca15-4ad8-8719-76c4796bf970 tempest-VolumesDeleteCascade-1603786445 None] Deleted volume successfully. Aug 29 01:16:30 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-b6c2a7bf-ca15-4ad8-8719-76c4796bf970 tempest-VolumesDeleteCascade-1603786445 None] Lock "cinder-2d5d2516-4ca9-40ae-bdf9-94c405abd15f-delete_volume" released by "delete_volume" :: held 1.584s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:16:37 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-1af43de7-3964-4f83-b511-d4fc9ce2c81a tempest-VolumesActionsTest-258600632 None] Acquiring lock "cinder-228ce9ce-1f9a-4453-971c-8dc58400f0ec" by "attach_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:16:37 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-1af43de7-3964-4f83-b511-d4fc9ce2c81a tempest-VolumesActionsTest-258600632 None] Lock "cinder-228ce9ce-1f9a-4453-971c-8dc58400f0ec" acquired by "attach_volume" :: waited 0.032s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:16:38 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-1af43de7-3964-4f83-b511-d4fc9ce2c81a tempest-VolumesActionsTest-258600632 None] Attaching volume 228ce9ce-1f9a-4453-971c-8dc58400f0ec to instance 635fe89f-deb9-4da1-a6be-503e69c7cc7f at mountpoint /dev/vdb on host None. Aug 29 01:16:38 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-1af43de7-3964-4f83-b511-d4fc9ce2c81a tempest-VolumesActionsTest-258600632 None] Attach volume completed successfully. Aug 29 01:16:38 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-1af43de7-3964-4f83-b511-d4fc9ce2c81a tempest-VolumesActionsTest-258600632 None] Lock "cinder-228ce9ce-1f9a-4453-971c-8dc58400f0ec" released by "attach_volume" :: held 0.158s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:16:38 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-c4741ced-3496-460e-a5f3-c979e8d30e9d tempest-VolumesActionsTest-258600632 None] Acquiring lock "cinder-228ce9ce-1f9a-4453-971c-8dc58400f0ec-detach_volume" by "detach_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:16:38 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-c4741ced-3496-460e-a5f3-c979e8d30e9d tempest-VolumesActionsTest-258600632 None] Lock "cinder-228ce9ce-1f9a-4453-971c-8dc58400f0ec-detach_volume" acquired by "detach_volume" :: waited 0.031s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:16:38 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-c4741ced-3496-460e-a5f3-c979e8d30e9d tempest-VolumesActionsTest-258600632 None] Detaching volume 228ce9ce-1f9a-4453-971c-8dc58400f0ec from instance 635fe89f-deb9-4da1-a6be-503e69c7cc7f. Aug 29 01:16:38 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-c4741ced-3496-460e-a5f3-c979e8d30e9d tempest-VolumesActionsTest-258600632 None] Detach volume completed successfully. Aug 29 01:16:38 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-c4741ced-3496-460e-a5f3-c979e8d30e9d tempest-VolumesActionsTest-258600632 None] Lock "cinder-228ce9ce-1f9a-4453-971c-8dc58400f0ec-detach_volume" released by "detach_volume" :: held 0.106s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:16:38 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d533605-cbad-428f-bba4-e901044ad3b6 tempest-VolumesListTestJSON-1105003552 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:16:38 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6d533605-cbad-428f-bba4-e901044ad3b6 tempest-VolumesListTestJSON-1105003552 None] Flow 'volume_create_manager' (d38c4aaa-253c-47ed-a6c8-4f4d94a670d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:16:38 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6d533605-cbad-428f-bba4-e901044ad3b6 tempest-VolumesListTestJSON-1105003552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99ec6fdc-5467-4c6a-a86b-cadb0c950e05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:16:38 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6d533605-cbad-428f-bba4-e901044ad3b6 tempest-VolumesListTestJSON-1105003552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99ec6fdc-5467-4c6a-a86b-cadb0c950e05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:16:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1549923368',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97ab8572-c014-4f9d-91ea-3eff0cebf70d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='11e0e7805a6843d395b0851df531a59b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:16:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:16:39Z,use_quota=True,user_id='744287d5e9504eaebf7075492c930bfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:16:38 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6d533605-cbad-428f-bba4-e901044ad3b6 tempest-VolumesListTestJSON-1105003552 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84db3b3a-6f0d-4af6-8d6c-e55fd685408b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:16:38 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6d533605-cbad-428f-bba4-e901044ad3b6 tempest-VolumesListTestJSON-1105003552 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84db3b3a-6f0d-4af6-8d6c-e55fd685408b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:16:38 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6d533605-cbad-428f-bba4-e901044ad3b6 tempest-VolumesListTestJSON-1105003552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc950ab0-7938-450b-a33e-5a7223144cbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:16:38 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6d533605-cbad-428f-bba4-e901044ad3b6 tempest-VolumesListTestJSON-1105003552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc950ab0-7938-450b-a33e-5a7223144cbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97ab8572-c014-4f9d-91ea-3eff0cebf70d', 'volume_name': 'volume-97ab8572-c014-4f9d-91ea-3eff0cebf70d', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:16:38 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6d533605-cbad-428f-bba4-e901044ad3b6 tempest-VolumesListTestJSON-1105003552 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16ad44c0-ae91-47a7-b440-153f63286bf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:16:38 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6d533605-cbad-428f-bba4-e901044ad3b6 tempest-VolumesListTestJSON-1105003552 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16ad44c0-ae91-47a7-b440-153f63286bf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:16:38 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6d533605-cbad-428f-bba4-e901044ad3b6 tempest-VolumesListTestJSON-1105003552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98c1c2be-8756-4e3f-ac62-bd07dff0a463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:16:38 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-6d533605-cbad-428f-bba4-e901044ad3b6 tempest-VolumesListTestJSON-1105003552 None] Volume 97ab8572-c014-4f9d-91ea-3eff0cebf70d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97ab8572-c014-4f9d-91ea-3eff0cebf70d', 'volume_size': 1} Aug 29 01:16:38 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-6d533605-cbad-428f-bba4-e901044ad3b6 tempest-VolumesListTestJSON-1105003552 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:16:38 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-6d533605-cbad-428f-bba4-e901044ad3b6 tempest-VolumesListTestJSON-1105003552 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:16:38 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-6d533605-cbad-428f-bba4-e901044ad3b6 tempest-VolumesListTestJSON-1105003552 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:16:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1549923368',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97ab8572-c014-4f9d-91ea-3eff0cebf70d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='11e0e7805a6843d395b0851df531a59b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:16:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:16:39Z,use_quota=True,user_id='744287d5e9504eaebf7075492c930bfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:16:38 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-6d533605-cbad-428f-bba4-e901044ad3b6 tempest-VolumesListTestJSON-1105003552 None] Creating volume 97ab8572-c014-4f9d-91ea-3eff0cebf70d {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:16:38 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-6d533605-cbad-428f-bba4-e901044ad3b6 tempest-VolumesListTestJSON-1105003552 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:16:38 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-6d533605-cbad-428f-bba4-e901044ad3b6 tempest-VolumesListTestJSON-1105003552 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:16:38 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-6d533605-cbad-428f-bba4-e901044ad3b6 tempest-VolumesListTestJSON-1105003552 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:16:38 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-6d533605-cbad-428f-bba4-e901044ad3b6 tempest-VolumesListTestJSON-1105003552 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:16:38 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-6d533605-cbad-428f-bba4-e901044ad3b6 tempest-VolumesListTestJSON-1105003552 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:16:38 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-6d533605-cbad-428f-bba4-e901044ad3b6 tempest-VolumesListTestJSON-1105003552 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:16:38 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-6d533605-cbad-428f-bba4-e901044ad3b6 tempest-VolumesListTestJSON-1105003552 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:16:38 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-6d533605-cbad-428f-bba4-e901044ad3b6 tempest-VolumesListTestJSON-1105003552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-97ab8572-c014-4f9d-91ea-3eff0cebf70d 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:16:38 devstack sudo[94697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-97ab8572-c014-4f9d-91ea-3eff0cebf70d 1073741824 Aug 29 01:16:38 devstack sudo[94697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:16:39 devstack sudo[94697]: pam_unix(sudo:session): session closed for user root Aug 29 01:16:39 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-6d533605-cbad-428f-bba4-e901044ad3b6 tempest-VolumesListTestJSON-1105003552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-97ab8572-c014-4f9d-91ea-3eff0cebf70d 1073741824" returned: 0 in 0.927s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:16:39 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-6d533605-cbad-428f-bba4-e901044ad3b6 tempest-VolumesListTestJSON-1105003552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-97ab8572-c014-4f9d-91ea-3eff0cebf70d {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:16:39 devstack sudo[94723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-97ab8572-c014-4f9d-91ea-3eff0cebf70d Aug 29 01:16:39 devstack sudo[94723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:16:40 devstack sudo[94723]: pam_unix(sudo:session): session closed for user root Aug 29 01:16:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-6d533605-cbad-428f-bba4-e901044ad3b6 tempest-VolumesListTestJSON-1105003552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-97ab8572-c014-4f9d-91ea-3eff0cebf70d" returned: 0 in 0.407s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:16:40 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-6d533605-cbad-428f-bba4-e901044ad3b6 tempest-VolumesListTestJSON-1105003552 None] <== create_volume: return (1403ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:16:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-6d533605-cbad-428f-bba4-e901044ad3b6 tempest-VolumesListTestJSON-1105003552 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.406s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:16:40 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6d533605-cbad-428f-bba4-e901044ad3b6 tempest-VolumesListTestJSON-1105003552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98c1c2be-8756-4e3f-ac62-bd07dff0a463) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97ab8572-c014-4f9d-91ea-3eff0cebf70d', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:16:40 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6d533605-cbad-428f-bba4-e901044ad3b6 tempest-VolumesListTestJSON-1105003552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7093f3ed-1990-4908-88d4-130818434d92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:16:40 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-6d533605-cbad-428f-bba4-e901044ad3b6 tempest-VolumesListTestJSON-1105003552 None] Volume volume-97ab8572-c014-4f9d-91ea-3eff0cebf70d (97ab8572-c014-4f9d-91ea-3eff0cebf70d): created successfully Aug 29 01:16:40 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6d533605-cbad-428f-bba4-e901044ad3b6 tempest-VolumesListTestJSON-1105003552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7093f3ed-1990-4908-88d4-130818434d92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:16:40 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6d533605-cbad-428f-bba4-e901044ad3b6 tempest-VolumesListTestJSON-1105003552 None] Flow 'volume_create_manager' (d38c4aaa-253c-47ed-a6c8-4f4d94a670d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:16:40 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-6d533605-cbad-428f-bba4-e901044ad3b6 tempest-VolumesListTestJSON-1105003552 None] Created volume successfully. Aug 29 01:16:40 devstack cinder-volume[86111]: DEBUG oslo_service.periodic_task [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86111) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 29 01:16:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:16:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:16:40 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:16:40 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:16:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:16:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:16:40 devstack sudo[94728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:16:40 devstack sudo[94728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:16:41 devstack sudo[94728]: pam_unix(sudo:session): session closed for user root Aug 29 01:16:41 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-de752545-d617-440e-8362-d04fae0901a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.436s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:16:41 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:16:41 devstack cinder-volume[86111]: DEBUG oslo_service.periodic_task [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Running periodic task VolumeManager._thread_info {{(pid=86111) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 29 01:16:41 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-de752545-d617-440e-8362-d04fae0901a5 None None] thread count: 28 {{(pid=86111) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 29 01:16:41 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-de752545-d617-440e-8362-d04fae0901a5 None None] thread info: [<_MainThread(MainThread, started 129173440548992)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86111) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 29 01:16:41 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7cd0e08-7435-402f-800c-c620c9cff7ea tempest-VolumesListTestJSON-1105003552 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:16:41 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-b7cd0e08-7435-402f-800c-c620c9cff7ea tempest-VolumesListTestJSON-1105003552 None] Flow 'volume_create_manager' (3c798378-2d8b-4bca-9d00-cbd434b1b12d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:16:41 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-b7cd0e08-7435-402f-800c-c620c9cff7ea tempest-VolumesListTestJSON-1105003552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66c6169f-f209-4780-8b13-e6db8b7ab393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:16:41 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-b7cd0e08-7435-402f-800c-c620c9cff7ea tempest-VolumesListTestJSON-1105003552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66c6169f-f209-4780-8b13-e6db8b7ab393) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:16:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-711992804',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07143835-563f-4e9a-aa18-cf013aaf085a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='11e0e7805a6843d395b0851df531a59b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:16:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:16:41Z,use_quota=True,user_id='744287d5e9504eaebf7075492c930bfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:16:41 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-b7cd0e08-7435-402f-800c-c620c9cff7ea tempest-VolumesListTestJSON-1105003552 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca3e1331-f7cf-4690-9875-a795906de616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:16:41 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-b7cd0e08-7435-402f-800c-c620c9cff7ea tempest-VolumesListTestJSON-1105003552 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca3e1331-f7cf-4690-9875-a795906de616) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:16:41 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-b7cd0e08-7435-402f-800c-c620c9cff7ea tempest-VolumesListTestJSON-1105003552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93dd4591-35a7-4b7b-a120-1cc8f457b707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:16:41 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-b7cd0e08-7435-402f-800c-c620c9cff7ea tempest-VolumesListTestJSON-1105003552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93dd4591-35a7-4b7b-a120-1cc8f457b707) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07143835-563f-4e9a-aa18-cf013aaf085a', 'volume_name': 'volume-07143835-563f-4e9a-aa18-cf013aaf085a', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:16:41 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-b7cd0e08-7435-402f-800c-c620c9cff7ea tempest-VolumesListTestJSON-1105003552 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ea6a11e-f8b4-4f33-842e-947dfda90089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:16:41 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-b7cd0e08-7435-402f-800c-c620c9cff7ea tempest-VolumesListTestJSON-1105003552 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ea6a11e-f8b4-4f33-842e-947dfda90089) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:16:41 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-b7cd0e08-7435-402f-800c-c620c9cff7ea tempest-VolumesListTestJSON-1105003552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b27f979c-f76c-4130-b9b5-4d81cebc657e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:16:41 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-b7cd0e08-7435-402f-800c-c620c9cff7ea tempest-VolumesListTestJSON-1105003552 None] Volume 07143835-563f-4e9a-aa18-cf013aaf085a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07143835-563f-4e9a-aa18-cf013aaf085a', 'volume_size': 1} Aug 29 01:16:41 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-b7cd0e08-7435-402f-800c-c620c9cff7ea tempest-VolumesListTestJSON-1105003552 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:16:41 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-b7cd0e08-7435-402f-800c-c620c9cff7ea tempest-VolumesListTestJSON-1105003552 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:16:41 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-b7cd0e08-7435-402f-800c-c620c9cff7ea tempest-VolumesListTestJSON-1105003552 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:16:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-711992804',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07143835-563f-4e9a-aa18-cf013aaf085a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='11e0e7805a6843d395b0851df531a59b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:16:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:16:41Z,use_quota=True,user_id='744287d5e9504eaebf7075492c930bfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:16:41 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-b7cd0e08-7435-402f-800c-c620c9cff7ea tempest-VolumesListTestJSON-1105003552 None] Creating volume 07143835-563f-4e9a-aa18-cf013aaf085a {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:16:41 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-b7cd0e08-7435-402f-800c-c620c9cff7ea tempest-VolumesListTestJSON-1105003552 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:16:41 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-b7cd0e08-7435-402f-800c-c620c9cff7ea tempest-VolumesListTestJSON-1105003552 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:16:41 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-b7cd0e08-7435-402f-800c-c620c9cff7ea tempest-VolumesListTestJSON-1105003552 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:16:41 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-b7cd0e08-7435-402f-800c-c620c9cff7ea tempest-VolumesListTestJSON-1105003552 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:16:41 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-b7cd0e08-7435-402f-800c-c620c9cff7ea tempest-VolumesListTestJSON-1105003552 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:16:41 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-b7cd0e08-7435-402f-800c-c620c9cff7ea tempest-VolumesListTestJSON-1105003552 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:16:41 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-b7cd0e08-7435-402f-800c-c620c9cff7ea tempest-VolumesListTestJSON-1105003552 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:16:41 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-b7cd0e08-7435-402f-800c-c620c9cff7ea tempest-VolumesListTestJSON-1105003552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-07143835-563f-4e9a-aa18-cf013aaf085a 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:16:41 devstack sudo[94731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-07143835-563f-4e9a-aa18-cf013aaf085a 1073741824 Aug 29 01:16:41 devstack sudo[94731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:16:42 devstack sudo[94731]: pam_unix(sudo:session): session closed for user root Aug 29 01:16:42 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-b7cd0e08-7435-402f-800c-c620c9cff7ea tempest-VolumesListTestJSON-1105003552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-07143835-563f-4e9a-aa18-cf013aaf085a 1073741824" returned: 0 in 0.678s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:16:42 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-b7cd0e08-7435-402f-800c-c620c9cff7ea tempest-VolumesListTestJSON-1105003552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-07143835-563f-4e9a-aa18-cf013aaf085a {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:16:42 devstack sudo[94736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-07143835-563f-4e9a-aa18-cf013aaf085a Aug 29 01:16:42 devstack sudo[94736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:16:42 devstack sudo[94736]: pam_unix(sudo:session): session closed for user root Aug 29 01:16:42 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-b7cd0e08-7435-402f-800c-c620c9cff7ea tempest-VolumesListTestJSON-1105003552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-07143835-563f-4e9a-aa18-cf013aaf085a" returned: 0 in 0.323s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:16:42 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-b7cd0e08-7435-402f-800c-c620c9cff7ea tempest-VolumesListTestJSON-1105003552 None] <== create_volume: return (1061ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:16:42 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-b7cd0e08-7435-402f-800c-c620c9cff7ea tempest-VolumesListTestJSON-1105003552 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.063s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:16:42 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-b7cd0e08-7435-402f-800c-c620c9cff7ea tempest-VolumesListTestJSON-1105003552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b27f979c-f76c-4130-b9b5-4d81cebc657e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07143835-563f-4e9a-aa18-cf013aaf085a', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:16:42 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-b7cd0e08-7435-402f-800c-c620c9cff7ea tempest-VolumesListTestJSON-1105003552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca248480-bc3c-4daf-96a7-a2308b3d6010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:16:42 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-b7cd0e08-7435-402f-800c-c620c9cff7ea tempest-VolumesListTestJSON-1105003552 None] Volume volume-07143835-563f-4e9a-aa18-cf013aaf085a (07143835-563f-4e9a-aa18-cf013aaf085a): created successfully Aug 29 01:16:42 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-b7cd0e08-7435-402f-800c-c620c9cff7ea tempest-VolumesListTestJSON-1105003552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca248480-bc3c-4daf-96a7-a2308b3d6010) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:16:42 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-b7cd0e08-7435-402f-800c-c620c9cff7ea tempest-VolumesListTestJSON-1105003552 None] Flow 'volume_create_manager' (3c798378-2d8b-4bca-9d00-cbd434b1b12d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:16:42 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-b7cd0e08-7435-402f-800c-c620c9cff7ea tempest-VolumesListTestJSON-1105003552 None] Created volume successfully. Aug 29 01:16:43 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [req-58798cc3-c0ca-4170-b7b1-61e3dac989e1 req-514593a7-24f4-466e-8288-014f94ebcaea tempest-VolumesGetTestJSON-317835317 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:16:43 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [req-58798cc3-c0ca-4170-b7b1-61e3dac989e1 req-514593a7-24f4-466e-8288-014f94ebcaea tempest-VolumesGetTestJSON-317835317 None] Flow 'volume_create_manager' (f655ee4d-60df-4422-b067-582ea42f0db7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:16:43 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [req-58798cc3-c0ca-4170-b7b1-61e3dac989e1 req-514593a7-24f4-466e-8288-014f94ebcaea tempest-VolumesGetTestJSON-317835317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd184c07-8c7f-4609-b553-43e3d1604bca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:16:43 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [req-58798cc3-c0ca-4170-b7b1-61e3dac989e1 req-514593a7-24f4-466e-8288-014f94ebcaea tempest-VolumesGetTestJSON-317835317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd184c07-8c7f-4609-b553-43e3d1604bca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:16:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1293381149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85aba7d8-3e29-4003-b9dd-b12695b14cdb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f932340ce861487d95a11053e9637e52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:16:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:16:43Z,use_quota=True,user_id='ce6b166d6ba2420dbbf43144a13a1086',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:16:43 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [req-58798cc3-c0ca-4170-b7b1-61e3dac989e1 req-514593a7-24f4-466e-8288-014f94ebcaea tempest-VolumesGetTestJSON-317835317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (435bf601-7591-4c5a-96e9-3673e324343d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:16:43 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [req-58798cc3-c0ca-4170-b7b1-61e3dac989e1 req-514593a7-24f4-466e-8288-014f94ebcaea tempest-VolumesGetTestJSON-317835317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (435bf601-7591-4c5a-96e9-3673e324343d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:16:43 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [req-58798cc3-c0ca-4170-b7b1-61e3dac989e1 req-514593a7-24f4-466e-8288-014f94ebcaea tempest-VolumesGetTestJSON-317835317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9856d594-1f38-4cf9-bd9e-7565a8e68353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:16:43 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [req-58798cc3-c0ca-4170-b7b1-61e3dac989e1 req-514593a7-24f4-466e-8288-014f94ebcaea tempest-VolumesGetTestJSON-317835317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9856d594-1f38-4cf9-bd9e-7565a8e68353) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85aba7d8-3e29-4003-b9dd-b12695b14cdb', 'volume_name': 'volume-85aba7d8-3e29-4003-b9dd-b12695b14cdb', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:16:43 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [req-58798cc3-c0ca-4170-b7b1-61e3dac989e1 req-514593a7-24f4-466e-8288-014f94ebcaea tempest-VolumesGetTestJSON-317835317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2b3e9ee-b5f6-4c20-b51b-b9ade2519cf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:16:43 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [req-58798cc3-c0ca-4170-b7b1-61e3dac989e1 req-514593a7-24f4-466e-8288-014f94ebcaea tempest-VolumesGetTestJSON-317835317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2b3e9ee-b5f6-4c20-b51b-b9ade2519cf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:16:43 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [req-58798cc3-c0ca-4170-b7b1-61e3dac989e1 req-514593a7-24f4-466e-8288-014f94ebcaea tempest-VolumesGetTestJSON-317835317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89aa725b-34f4-4d59-8a7c-af8786fa425b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:16:43 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [req-58798cc3-c0ca-4170-b7b1-61e3dac989e1 req-514593a7-24f4-466e-8288-014f94ebcaea tempest-VolumesGetTestJSON-317835317 None] Volume 85aba7d8-3e29-4003-b9dd-b12695b14cdb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85aba7d8-3e29-4003-b9dd-b12695b14cdb', 'volume_size': 1} Aug 29 01:16:43 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [req-58798cc3-c0ca-4170-b7b1-61e3dac989e1 req-514593a7-24f4-466e-8288-014f94ebcaea tempest-VolumesGetTestJSON-317835317 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:16:43 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [req-58798cc3-c0ca-4170-b7b1-61e3dac989e1 req-514593a7-24f4-466e-8288-014f94ebcaea tempest-VolumesGetTestJSON-317835317 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:16:43 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [req-58798cc3-c0ca-4170-b7b1-61e3dac989e1 req-514593a7-24f4-466e-8288-014f94ebcaea tempest-VolumesGetTestJSON-317835317 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:16:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1293381149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85aba7d8-3e29-4003-b9dd-b12695b14cdb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f932340ce861487d95a11053e9637e52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:16:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:16:43Z,use_quota=True,user_id='ce6b166d6ba2420dbbf43144a13a1086',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:16:43 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [req-58798cc3-c0ca-4170-b7b1-61e3dac989e1 req-514593a7-24f4-466e-8288-014f94ebcaea tempest-VolumesGetTestJSON-317835317 None] Creating volume 85aba7d8-3e29-4003-b9dd-b12695b14cdb {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:16:43 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [req-58798cc3-c0ca-4170-b7b1-61e3dac989e1 req-514593a7-24f4-466e-8288-014f94ebcaea tempest-VolumesGetTestJSON-317835317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:16:43 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [req-58798cc3-c0ca-4170-b7b1-61e3dac989e1 req-514593a7-24f4-466e-8288-014f94ebcaea tempest-VolumesGetTestJSON-317835317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:16:43 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [req-58798cc3-c0ca-4170-b7b1-61e3dac989e1 req-514593a7-24f4-466e-8288-014f94ebcaea tempest-VolumesGetTestJSON-317835317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:16:43 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [req-58798cc3-c0ca-4170-b7b1-61e3dac989e1 req-514593a7-24f4-466e-8288-014f94ebcaea tempest-VolumesGetTestJSON-317835317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:16:43 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [req-58798cc3-c0ca-4170-b7b1-61e3dac989e1 req-514593a7-24f4-466e-8288-014f94ebcaea tempest-VolumesGetTestJSON-317835317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:16:43 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [req-58798cc3-c0ca-4170-b7b1-61e3dac989e1 req-514593a7-24f4-466e-8288-014f94ebcaea tempest-VolumesGetTestJSON-317835317 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:16:43 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [req-58798cc3-c0ca-4170-b7b1-61e3dac989e1 req-514593a7-24f4-466e-8288-014f94ebcaea tempest-VolumesGetTestJSON-317835317 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:16:43 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [req-58798cc3-c0ca-4170-b7b1-61e3dac989e1 req-514593a7-24f4-466e-8288-014f94ebcaea tempest-VolumesGetTestJSON-317835317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-85aba7d8-3e29-4003-b9dd-b12695b14cdb 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:16:43 devstack sudo[94739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-85aba7d8-3e29-4003-b9dd-b12695b14cdb 1073741824 Aug 29 01:16:43 devstack sudo[94739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:16:43 devstack sudo[94739]: pam_unix(sudo:session): session closed for user root Aug 29 01:16:43 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [req-58798cc3-c0ca-4170-b7b1-61e3dac989e1 req-514593a7-24f4-466e-8288-014f94ebcaea tempest-VolumesGetTestJSON-317835317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-85aba7d8-3e29-4003-b9dd-b12695b14cdb 1073741824" returned: 0 in 0.558s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:16:43 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [req-58798cc3-c0ca-4170-b7b1-61e3dac989e1 req-514593a7-24f4-466e-8288-014f94ebcaea tempest-VolumesGetTestJSON-317835317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-85aba7d8-3e29-4003-b9dd-b12695b14cdb {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:16:43 devstack sudo[94745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-85aba7d8-3e29-4003-b9dd-b12695b14cdb Aug 29 01:16:43 devstack sudo[94745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:16:44 devstack sudo[94745]: pam_unix(sudo:session): session closed for user root Aug 29 01:16:44 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [req-58798cc3-c0ca-4170-b7b1-61e3dac989e1 req-514593a7-24f4-466e-8288-014f94ebcaea tempest-VolumesGetTestJSON-317835317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-85aba7d8-3e29-4003-b9dd-b12695b14cdb" returned: 0 in 0.327s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:16:44 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [req-58798cc3-c0ca-4170-b7b1-61e3dac989e1 req-514593a7-24f4-466e-8288-014f94ebcaea tempest-VolumesGetTestJSON-317835317 None] <== create_volume: return (942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:16:44 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [req-58798cc3-c0ca-4170-b7b1-61e3dac989e1 req-514593a7-24f4-466e-8288-014f94ebcaea tempest-VolumesGetTestJSON-317835317 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.946s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:16:44 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [req-58798cc3-c0ca-4170-b7b1-61e3dac989e1 req-514593a7-24f4-466e-8288-014f94ebcaea tempest-VolumesGetTestJSON-317835317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89aa725b-34f4-4d59-8a7c-af8786fa425b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85aba7d8-3e29-4003-b9dd-b12695b14cdb', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:16:44 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [req-58798cc3-c0ca-4170-b7b1-61e3dac989e1 req-514593a7-24f4-466e-8288-014f94ebcaea tempest-VolumesGetTestJSON-317835317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b3ef8d8-88dc-4920-9af1-ec6c090fc888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:16:44 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [req-58798cc3-c0ca-4170-b7b1-61e3dac989e1 req-514593a7-24f4-466e-8288-014f94ebcaea tempest-VolumesGetTestJSON-317835317 None] Volume volume-85aba7d8-3e29-4003-b9dd-b12695b14cdb (85aba7d8-3e29-4003-b9dd-b12695b14cdb): created successfully Aug 29 01:16:44 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [req-58798cc3-c0ca-4170-b7b1-61e3dac989e1 req-514593a7-24f4-466e-8288-014f94ebcaea tempest-VolumesGetTestJSON-317835317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b3ef8d8-88dc-4920-9af1-ec6c090fc888) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:16:44 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [req-58798cc3-c0ca-4170-b7b1-61e3dac989e1 req-514593a7-24f4-466e-8288-014f94ebcaea tempest-VolumesGetTestJSON-317835317 None] Flow 'volume_create_manager' (f655ee4d-60df-4422-b067-582ea42f0db7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:16:44 devstack cinder-volume[86111]: INFO cinder.volume.manager [req-58798cc3-c0ca-4170-b7b1-61e3dac989e1 req-514593a7-24f4-466e-8288-014f94ebcaea tempest-VolumesGetTestJSON-317835317 None] Created volume successfully. Aug 29 01:16:44 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-d46e7f51-f98c-473e-84d6-0146d37f79a9 tempest-VolumesActionsTest-258600632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:16:44 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-d46e7f51-f98c-473e-84d6-0146d37f79a9 tempest-VolumesActionsTest-258600632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.002s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:16:44 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[467acd44-5160-4f2d-88a5-3739fbaadf9c]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:16:44 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d46e7f51-f98c-473e-84d6-0146d37f79a9 tempest-VolumesActionsTest-258600632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-228ce9ce-1f9a-4453-971c-8dc58400f0ec {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:16:44 devstack sudo[94748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-228ce9ce-1f9a-4453-971c-8dc58400f0ec Aug 29 01:16:44 devstack sudo[94748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:16:44 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-95bb2096-63ee-47ca-b7ef-ca871272374a tempest-VolumesListTestJSON-1105003552 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:16:44 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-95bb2096-63ee-47ca-b7ef-ca871272374a tempest-VolumesListTestJSON-1105003552 None] Flow 'volume_create_manager' (329da024-e9a5-42e9-8f4f-e7f6622809a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:16:44 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-95bb2096-63ee-47ca-b7ef-ca871272374a tempest-VolumesListTestJSON-1105003552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1777b929-db1b-4f5d-b9c6-e71e8dc4763a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:16:44 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-95bb2096-63ee-47ca-b7ef-ca871272374a tempest-VolumesListTestJSON-1105003552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1777b929-db1b-4f5d-b9c6-e71e8dc4763a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:16:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1948118011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=398f2381-a82f-4403-829b-5a6b27b16bb3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='11e0e7805a6843d395b0851df531a59b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:16:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:16:44Z,use_quota=True,user_id='744287d5e9504eaebf7075492c930bfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:16:44 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-95bb2096-63ee-47ca-b7ef-ca871272374a tempest-VolumesListTestJSON-1105003552 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8d837a0-d5e9-4655-8c2f-e45c7257a7fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:16:44 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-95bb2096-63ee-47ca-b7ef-ca871272374a tempest-VolumesListTestJSON-1105003552 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8d837a0-d5e9-4655-8c2f-e45c7257a7fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:16:44 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-95bb2096-63ee-47ca-b7ef-ca871272374a tempest-VolumesListTestJSON-1105003552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04f8f789-3b4d-49a0-804b-9ee8dbedd8a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:16:44 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-95bb2096-63ee-47ca-b7ef-ca871272374a tempest-VolumesListTestJSON-1105003552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04f8f789-3b4d-49a0-804b-9ee8dbedd8a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '398f2381-a82f-4403-829b-5a6b27b16bb3', 'volume_name': 'volume-398f2381-a82f-4403-829b-5a6b27b16bb3', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:16:44 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-95bb2096-63ee-47ca-b7ef-ca871272374a tempest-VolumesListTestJSON-1105003552 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d89510b2-fb6c-4bec-b2e5-0f1112c76497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:16:44 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-95bb2096-63ee-47ca-b7ef-ca871272374a tempest-VolumesListTestJSON-1105003552 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d89510b2-fb6c-4bec-b2e5-0f1112c76497) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:16:44 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-95bb2096-63ee-47ca-b7ef-ca871272374a tempest-VolumesListTestJSON-1105003552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e110b54a-aef7-4f8d-afae-e7dbec3ca4c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:16:44 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-95bb2096-63ee-47ca-b7ef-ca871272374a tempest-VolumesListTestJSON-1105003552 None] Volume 398f2381-a82f-4403-829b-5a6b27b16bb3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-398f2381-a82f-4403-829b-5a6b27b16bb3', 'volume_size': 1} Aug 29 01:16:44 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-95bb2096-63ee-47ca-b7ef-ca871272374a tempest-VolumesListTestJSON-1105003552 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:16:44 devstack cinder-volume[86111]: DEBUG cinder.coordination [req-3035c7a8-f5d7-46e2-8729-849bc453258f req-9dc0b2f2-e02b-4002-9532-3359e83eb136 tempest-VolumesGetTestJSON-317835317 None] Acquiring lock "cinder-85aba7d8-3e29-4003-b9dd-b12695b14cdb-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:16:44 devstack cinder-volume[86111]: DEBUG cinder.coordination [req-3035c7a8-f5d7-46e2-8729-849bc453258f req-9dc0b2f2-e02b-4002-9532-3359e83eb136 tempest-VolumesGetTestJSON-317835317 None] Lock "cinder-85aba7d8-3e29-4003-b9dd-b12695b14cdb-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:16:44 devstack cinder-volume[86111]: DEBUG cinder.coordination [req-3035c7a8-f5d7-46e2-8729-849bc453258f req-9dc0b2f2-e02b-4002-9532-3359e83eb136 tempest-VolumesGetTestJSON-317835317 None] Acquiring lock "cinder-quobyte-85aba7d8-3e29-4003-b9dd-b12695b14cdb" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:16:44 devstack cinder-volume[86111]: DEBUG cinder.coordination [req-3035c7a8-f5d7-46e2-8729-849bc453258f req-9dc0b2f2-e02b-4002-9532-3359e83eb136 tempest-VolumesGetTestJSON-317835317 None] Lock "cinder-quobyte-85aba7d8-3e29-4003-b9dd-b12695b14cdb" acquired by "delete_volume" :: waited 0.030s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:16:44 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd3c1e52-3a71-4cc7-b08b-7ecfb893b6d1]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:16:44 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [req-3035c7a8-f5d7-46e2-8729-849bc453258f req-9dc0b2f2-e02b-4002-9532-3359e83eb136 tempest-VolumesGetTestJSON-317835317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-85aba7d8-3e29-4003-b9dd-b12695b14cdb {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:16:44 devstack sudo[94748]: pam_unix(sudo:session): session closed for user root Aug 29 01:16:44 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d46e7f51-f98c-473e-84d6-0146d37f79a9 tempest-VolumesActionsTest-258600632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-228ce9ce-1f9a-4453-971c-8dc58400f0ec" returned: 0 in 0.603s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:16:44 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[f51d8ed9-a3c5-47b3-b293-c9fd08b1d60c]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:16:44 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d46e7f51-f98c-473e-84d6-0146d37f79a9 tempest-VolumesActionsTest-258600632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-228ce9ce-1f9a-4453-971c-8dc58400f0ec {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:16:44 devstack sudo[94750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-85aba7d8-3e29-4003-b9dd-b12695b14cdb Aug 29 01:16:44 devstack sudo[94750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:16:45 devstack sudo[94756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-228ce9ce-1f9a-4453-971c-8dc58400f0ec Aug 29 01:16:45 devstack sudo[94756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:16:45 devstack sudo[94750]: pam_unix(sudo:session): session closed for user root Aug 29 01:16:45 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [req-3035c7a8-f5d7-46e2-8729-849bc453258f req-9dc0b2f2-e02b-4002-9532-3359e83eb136 tempest-VolumesGetTestJSON-317835317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-85aba7d8-3e29-4003-b9dd-b12695b14cdb" returned: 0 in 0.614s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:16:45 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [req-3035c7a8-f5d7-46e2-8729-849bc453258f req-9dc0b2f2-e02b-4002-9532-3359e83eb136 tempest-VolumesGetTestJSON-317835317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-85aba7d8-3e29-4003-b9dd-b12695b14cdb {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:16:45 devstack sudo[94764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-85aba7d8-3e29-4003-b9dd-b12695b14cdb Aug 29 01:16:45 devstack sudo[94764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:16:45 devstack sudo[94756]: pam_unix(sudo:session): session closed for user root Aug 29 01:16:45 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d46e7f51-f98c-473e-84d6-0146d37f79a9 tempest-VolumesActionsTest-258600632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-228ce9ce-1f9a-4453-971c-8dc58400f0ec" returned: 0 in 0.566s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:16:45 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d46e7f51-f98c-473e-84d6-0146d37f79a9 tempest-VolumesActionsTest-258600632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-228ce9ce-1f9a-4453-971c-8dc58400f0ec /opt/stack/data/cinder/conversion/228ce9ce-1f9a-4453-971c-8dc58400f0ec.temp_image.a0a966d1-9c74-4504-8912-f81e56824243n76xfdw9.img {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:16:45 devstack sudo[94768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-228ce9ce-1f9a-4453-971c-8dc58400f0ec /opt/stack/data/cinder/conversion/228ce9ce-1f9a-4453-971c-8dc58400f0ec.temp_image.a0a966d1-9c74-4504-8912-f81e56824243n76xfdw9.img Aug 29 01:16:45 devstack sudo[94768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:16:45 devstack sudo[94764]: pam_unix(sudo:session): session closed for user root Aug 29 01:16:45 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [req-3035c7a8-f5d7-46e2-8729-849bc453258f req-9dc0b2f2-e02b-4002-9532-3359e83eb136 tempest-VolumesGetTestJSON-317835317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-85aba7d8-3e29-4003-b9dd-b12695b14cdb" returned: 0 in 0.272s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:16:45 devstack cinder-volume[86111]: DEBUG cinder.coordination [req-3035c7a8-f5d7-46e2-8729-849bc453258f req-9dc0b2f2-e02b-4002-9532-3359e83eb136 tempest-VolumesGetTestJSON-317835317 None] Lock "cinder-quobyte-85aba7d8-3e29-4003-b9dd-b12695b14cdb" released by "delete_volume" :: held 0.972s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:16:45 devstack cinder-volume[86111]: DEBUG cinder.quota [req-3035c7a8-f5d7-46e2-8729-849bc453258f req-9dc0b2f2-e02b-4002-9532-3359e83eb136 tempest-VolumesGetTestJSON-317835317 None] Created reservations ['96d14410-5e70-4e82-81fa-3e1c3e8d1927', '5cd3a223-a6cb-4b8d-bc1b-189db27a98be', '4285bd12-dc7b-49a4-b430-6ec2db14835e', '7ffe42a4-9212-4873-82e6-58e1302fcecc'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:16:45 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [req-3035c7a8-f5d7-46e2-8729-849bc453258f req-9dc0b2f2-e02b-4002-9532-3359e83eb136 tempest-VolumesGetTestJSON-317835317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:16:45 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [req-3035c7a8-f5d7-46e2-8729-849bc453258f req-9dc0b2f2-e02b-4002-9532-3359e83eb136 tempest-VolumesGetTestJSON-317835317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:16:45 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [req-3035c7a8-f5d7-46e2-8729-849bc453258f req-9dc0b2f2-e02b-4002-9532-3359e83eb136 tempest-VolumesGetTestJSON-317835317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:16:45 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [req-3035c7a8-f5d7-46e2-8729-849bc453258f req-9dc0b2f2-e02b-4002-9532-3359e83eb136 tempest-VolumesGetTestJSON-317835317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:16:45 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [req-3035c7a8-f5d7-46e2-8729-849bc453258f req-9dc0b2f2-e02b-4002-9532-3359e83eb136 tempest-VolumesGetTestJSON-317835317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:16:45 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [req-3035c7a8-f5d7-46e2-8729-849bc453258f req-9dc0b2f2-e02b-4002-9532-3359e83eb136 tempest-VolumesGetTestJSON-317835317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:16:45 devstack sudo[94781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:16:45 devstack sudo[94781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:16:46 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [req-3035c7a8-f5d7-46e2-8729-849bc453258f req-9dc0b2f2-e02b-4002-9532-3359e83eb136 tempest-VolumesGetTestJSON-317835317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.656s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:16:46 devstack sudo[94781]: pam_unix(sudo:session): session closed for user root Aug 29 01:16:46 devstack cinder-volume[86111]: DEBUG cinder.manager [req-3035c7a8-f5d7-46e2-8729-849bc453258f req-9dc0b2f2-e02b-4002-9532-3359e83eb136 tempest-VolumesGetTestJSON-317835317 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:16:46 devstack cinder-volume[86111]: INFO cinder.volume.manager [req-3035c7a8-f5d7-46e2-8729-849bc453258f req-9dc0b2f2-e02b-4002-9532-3359e83eb136 tempest-VolumesGetTestJSON-317835317 None] Deleted volume successfully. Aug 29 01:16:46 devstack cinder-volume[86111]: DEBUG cinder.coordination [req-3035c7a8-f5d7-46e2-8729-849bc453258f req-9dc0b2f2-e02b-4002-9532-3359e83eb136 tempest-VolumesGetTestJSON-317835317 None] Lock "cinder-85aba7d8-3e29-4003-b9dd-b12695b14cdb-delete_volume" released by "delete_volume" :: held 1.945s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:16:50 devstack sudo[94768]: pam_unix(sudo:session): session closed for user root Aug 29 01:16:50 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d46e7f51-f98c-473e-84d6-0146d37f79a9 tempest-VolumesActionsTest-258600632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-228ce9ce-1f9a-4453-971c-8dc58400f0ec /opt/stack/data/cinder/conversion/228ce9ce-1f9a-4453-971c-8dc58400f0ec.temp_image.a0a966d1-9c74-4504-8912-f81e56824243n76xfdw9.img" returned: 0 in 5.530s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:16:50 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[09b0588b-f6c5-4d4b-8ef2-f15d5678f67f]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:16:50 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d46e7f51-f98c-473e-84d6-0146d37f79a9 tempest-VolumesActionsTest-258600632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-228ce9ce-1f9a-4453-971c-8dc58400f0ec {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:16:51 devstack sudo[94786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-228ce9ce-1f9a-4453-971c-8dc58400f0ec Aug 29 01:16:51 devstack sudo[94786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:16:51 devstack sudo[94786]: pam_unix(sudo:session): session closed for user root Aug 29 01:16:51 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d46e7f51-f98c-473e-84d6-0146d37f79a9 tempest-VolumesActionsTest-258600632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-228ce9ce-1f9a-4453-971c-8dc58400f0ec" returned: 0 in 0.806s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:16:51 devstack cinder-volume[86111]: DEBUG cinder.image.image_utils [None req-d46e7f51-f98c-473e-84d6-0146d37f79a9 tempest-VolumesActionsTest-258600632 None] Image conversion details: src /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-228ce9ce-1f9a-4453-971c-8dc58400f0ec, size 1024.00 MB, duration 5.53 sec, destination /opt/stack/data/cinder/conversion/228ce9ce-1f9a-4453-971c-8dc58400f0ec.temp_image.a0a966d1-9c74-4504-8912-f81e56824243n76xfdw9.img {{(pid=86111) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 29 01:16:51 devstack cinder-volume[86111]: INFO cinder.image.image_utils [None req-d46e7f51-f98c-473e-84d6-0146d37f79a9 tempest-VolumesActionsTest-258600632 None] Converted 1024.00 MB image at 185.14 MB/s Aug 29 01:16:51 devstack cinder-volume[86111]: DEBUG cinder.image.image_utils [None req-d46e7f51-f98c-473e-84d6-0146d37f79a9 tempest-VolumesActionsTest-258600632 None] a0a966d1-9c74-4504-8912-f81e56824243 was raw, no need to convert to raw {{(pid=86111) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Aug 29 01:16:59 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-735b25b4-1286-4f79-8813-c8ac83dd75b1 tempest-GroupsV314Test-1886998862 None] Group tempest-GroupsV314Test-Group-324767223: creating Aug 29 01:16:59 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-735b25b4-1286-4f79-8813-c8ac83dd75b1 tempest-GroupsV314Test-1886998862 None] Group tempest-GroupsV314Test-Group-324767223: created successfully Aug 29 01:16:59 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-735b25b4-1286-4f79-8813-c8ac83dd75b1 tempest-GroupsV314Test-1886998862 None] Create group completed successfully. Aug 29 01:17:00 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-680764b9-714c-4954-9cc1-1caba23a8a6b tempest-GroupsV314Test-1886998862 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:17:01 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-680764b9-714c-4954-9cc1-1caba23a8a6b tempest-GroupsV314Test-1886998862 None] Flow 'volume_create_manager' (51c4c5bc-905e-43f5-a6a0-700240ccd055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:17:01 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-680764b9-714c-4954-9cc1-1caba23a8a6b tempest-GroupsV314Test-1886998862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91326689-a62f-4bdf-92db-3a9c559d909c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:17:01 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-680764b9-714c-4954-9cc1-1caba23a8a6b tempest-GroupsV314Test-1886998862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91326689-a62f-4bdf-92db-3a9c559d909c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:17:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1848481850',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d5f755a4-aa29-4005-858a-e3c3026a2971,host='devstack@QuobyteHD#QuobyteHD',id=05199fd8-0077-45f0-b4b6-d19860397bfd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7ae6bddfd784c00b8fd412b97664b6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:17:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:17:01Z,use_quota=True,user_id='27cab960c15d4c4fa1d98f12cf7e2039',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cd84f23f-9c73-4e7c-b130-ff0609d22b70),volume_type_id=cd84f23f-9c73-4e7c-b130-ff0609d22b70)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:17:01 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-680764b9-714c-4954-9cc1-1caba23a8a6b tempest-GroupsV314Test-1886998862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d7c82ac-eccc-40a9-a56d-96c8b6979920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:17:01 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-680764b9-714c-4954-9cc1-1caba23a8a6b tempest-GroupsV314Test-1886998862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d7c82ac-eccc-40a9-a56d-96c8b6979920) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:17:01 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-680764b9-714c-4954-9cc1-1caba23a8a6b tempest-GroupsV314Test-1886998862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdbcb6f2-53f3-4aba-952c-ca983e01caa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:17:01 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-680764b9-714c-4954-9cc1-1caba23a8a6b tempest-GroupsV314Test-1886998862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdbcb6f2-53f3-4aba-952c-ca983e01caa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05199fd8-0077-45f0-b4b6-d19860397bfd', 'volume_name': 'volume-05199fd8-0077-45f0-b4b6-d19860397bfd', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:17:01 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-680764b9-714c-4954-9cc1-1caba23a8a6b tempest-GroupsV314Test-1886998862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da71a7e8-afbf-4b9c-b1a0-2b62a4262c2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:17:01 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-680764b9-714c-4954-9cc1-1caba23a8a6b tempest-GroupsV314Test-1886998862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da71a7e8-afbf-4b9c-b1a0-2b62a4262c2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:17:01 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-680764b9-714c-4954-9cc1-1caba23a8a6b tempest-GroupsV314Test-1886998862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6fd6d56-5b9f-4cf4-b626-8824e3fa5b2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:17:01 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-680764b9-714c-4954-9cc1-1caba23a8a6b tempest-GroupsV314Test-1886998862 None] Volume 05199fd8-0077-45f0-b4b6-d19860397bfd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05199fd8-0077-45f0-b4b6-d19860397bfd', 'volume_size': 1} Aug 29 01:17:01 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-680764b9-714c-4954-9cc1-1caba23a8a6b tempest-GroupsV314Test-1886998862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:17:10 devstack cinder-volume[86111]: DEBUG dbcounter [-] [86111] Writing DB stats cinder:SELECT=53,cinder:INSERT=14,cinder:UPDATE=53,cinder:DELETE=5 {{(pid=86111) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 29 01:17:11 devstack cinder-volume[86111]: DEBUG dbcounter [-] [86111] Writing DB stats cinder:SELECT=45,cinder:INSERT=16,cinder:UPDATE=71,cinder:DELETE=4 {{(pid=86111) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 29 01:17:15 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-d46e7f51-f98c-473e-84d6-0146d37f79a9 tempest-VolumesActionsTest-258600632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 31.359s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:17:15 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-d46e7f51-f98c-473e-84d6-0146d37f79a9 tempest-VolumesActionsTest-258600632 None] Uploaded volume to glance image-id: a0a966d1-9c74-4504-8912-f81e56824243. {{(pid=86111) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Aug 29 01:17:15 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-95bb2096-63ee-47ca-b7ef-ca871272374a tempest-VolumesListTestJSON-1105003552 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 31.042s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:17:15 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-95bb2096-63ee-47ca-b7ef-ca871272374a tempest-VolumesListTestJSON-1105003552 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:16:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1948118011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=398f2381-a82f-4403-829b-5a6b27b16bb3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='11e0e7805a6843d395b0851df531a59b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:16:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:16:44Z,use_quota=True,user_id='744287d5e9504eaebf7075492c930bfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:17:15 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-95bb2096-63ee-47ca-b7ef-ca871272374a tempest-VolumesListTestJSON-1105003552 None] Creating volume 398f2381-a82f-4403-829b-5a6b27b16bb3 {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:17:15 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-95bb2096-63ee-47ca-b7ef-ca871272374a tempest-VolumesListTestJSON-1105003552 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:17:15 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-95bb2096-63ee-47ca-b7ef-ca871272374a tempest-VolumesListTestJSON-1105003552 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:17:15 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-95bb2096-63ee-47ca-b7ef-ca871272374a tempest-VolumesListTestJSON-1105003552 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:17:15 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-95bb2096-63ee-47ca-b7ef-ca871272374a tempest-VolumesListTestJSON-1105003552 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:17:15 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-95bb2096-63ee-47ca-b7ef-ca871272374a tempest-VolumesListTestJSON-1105003552 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:17:15 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-95bb2096-63ee-47ca-b7ef-ca871272374a tempest-VolumesListTestJSON-1105003552 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:17:15 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-95bb2096-63ee-47ca-b7ef-ca871272374a tempest-VolumesListTestJSON-1105003552 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:17:15 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-95bb2096-63ee-47ca-b7ef-ca871272374a tempest-VolumesListTestJSON-1105003552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-398f2381-a82f-4403-829b-5a6b27b16bb3 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:17:15 devstack sudo[94908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-398f2381-a82f-4403-829b-5a6b27b16bb3 1073741824 Aug 29 01:17:15 devstack sudo[94908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:17:15 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-d46e7f51-f98c-473e-84d6-0146d37f79a9 tempest-VolumesActionsTest-258600632 None] Copy volume to image completed successfully. Aug 29 01:17:16 devstack sudo[94908]: pam_unix(sudo:session): session closed for user root Aug 29 01:17:16 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-95bb2096-63ee-47ca-b7ef-ca871272374a tempest-VolumesListTestJSON-1105003552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-398f2381-a82f-4403-829b-5a6b27b16bb3 1073741824" returned: 0 in 0.467s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:17:16 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-95bb2096-63ee-47ca-b7ef-ca871272374a tempest-VolumesListTestJSON-1105003552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-398f2381-a82f-4403-829b-5a6b27b16bb3 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:17:16 devstack sudo[94914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-398f2381-a82f-4403-829b-5a6b27b16bb3 Aug 29 01:17:16 devstack sudo[94914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:17:16 devstack sudo[94914]: pam_unix(sudo:session): session closed for user root Aug 29 01:17:16 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-95bb2096-63ee-47ca-b7ef-ca871272374a tempest-VolumesListTestJSON-1105003552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-398f2381-a82f-4403-829b-5a6b27b16bb3" returned: 0 in 0.265s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:17:16 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-95bb2096-63ee-47ca-b7ef-ca871272374a tempest-VolumesListTestJSON-1105003552 None] <== create_volume: return (773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:17:16 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-95bb2096-63ee-47ca-b7ef-ca871272374a tempest-VolumesListTestJSON-1105003552 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.775s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:17:16 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-680764b9-714c-4954-9cc1-1caba23a8a6b tempest-GroupsV314Test-1886998862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.226s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:17:16 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-680764b9-714c-4954-9cc1-1caba23a8a6b tempest-GroupsV314Test-1886998862 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d5f755a4-aa29-4005-858a-e3c3026a2971,created_at=2026-08-28T23:17:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1848481850',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d5f755a4-aa29-4005-858a-e3c3026a2971,host='devstack@QuobyteHD#QuobyteHD',id=05199fd8-0077-45f0-b4b6-d19860397bfd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7ae6bddfd784c00b8fd412b97664b6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:17:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:17:01Z,use_quota=True,user_id='27cab960c15d4c4fa1d98f12cf7e2039',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cd84f23f-9c73-4e7c-b130-ff0609d22b70),volume_type_id=cd84f23f-9c73-4e7c-b130-ff0609d22b70)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:17:16 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-680764b9-714c-4954-9cc1-1caba23a8a6b tempest-GroupsV314Test-1886998862 None] Creating volume 05199fd8-0077-45f0-b4b6-d19860397bfd {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:17:16 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-680764b9-714c-4954-9cc1-1caba23a8a6b tempest-GroupsV314Test-1886998862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:17:16 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-680764b9-714c-4954-9cc1-1caba23a8a6b tempest-GroupsV314Test-1886998862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:17:16 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-680764b9-714c-4954-9cc1-1caba23a8a6b tempest-GroupsV314Test-1886998862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:17:16 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-680764b9-714c-4954-9cc1-1caba23a8a6b tempest-GroupsV314Test-1886998862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:17:16 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-680764b9-714c-4954-9cc1-1caba23a8a6b tempest-GroupsV314Test-1886998862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:17:16 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-680764b9-714c-4954-9cc1-1caba23a8a6b tempest-GroupsV314Test-1886998862 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:17:16 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-680764b9-714c-4954-9cc1-1caba23a8a6b tempest-GroupsV314Test-1886998862 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:17:16 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-680764b9-714c-4954-9cc1-1caba23a8a6b tempest-GroupsV314Test-1886998862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-05199fd8-0077-45f0-b4b6-d19860397bfd 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:17:16 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-95bb2096-63ee-47ca-b7ef-ca871272374a tempest-VolumesListTestJSON-1105003552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e110b54a-aef7-4f8d-afae-e7dbec3ca4c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-398f2381-a82f-4403-829b-5a6b27b16bb3', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:17:16 devstack sudo[94917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-05199fd8-0077-45f0-b4b6-d19860397bfd 1073741824 Aug 29 01:17:16 devstack sudo[94917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:17:16 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-95bb2096-63ee-47ca-b7ef-ca871272374a tempest-VolumesListTestJSON-1105003552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9905a557-cab4-4619-963c-150ff5de2844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:17:16 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-95bb2096-63ee-47ca-b7ef-ca871272374a tempest-VolumesListTestJSON-1105003552 None] Volume volume-398f2381-a82f-4403-829b-5a6b27b16bb3 (398f2381-a82f-4403-829b-5a6b27b16bb3): created successfully Aug 29 01:17:16 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-95bb2096-63ee-47ca-b7ef-ca871272374a tempest-VolumesListTestJSON-1105003552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9905a557-cab4-4619-963c-150ff5de2844) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:17:16 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-95bb2096-63ee-47ca-b7ef-ca871272374a tempest-VolumesListTestJSON-1105003552 None] Flow 'volume_create_manager' (329da024-e9a5-42e9-8f4f-e7f6622809a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:17:16 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-95bb2096-63ee-47ca-b7ef-ca871272374a tempest-VolumesListTestJSON-1105003552 None] Created volume successfully. Aug 29 01:17:16 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-ec488187-8fa7-4246-8b37-dced2ecbdd2a tempest-VolumesActionsTest-258600632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:17:16 devstack sudo[94917]: pam_unix(sudo:session): session closed for user root Aug 29 01:17:16 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-680764b9-714c-4954-9cc1-1caba23a8a6b tempest-GroupsV314Test-1886998862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-05199fd8-0077-45f0-b4b6-d19860397bfd 1073741824" returned: 0 in 0.450s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:17:16 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-680764b9-714c-4954-9cc1-1caba23a8a6b tempest-GroupsV314Test-1886998862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-05199fd8-0077-45f0-b4b6-d19860397bfd {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:17:16 devstack sudo[94923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-05199fd8-0077-45f0-b4b6-d19860397bfd Aug 29 01:17:16 devstack sudo[94923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:17:17 devstack sudo[94923]: pam_unix(sudo:session): session closed for user root Aug 29 01:17:17 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-680764b9-714c-4954-9cc1-1caba23a8a6b tempest-GroupsV314Test-1886998862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-05199fd8-0077-45f0-b4b6-d19860397bfd" returned: 0 in 0.238s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:17:17 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-680764b9-714c-4954-9cc1-1caba23a8a6b tempest-GroupsV314Test-1886998862 None] <== create_volume: return (736ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:17:17 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-680764b9-714c-4954-9cc1-1caba23a8a6b tempest-GroupsV314Test-1886998862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.740s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:17:17 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-ec488187-8fa7-4246-8b37-dced2ecbdd2a tempest-VolumesActionsTest-258600632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.327s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:17:17 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-680764b9-714c-4954-9cc1-1caba23a8a6b tempest-GroupsV314Test-1886998862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6fd6d56-5b9f-4cf4-b626-8824e3fa5b2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05199fd8-0077-45f0-b4b6-d19860397bfd', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:17:17 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-680764b9-714c-4954-9cc1-1caba23a8a6b tempest-GroupsV314Test-1886998862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50e54f11-519c-41df-b229-b97e8a018a51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:17:17 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[0943718c-f7df-45e8-bceb-c25bb13395ae]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:17:17 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-ec488187-8fa7-4246-8b37-dced2ecbdd2a tempest-VolumesActionsTest-258600632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-228ce9ce-1f9a-4453-971c-8dc58400f0ec {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:17:17 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-680764b9-714c-4954-9cc1-1caba23a8a6b tempest-GroupsV314Test-1886998862 None] Volume volume-05199fd8-0077-45f0-b4b6-d19860397bfd (05199fd8-0077-45f0-b4b6-d19860397bfd): created successfully Aug 29 01:17:17 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-680764b9-714c-4954-9cc1-1caba23a8a6b tempest-GroupsV314Test-1886998862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50e54f11-519c-41df-b229-b97e8a018a51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:17:17 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-680764b9-714c-4954-9cc1-1caba23a8a6b tempest-GroupsV314Test-1886998862 None] Flow 'volume_create_manager' (51c4c5bc-905e-43f5-a6a0-700240ccd055) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:17:17 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-680764b9-714c-4954-9cc1-1caba23a8a6b tempest-GroupsV314Test-1886998862 None] Created volume successfully. Aug 29 01:17:17 devstack sudo[94926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-228ce9ce-1f9a-4453-971c-8dc58400f0ec Aug 29 01:17:17 devstack sudo[94926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:17:17 devstack sudo[94926]: pam_unix(sudo:session): session closed for user root Aug 29 01:17:17 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-ec488187-8fa7-4246-8b37-dced2ecbdd2a tempest-VolumesActionsTest-258600632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-228ce9ce-1f9a-4453-971c-8dc58400f0ec" returned: 0 in 0.368s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:17:17 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[398d1c71-e5dd-4c8d-b890-d189b40a6dfd]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:17:17 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-ec488187-8fa7-4246-8b37-dced2ecbdd2a tempest-VolumesActionsTest-258600632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-228ce9ce-1f9a-4453-971c-8dc58400f0ec {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:17:17 devstack sudo[94931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-228ce9ce-1f9a-4453-971c-8dc58400f0ec Aug 29 01:17:17 devstack sudo[94931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:17:17 devstack sudo[94931]: pam_unix(sudo:session): session closed for user root Aug 29 01:17:17 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-ec488187-8fa7-4246-8b37-dced2ecbdd2a tempest-VolumesActionsTest-258600632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-228ce9ce-1f9a-4453-971c-8dc58400f0ec" returned: 0 in 0.362s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:17:17 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-ec488187-8fa7-4246-8b37-dced2ecbdd2a tempest-VolumesActionsTest-258600632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-228ce9ce-1f9a-4453-971c-8dc58400f0ec /opt/stack/data/cinder/conversion/228ce9ce-1f9a-4453-971c-8dc58400f0ec.temp_image.ceac023d-189c-40b9-a0d1-62a92a828ca6pfs79pst.img {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:17:17 devstack sudo[94937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-228ce9ce-1f9a-4453-971c-8dc58400f0ec /opt/stack/data/cinder/conversion/228ce9ce-1f9a-4453-971c-8dc58400f0ec.temp_image.ceac023d-189c-40b9-a0d1-62a92a828ca6pfs79pst.img Aug 29 01:17:17 devstack sudo[94937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:17:20 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-2fa3c704-4ff1-4eb9-af80-0d191ab259c9 tempest-GroupsV314Test-1886998862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:17:21 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-7ac57a13-22a9-4aa3-ba09-782ae8a004ad tempest-VolumesListTestJSON-1105003552 None] Acquiring lock "cinder-398f2381-a82f-4403-829b-5a6b27b16bb3-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:17:21 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-7ac57a13-22a9-4aa3-ba09-782ae8a004ad tempest-VolumesListTestJSON-1105003552 None] Lock "cinder-398f2381-a82f-4403-829b-5a6b27b16bb3-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:17:21 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-7ac57a13-22a9-4aa3-ba09-782ae8a004ad tempest-VolumesListTestJSON-1105003552 None] Acquiring lock "cinder-quobyte-398f2381-a82f-4403-829b-5a6b27b16bb3" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:17:21 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-7ac57a13-22a9-4aa3-ba09-782ae8a004ad tempest-VolumesListTestJSON-1105003552 None] Lock "cinder-quobyte-398f2381-a82f-4403-829b-5a6b27b16bb3" acquired by "delete_volume" :: waited 0.026s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:17:21 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[455e295a-d34a-4972-ab1f-997c0618b996]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:17:21 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-7ac57a13-22a9-4aa3-ba09-782ae8a004ad tempest-VolumesListTestJSON-1105003552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-398f2381-a82f-4403-829b-5a6b27b16bb3 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:17:21 devstack sudo[94958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-398f2381-a82f-4403-829b-5a6b27b16bb3 Aug 29 01:17:21 devstack sudo[94958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:17:22 devstack sudo[94958]: pam_unix(sudo:session): session closed for user root Aug 29 01:17:22 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-7ac57a13-22a9-4aa3-ba09-782ae8a004ad tempest-VolumesListTestJSON-1105003552 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-398f2381-a82f-4403-829b-5a6b27b16bb3" returned: 0 in 0.699s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:17:22 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-7ac57a13-22a9-4aa3-ba09-782ae8a004ad tempest-VolumesListTestJSON-1105003552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-398f2381-a82f-4403-829b-5a6b27b16bb3 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:17:22 devstack sudo[94963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-398f2381-a82f-4403-829b-5a6b27b16bb3 Aug 29 01:17:22 devstack sudo[94963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:17:23 devstack sudo[94963]: pam_unix(sudo:session): session closed for user root Aug 29 01:17:23 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-7ac57a13-22a9-4aa3-ba09-782ae8a004ad tempest-VolumesListTestJSON-1105003552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-398f2381-a82f-4403-829b-5a6b27b16bb3" returned: 0 in 0.614s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:17:23 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-7ac57a13-22a9-4aa3-ba09-782ae8a004ad tempest-VolumesListTestJSON-1105003552 None] Lock "cinder-quobyte-398f2381-a82f-4403-829b-5a6b27b16bb3" released by "delete_volume" :: held 1.401s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:17:23 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-7ac57a13-22a9-4aa3-ba09-782ae8a004ad tempest-VolumesListTestJSON-1105003552 None] Created reservations ['3892ba41-da1e-4089-89e0-7ebf863fcb79', '307e05bd-7e91-451b-ae46-12c74f42778f', '7de06d4d-75f5-4ef5-8008-71ddf820c8c5', '98ccb9f0-ce20-4f31-97b1-17efe7e96330'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:17:23 devstack sudo[94937]: pam_unix(sudo:session): session closed for user root Aug 29 01:17:23 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-ec488187-8fa7-4246-8b37-dced2ecbdd2a tempest-VolumesActionsTest-258600632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-228ce9ce-1f9a-4453-971c-8dc58400f0ec /opt/stack/data/cinder/conversion/228ce9ce-1f9a-4453-971c-8dc58400f0ec.temp_image.ceac023d-189c-40b9-a0d1-62a92a828ca6pfs79pst.img" returned: 0 in 5.302s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:17:23 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[8296825f-17f3-4523-abb3-8e15505bc43b]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:17:23 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-ec488187-8fa7-4246-8b37-dced2ecbdd2a tempest-VolumesActionsTest-258600632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-228ce9ce-1f9a-4453-971c-8dc58400f0ec {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:17:23 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-7ac57a13-22a9-4aa3-ba09-782ae8a004ad tempest-VolumesListTestJSON-1105003552 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:17:23 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-7ac57a13-22a9-4aa3-ba09-782ae8a004ad tempest-VolumesListTestJSON-1105003552 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:17:23 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-7ac57a13-22a9-4aa3-ba09-782ae8a004ad tempest-VolumesListTestJSON-1105003552 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:17:23 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-7ac57a13-22a9-4aa3-ba09-782ae8a004ad tempest-VolumesListTestJSON-1105003552 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:17:23 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-7ac57a13-22a9-4aa3-ba09-782ae8a004ad tempest-VolumesListTestJSON-1105003552 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:17:23 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-7ac57a13-22a9-4aa3-ba09-782ae8a004ad tempest-VolumesListTestJSON-1105003552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:17:23 devstack sudo[94967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:17:23 devstack sudo[94967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:17:23 devstack sudo[94966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-228ce9ce-1f9a-4453-971c-8dc58400f0ec Aug 29 01:17:23 devstack sudo[94966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:17:23 devstack sudo[94967]: pam_unix(sudo:session): session closed for user root Aug 29 01:17:23 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-7ac57a13-22a9-4aa3-ba09-782ae8a004ad tempest-VolumesListTestJSON-1105003552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.278s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:17:23 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-7ac57a13-22a9-4aa3-ba09-782ae8a004ad tempest-VolumesListTestJSON-1105003552 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:17:23 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-7ac57a13-22a9-4aa3-ba09-782ae8a004ad tempest-VolumesListTestJSON-1105003552 None] Deleted volume successfully. Aug 29 01:17:23 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-7ac57a13-22a9-4aa3-ba09-782ae8a004ad tempest-VolumesListTestJSON-1105003552 None] Lock "cinder-398f2381-a82f-4403-829b-5a6b27b16bb3-delete_volume" released by "delete_volume" :: held 2.056s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:17:23 devstack sudo[94966]: pam_unix(sudo:session): session closed for user root Aug 29 01:17:23 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-ec488187-8fa7-4246-8b37-dced2ecbdd2a tempest-VolumesActionsTest-258600632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-228ce9ce-1f9a-4453-971c-8dc58400f0ec" returned: 0 in 0.590s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:17:23 devstack cinder-volume[86111]: DEBUG cinder.image.image_utils [None req-ec488187-8fa7-4246-8b37-dced2ecbdd2a tempest-VolumesActionsTest-258600632 None] Image conversion details: src /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-228ce9ce-1f9a-4453-971c-8dc58400f0ec, size 1024.00 MB, duration 5.30 sec, destination /opt/stack/data/cinder/conversion/228ce9ce-1f9a-4453-971c-8dc58400f0ec.temp_image.ceac023d-189c-40b9-a0d1-62a92a828ca6pfs79pst.img {{(pid=86111) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 29 01:17:23 devstack cinder-volume[86111]: INFO cinder.image.image_utils [None req-ec488187-8fa7-4246-8b37-dced2ecbdd2a tempest-VolumesActionsTest-258600632 None] Converted 1024.00 MB image at 193.08 MB/s Aug 29 01:17:23 devstack cinder-volume[86111]: DEBUG cinder.image.image_utils [None req-ec488187-8fa7-4246-8b37-dced2ecbdd2a tempest-VolumesActionsTest-258600632 None] ceac023d-189c-40b9-a0d1-62a92a828ca6 was raw, converting to qcow2 {{(pid=86111) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Aug 29 01:17:23 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8251531-144b-4835-a68a-caf2715472ec]: (4, 'raw') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:17:23 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-ec488187-8fa7-4246-8b37-dced2ecbdd2a tempest-VolumesActionsTest-258600632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/228ce9ce-1f9a-4453-971c-8dc58400f0ec.temp_image.ceac023d-189c-40b9-a0d1-62a92a828ca6pfs79pst.img {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:17:23 devstack sudo[94974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/228ce9ce-1f9a-4453-971c-8dc58400f0ec.temp_image.ceac023d-189c-40b9-a0d1-62a92a828ca6pfs79pst.img Aug 29 01:17:23 devstack sudo[94974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:17:24 devstack sudo[94974]: pam_unix(sudo:session): session closed for user root Aug 29 01:17:24 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-ec488187-8fa7-4246-8b37-dced2ecbdd2a tempest-VolumesActionsTest-258600632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/228ce9ce-1f9a-4453-971c-8dc58400f0ec.temp_image.ceac023d-189c-40b9-a0d1-62a92a828ca6pfs79pst.img" returned: 0 in 0.376s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:17:24 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-ec488187-8fa7-4246-8b37-dced2ecbdd2a tempest-VolumesActionsTest-258600632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/228ce9ce-1f9a-4453-971c-8dc58400f0ec.temp_image.ceac023d-189c-40b9-a0d1-62a92a828ca6pfs79pst.img {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:17:24 devstack sudo[94980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/228ce9ce-1f9a-4453-971c-8dc58400f0ec.temp_image.ceac023d-189c-40b9-a0d1-62a92a828ca6pfs79pst.img Aug 29 01:17:24 devstack sudo[94980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:17:24 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-0a34945f-aaa7-400c-b675-6f70ce0505db tempest-VolumesListTestJSON-1105003552 None] Acquiring lock "cinder-07143835-563f-4e9a-aa18-cf013aaf085a-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:17:24 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-0a34945f-aaa7-400c-b675-6f70ce0505db tempest-VolumesListTestJSON-1105003552 None] Lock "cinder-07143835-563f-4e9a-aa18-cf013aaf085a-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:17:24 devstack sudo[94980]: pam_unix(sudo:session): session closed for user root Aug 29 01:17:24 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-ec488187-8fa7-4246-8b37-dced2ecbdd2a tempest-VolumesActionsTest-258600632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/228ce9ce-1f9a-4453-971c-8dc58400f0ec.temp_image.ceac023d-189c-40b9-a0d1-62a92a828ca6pfs79pst.img" returned: 1 in 0.361s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:17:24 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-ec488187-8fa7-4246-8b37-dced2ecbdd2a tempest-VolumesActionsTest-258600632 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/228ce9ce-1f9a-4453-971c-8dc58400f0ec.temp_image.ceac023d-189c-40b9-a0d1-62a92a828ca6pfs79pst.img' failed. Not Retrying. {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 29 01:17:24 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-ec488187-8fa7-4246-8b37-dced2ecbdd2a tempest-VolumesActionsTest-258600632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/228ce9ce-1f9a-4453-971c-8dc58400f0ec.temp_image.ceac023d-189c-40b9-a0d1-62a92a828ca6pfs79pst.img /opt/stack/data/cinder/conversion/vol_upload_r5fdxs4i {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:17:24 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-0a34945f-aaa7-400c-b675-6f70ce0505db tempest-VolumesListTestJSON-1105003552 None] Acquiring lock "cinder-quobyte-07143835-563f-4e9a-aa18-cf013aaf085a" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:17:24 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-0a34945f-aaa7-400c-b675-6f70ce0505db tempest-VolumesListTestJSON-1105003552 None] Lock "cinder-quobyte-07143835-563f-4e9a-aa18-cf013aaf085a" acquired by "delete_volume" :: waited 0.030s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:17:24 devstack sudo[94985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/228ce9ce-1f9a-4453-971c-8dc58400f0ec.temp_image.ceac023d-189c-40b9-a0d1-62a92a828ca6pfs79pst.img /opt/stack/data/cinder/conversion/vol_upload_r5fdxs4i Aug 29 01:17:24 devstack sudo[94985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:17:24 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[314157b4-b2f8-419d-916c-e29c60c48d31]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:17:24 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-0a34945f-aaa7-400c-b675-6f70ce0505db tempest-VolumesListTestJSON-1105003552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-07143835-563f-4e9a-aa18-cf013aaf085a {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:17:24 devstack sudo[94987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-07143835-563f-4e9a-aa18-cf013aaf085a Aug 29 01:17:24 devstack sudo[94987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:17:24 devstack sudo[94985]: pam_unix(sudo:session): session closed for user root Aug 29 01:17:24 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-ec488187-8fa7-4246-8b37-dced2ecbdd2a tempest-VolumesActionsTest-258600632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/228ce9ce-1f9a-4453-971c-8dc58400f0ec.temp_image.ceac023d-189c-40b9-a0d1-62a92a828ca6pfs79pst.img /opt/stack/data/cinder/conversion/vol_upload_r5fdxs4i" returned: 0 in 0.295s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:17:24 devstack cinder-volume[86111]: DEBUG cinder.image.image_utils [None req-ec488187-8fa7-4246-8b37-dced2ecbdd2a tempest-VolumesActionsTest-258600632 None] Image conversion details: src /opt/stack/data/cinder/conversion/228ce9ce-1f9a-4453-971c-8dc58400f0ec.temp_image.ceac023d-189c-40b9-a0d1-62a92a828ca6pfs79pst.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_r5fdxs4i {{(pid=86111) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 29 01:17:24 devstack cinder-volume[86111]: INFO cinder.image.image_utils [None req-ec488187-8fa7-4246-8b37-dced2ecbdd2a tempest-VolumesActionsTest-258600632 None] Converted 1024.00 MB image at 1024.00 MB/s Aug 29 01:17:24 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[622af243-1318-43b0-b168-e45f38c4941d]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:17:24 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-ec488187-8fa7-4246-8b37-dced2ecbdd2a tempest-VolumesActionsTest-258600632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_r5fdxs4i {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:17:25 devstack sudo[94992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_r5fdxs4i Aug 29 01:17:25 devstack sudo[94992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:17:25 devstack sudo[94987]: pam_unix(sudo:session): session closed for user root Aug 29 01:17:25 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-0a34945f-aaa7-400c-b675-6f70ce0505db tempest-VolumesListTestJSON-1105003552 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-07143835-563f-4e9a-aa18-cf013aaf085a" returned: 0 in 0.519s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:17:25 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-0a34945f-aaa7-400c-b675-6f70ce0505db tempest-VolumesListTestJSON-1105003552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-07143835-563f-4e9a-aa18-cf013aaf085a {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:17:25 devstack sudo[95033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-07143835-563f-4e9a-aa18-cf013aaf085a Aug 29 01:17:25 devstack sudo[95033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:17:25 devstack sudo[94992]: pam_unix(sudo:session): session closed for user root Aug 29 01:17:25 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-ec488187-8fa7-4246-8b37-dced2ecbdd2a tempest-VolumesActionsTest-258600632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_r5fdxs4i" returned: 0 in 0.487s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:17:25 devstack sudo[95033]: pam_unix(sudo:session): session closed for user root Aug 29 01:17:25 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-0a34945f-aaa7-400c-b675-6f70ce0505db tempest-VolumesListTestJSON-1105003552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-07143835-563f-4e9a-aa18-cf013aaf085a" returned: 0 in 0.381s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:17:25 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-0a34945f-aaa7-400c-b675-6f70ce0505db tempest-VolumesListTestJSON-1105003552 None] Lock "cinder-quobyte-07143835-563f-4e9a-aa18-cf013aaf085a" released by "delete_volume" :: held 0.972s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:17:25 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-0a34945f-aaa7-400c-b675-6f70ce0505db tempest-VolumesListTestJSON-1105003552 None] Created reservations ['096e7baf-cadf-4264-a2cb-163cac080b3d', '06216a95-ed98-4a06-be52-f09d43ac2be0', '0d55b356-1981-4ad6-a1ab-03aba8c9f753', '8175754f-8df1-4be2-aa1e-cc9b02a97f24'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:17:25 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-0a34945f-aaa7-400c-b675-6f70ce0505db tempest-VolumesListTestJSON-1105003552 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:17:25 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-0a34945f-aaa7-400c-b675-6f70ce0505db tempest-VolumesListTestJSON-1105003552 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:17:25 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-0a34945f-aaa7-400c-b675-6f70ce0505db tempest-VolumesListTestJSON-1105003552 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:17:25 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-0a34945f-aaa7-400c-b675-6f70ce0505db tempest-VolumesListTestJSON-1105003552 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:17:25 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-0a34945f-aaa7-400c-b675-6f70ce0505db tempest-VolumesListTestJSON-1105003552 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:17:25 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-0a34945f-aaa7-400c-b675-6f70ce0505db tempest-VolumesListTestJSON-1105003552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:17:25 devstack sudo[95042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:17:25 devstack sudo[95042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:17:25 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-2eede639-193f-4055-8a7e-c0a040e0f437 tempest-AttachVolumeNegativeTest-614873311 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:17:26 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-2eede639-193f-4055-8a7e-c0a040e0f437 tempest-AttachVolumeNegativeTest-614873311 None] Flow 'volume_create_manager' (00e6af60-ff9d-4490-a0c5-43fa77d37da5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:17:26 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-2eede639-193f-4055-8a7e-c0a040e0f437 tempest-AttachVolumeNegativeTest-614873311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce1500a6-c49a-4a56-906c-efcf75fd1af6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:17:26 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-2eede639-193f-4055-8a7e-c0a040e0f437 tempest-AttachVolumeNegativeTest-614873311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce1500a6-c49a-4a56-906c-efcf75fd1af6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:17:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-891455675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7de1227-64f7-4764-ba98-fc77c7de7ae0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='159178f1d77e473eabc4e957f357dddb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:17:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:17:26Z,use_quota=True,user_id='c0630dbe1c18496e8ec320517ae79496',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:17:26 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-2eede639-193f-4055-8a7e-c0a040e0f437 tempest-AttachVolumeNegativeTest-614873311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec97ef69-836f-4283-b214-5d9bf87cb941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:17:26 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-2eede639-193f-4055-8a7e-c0a040e0f437 tempest-AttachVolumeNegativeTest-614873311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec97ef69-836f-4283-b214-5d9bf87cb941) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:17:26 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-2eede639-193f-4055-8a7e-c0a040e0f437 tempest-AttachVolumeNegativeTest-614873311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78489f34-ea40-4733-a719-63726c1674cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:17:26 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-2eede639-193f-4055-8a7e-c0a040e0f437 tempest-AttachVolumeNegativeTest-614873311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78489f34-ea40-4733-a719-63726c1674cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7de1227-64f7-4764-ba98-fc77c7de7ae0', 'volume_name': 'volume-a7de1227-64f7-4764-ba98-fc77c7de7ae0', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:17:26 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-2eede639-193f-4055-8a7e-c0a040e0f437 tempest-AttachVolumeNegativeTest-614873311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca439bfa-3dfb-48dc-adfe-9d04f4067183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:17:26 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-2eede639-193f-4055-8a7e-c0a040e0f437 tempest-AttachVolumeNegativeTest-614873311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca439bfa-3dfb-48dc-adfe-9d04f4067183) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:17:26 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-2eede639-193f-4055-8a7e-c0a040e0f437 tempest-AttachVolumeNegativeTest-614873311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96a1b142-61ac-4200-91cc-0d2c364c9b04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:17:26 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-2eede639-193f-4055-8a7e-c0a040e0f437 tempest-AttachVolumeNegativeTest-614873311 None] Volume a7de1227-64f7-4764-ba98-fc77c7de7ae0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7de1227-64f7-4764-ba98-fc77c7de7ae0', 'volume_size': 1} Aug 29 01:17:26 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-2eede639-193f-4055-8a7e-c0a040e0f437 tempest-AttachVolumeNegativeTest-614873311 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:17:26 devstack sudo[95042]: pam_unix(sudo:session): session closed for user root Aug 29 01:17:26 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-0a34945f-aaa7-400c-b675-6f70ce0505db tempest-VolumesListTestJSON-1105003552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.285s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:17:26 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-0a34945f-aaa7-400c-b675-6f70ce0505db tempest-VolumesListTestJSON-1105003552 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:17:26 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-0a34945f-aaa7-400c-b675-6f70ce0505db tempest-VolumesListTestJSON-1105003552 None] Deleted volume successfully. Aug 29 01:17:26 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-0a34945f-aaa7-400c-b675-6f70ce0505db tempest-VolumesListTestJSON-1105003552 None] Lock "cinder-07143835-563f-4e9a-aa18-cf013aaf085a-delete_volume" released by "delete_volume" :: held 1.598s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:17:26 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-de511820-00ff-4ce1-a067-d459cb4f8e9a tempest-VolumesListTestJSON-1105003552 None] Acquiring lock "cinder-97ab8572-c014-4f9d-91ea-3eff0cebf70d-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:17:26 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-ec488187-8fa7-4246-8b37-dced2ecbdd2a tempest-VolumesActionsTest-258600632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 9.757s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:17:26 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-ec488187-8fa7-4246-8b37-dced2ecbdd2a tempest-VolumesActionsTest-258600632 None] Uploaded volume to glance image-id: ceac023d-189c-40b9-a0d1-62a92a828ca6. {{(pid=86111) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Aug 29 01:17:26 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-2fa3c704-4ff1-4eb9-af80-0d191ab259c9 tempest-GroupsV314Test-1886998862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 6.874s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:17:26 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-2fa3c704-4ff1-4eb9-af80-0d191ab259c9 tempest-GroupsV314Test-1886998862 None] Cloning volume 05199fd8-0077-45f0-b4b6-d19860397bfd to volume b5221aa6-cc38-4ff8-b428-847125f71f4e Aug 29 01:17:26 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-de511820-00ff-4ce1-a067-d459cb4f8e9a tempest-VolumesListTestJSON-1105003552 None] Lock "cinder-97ab8572-c014-4f9d-91ea-3eff0cebf70d-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:17:26 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-ec488187-8fa7-4246-8b37-dced2ecbdd2a tempest-VolumesActionsTest-258600632 None] Copy volume to image completed successfully. Aug 29 01:17:26 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-2fa3c704-4ff1-4eb9-af80-0d191ab259c9 tempest-GroupsV314Test-1886998862 None] Creating offline snapshot 09025fc5-2266-4b84-a4fe-5cf0fb64818b of volume 05199fd8-0077-45f0-b4b6-d19860397bfd {{(pid=86111) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 29 01:17:26 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[91686c23-9fb0-426f-893a-8375e16f213d]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:17:26 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-2fa3c704-4ff1-4eb9-af80-0d191ab259c9 tempest-GroupsV314Test-1886998862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-05199fd8-0077-45f0-b4b6-d19860397bfd {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:17:26 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-de511820-00ff-4ce1-a067-d459cb4f8e9a tempest-VolumesListTestJSON-1105003552 None] Acquiring lock "cinder-quobyte-97ab8572-c014-4f9d-91ea-3eff0cebf70d" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:17:27 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-de511820-00ff-4ce1-a067-d459cb4f8e9a tempest-VolumesListTestJSON-1105003552 None] Lock "cinder-quobyte-97ab8572-c014-4f9d-91ea-3eff0cebf70d" acquired by "delete_volume" :: waited 0.023s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:17:27 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd6361f0-2dd4-4ba5-a45a-7fb9a62573c5]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:17:27 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-de511820-00ff-4ce1-a067-d459cb4f8e9a tempest-VolumesListTestJSON-1105003552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-97ab8572-c014-4f9d-91ea-3eff0cebf70d {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:17:27 devstack sudo[95045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-05199fd8-0077-45f0-b4b6-d19860397bfd Aug 29 01:17:27 devstack sudo[95045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:17:27 devstack sudo[95046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-97ab8572-c014-4f9d-91ea-3eff0cebf70d Aug 29 01:17:27 devstack sudo[95046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:17:27 devstack sudo[95045]: pam_unix(sudo:session): session closed for user root Aug 29 01:17:27 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-2fa3c704-4ff1-4eb9-af80-0d191ab259c9 tempest-GroupsV314Test-1886998862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-05199fd8-0077-45f0-b4b6-d19860397bfd" returned: 0 in 0.388s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:17:27 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-2fa3c704-4ff1-4eb9-af80-0d191ab259c9 tempest-GroupsV314Test-1886998862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-05199fd8-0077-45f0-b4b6-d19860397bfd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-05199fd8-0077-45f0-b4b6-d19860397bfd.09025fc5-2266-4b84-a4fe-5cf0fb64818b 1G {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:17:27 devstack sudo[95053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-05199fd8-0077-45f0-b4b6-d19860397bfd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-05199fd8-0077-45f0-b4b6-d19860397bfd.09025fc5-2266-4b84-a4fe-5cf0fb64818b 1G Aug 29 01:17:27 devstack sudo[95053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:17:27 devstack sudo[95046]: pam_unix(sudo:session): session closed for user root Aug 29 01:17:27 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-de511820-00ff-4ce1-a067-d459cb4f8e9a tempest-VolumesListTestJSON-1105003552 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-97ab8572-c014-4f9d-91ea-3eff0cebf70d" returned: 0 in 0.406s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:17:27 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-de511820-00ff-4ce1-a067-d459cb4f8e9a tempest-VolumesListTestJSON-1105003552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-97ab8572-c014-4f9d-91ea-3eff0cebf70d {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:17:27 devstack sudo[95058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-97ab8572-c014-4f9d-91ea-3eff0cebf70d Aug 29 01:17:27 devstack sudo[95058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:17:27 devstack sudo[95058]: pam_unix(sudo:session): session closed for user root Aug 29 01:17:27 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-de511820-00ff-4ce1-a067-d459cb4f8e9a tempest-VolumesListTestJSON-1105003552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-97ab8572-c014-4f9d-91ea-3eff0cebf70d" returned: 0 in 0.277s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:17:27 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-de511820-00ff-4ce1-a067-d459cb4f8e9a tempest-VolumesListTestJSON-1105003552 None] Lock "cinder-quobyte-97ab8572-c014-4f9d-91ea-3eff0cebf70d" released by "delete_volume" :: held 0.730s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:17:27 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-de511820-00ff-4ce1-a067-d459cb4f8e9a tempest-VolumesListTestJSON-1105003552 None] Created reservations ['edcdf732-73cb-4fc0-bd0f-d5dccd4221b6', 'ca78244b-b219-4dcd-bd6f-8169ff898da6', '0bbda3ec-bc6a-49c6-b69c-507f5e0dd7e5', 'f6f58a89-bfab-4167-aaa3-0866c4df8319'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:17:27 devstack sudo[95053]: pam_unix(sudo:session): session closed for user root Aug 29 01:17:27 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-2fa3c704-4ff1-4eb9-af80-0d191ab259c9 tempest-GroupsV314Test-1886998862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-05199fd8-0077-45f0-b4b6-d19860397bfd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-05199fd8-0077-45f0-b4b6-d19860397bfd.09025fc5-2266-4b84-a4fe-5cf0fb64818b 1G" returned: 0 in 0.469s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:17:27 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-2fa3c704-4ff1-4eb9-af80-0d191ab259c9 tempest-GroupsV314Test-1886998862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05199fd8-0077-45f0-b4b6-d19860397bfd -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-05199fd8-0077-45f0-b4b6-d19860397bfd.09025fc5-2266-4b84-a4fe-5cf0fb64818b {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:17:27 devstack sudo[95065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05199fd8-0077-45f0-b4b6-d19860397bfd -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-05199fd8-0077-45f0-b4b6-d19860397bfd.09025fc5-2266-4b84-a4fe-5cf0fb64818b Aug 29 01:17:27 devstack sudo[95065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:17:27 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-de511820-00ff-4ce1-a067-d459cb4f8e9a tempest-VolumesListTestJSON-1105003552 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:17:27 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-de511820-00ff-4ce1-a067-d459cb4f8e9a tempest-VolumesListTestJSON-1105003552 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:17:27 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-de511820-00ff-4ce1-a067-d459cb4f8e9a tempest-VolumesListTestJSON-1105003552 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:17:27 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-de511820-00ff-4ce1-a067-d459cb4f8e9a tempest-VolumesListTestJSON-1105003552 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:17:27 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-de511820-00ff-4ce1-a067-d459cb4f8e9a tempest-VolumesListTestJSON-1105003552 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:17:27 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-de511820-00ff-4ce1-a067-d459cb4f8e9a tempest-VolumesListTestJSON-1105003552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:17:27 devstack sudo[95067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:17:27 devstack sudo[95067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:17:28 devstack sudo[95067]: pam_unix(sudo:session): session closed for user root Aug 29 01:17:28 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-3df86a43-0896-4b19-8a56-e1dffc3844dd tempest-VolumesActionsTest-258600632 None] Acquiring lock "cinder-228ce9ce-1f9a-4453-971c-8dc58400f0ec-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:17:28 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-de511820-00ff-4ce1-a067-d459cb4f8e9a tempest-VolumesListTestJSON-1105003552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.319s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:17:28 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-de511820-00ff-4ce1-a067-d459cb4f8e9a tempest-VolumesListTestJSON-1105003552 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:17:28 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-de511820-00ff-4ce1-a067-d459cb4f8e9a tempest-VolumesListTestJSON-1105003552 None] Deleted volume successfully. Aug 29 01:17:28 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-3df86a43-0896-4b19-8a56-e1dffc3844dd tempest-VolumesActionsTest-258600632 None] Lock "cinder-228ce9ce-1f9a-4453-971c-8dc58400f0ec-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:17:28 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-de511820-00ff-4ce1-a067-d459cb4f8e9a tempest-VolumesListTestJSON-1105003552 None] Lock "cinder-97ab8572-c014-4f9d-91ea-3eff0cebf70d-delete_volume" released by "delete_volume" :: held 1.375s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:17:28 devstack sudo[95065]: pam_unix(sudo:session): session closed for user root Aug 29 01:17:28 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-2fa3c704-4ff1-4eb9-af80-0d191ab259c9 tempest-GroupsV314Test-1886998862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05199fd8-0077-45f0-b4b6-d19860397bfd -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-05199fd8-0077-45f0-b4b6-d19860397bfd.09025fc5-2266-4b84-a4fe-5cf0fb64818b" returned: 0 in 0.492s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:17:28 devstack cinder-volume[86111]: WARNING cinder.volume.drivers.remotefs [None req-2fa3c704-4ff1-4eb9-af80-0d191ab259c9 tempest-GroupsV314Test-1886998862 None] /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-05199fd8-0077-45f0-b4b6-d19860397bfd.09025fc5-2266-4b84-a4fe-5cf0fb64818b is being set with open permissions: ugo+rw: NotImplementedError Aug 29 01:17:28 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-2fa3c704-4ff1-4eb9-af80-0d191ab259c9 tempest-GroupsV314Test-1886998862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-05199fd8-0077-45f0-b4b6-d19860397bfd.09025fc5-2266-4b84-a4fe-5cf0fb64818b {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:17:28 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-3df86a43-0896-4b19-8a56-e1dffc3844dd tempest-VolumesActionsTest-258600632 None] Acquiring lock "cinder-quobyte-228ce9ce-1f9a-4453-971c-8dc58400f0ec" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:17:28 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-3df86a43-0896-4b19-8a56-e1dffc3844dd tempest-VolumesActionsTest-258600632 None] Lock "cinder-quobyte-228ce9ce-1f9a-4453-971c-8dc58400f0ec" acquired by "delete_volume" :: waited 0.018s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:17:28 devstack sudo[95073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-05199fd8-0077-45f0-b4b6-d19860397bfd.09025fc5-2266-4b84-a4fe-5cf0fb64818b Aug 29 01:17:28 devstack sudo[95073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:17:28 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[573a4129-497e-4897-a2da-80646d9c3d74]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:17:28 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-3df86a43-0896-4b19-8a56-e1dffc3844dd tempest-VolumesActionsTest-258600632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-228ce9ce-1f9a-4453-971c-8dc58400f0ec {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:17:28 devstack sudo[95075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-228ce9ce-1f9a-4453-971c-8dc58400f0ec Aug 29 01:17:28 devstack sudo[95075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:17:28 devstack sudo[95073]: pam_unix(sudo:session): session closed for user root Aug 29 01:17:28 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-2fa3c704-4ff1-4eb9-af80-0d191ab259c9 tempest-GroupsV314Test-1886998862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-05199fd8-0077-45f0-b4b6-d19860397bfd.09025fc5-2266-4b84-a4fe-5cf0fb64818b" returned: 0 in 0.274s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:17:28 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-2fa3c704-4ff1-4eb9-af80-0d191ab259c9 tempest-GroupsV314Test-1886998862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-05199fd8-0077-45f0-b4b6-d19860397bfd.info {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:17:28 devstack sudo[95078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-05199fd8-0077-45f0-b4b6-d19860397bfd.info Aug 29 01:17:28 devstack sudo[95078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:17:28 devstack sudo[95075]: pam_unix(sudo:session): session closed for user root Aug 29 01:17:28 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-3df86a43-0896-4b19-8a56-e1dffc3844dd tempest-VolumesActionsTest-258600632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-228ce9ce-1f9a-4453-971c-8dc58400f0ec" returned: 0 in 0.413s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:17:28 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-3df86a43-0896-4b19-8a56-e1dffc3844dd tempest-VolumesActionsTest-258600632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-228ce9ce-1f9a-4453-971c-8dc58400f0ec {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:17:28 devstack sudo[95084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-228ce9ce-1f9a-4453-971c-8dc58400f0ec Aug 29 01:17:28 devstack sudo[95084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:17:28 devstack sudo[95078]: pam_unix(sudo:session): session closed for user root Aug 29 01:17:28 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-2fa3c704-4ff1-4eb9-af80-0d191ab259c9 tempest-GroupsV314Test-1886998862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-05199fd8-0077-45f0-b4b6-d19860397bfd.info" returned: 0 in 0.280s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:17:28 devstack cinder-volume[86111]: WARNING cinder.volume.drivers.remotefs [None req-2fa3c704-4ff1-4eb9-af80-0d191ab259c9 tempest-GroupsV314Test-1886998862 None] /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-05199fd8-0077-45f0-b4b6-d19860397bfd.info is being set with open permissions: ugo+rw: NotImplementedError Aug 29 01:17:28 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-2fa3c704-4ff1-4eb9-af80-0d191ab259c9 tempest-GroupsV314Test-1886998862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-05199fd8-0077-45f0-b4b6-d19860397bfd.info {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:17:28 devstack sudo[95087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-05199fd8-0077-45f0-b4b6-d19860397bfd.info Aug 29 01:17:28 devstack sudo[95087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:17:29 devstack sudo[95084]: pam_unix(sudo:session): session closed for user root Aug 29 01:17:29 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-3df86a43-0896-4b19-8a56-e1dffc3844dd tempest-VolumesActionsTest-258600632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-228ce9ce-1f9a-4453-971c-8dc58400f0ec" returned: 0 in 0.301s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:17:29 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-3df86a43-0896-4b19-8a56-e1dffc3844dd tempest-VolumesActionsTest-258600632 None] Lock "cinder-quobyte-228ce9ce-1f9a-4453-971c-8dc58400f0ec" released by "delete_volume" :: held 0.759s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:17:29 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-3df86a43-0896-4b19-8a56-e1dffc3844dd tempest-VolumesActionsTest-258600632 None] Created reservations ['c51326d1-4488-4026-b9a7-f628e0cd75ca', 'e9d8de57-03b7-40a2-8fd1-81ff4c50b941', 'b5a61fc0-b560-42ee-9014-0974857a2c15', '6f507684-3ce2-42ce-9ef1-b34440c64228'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:17:29 devstack sudo[95087]: pam_unix(sudo:session): session closed for user root Aug 29 01:17:29 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-2fa3c704-4ff1-4eb9-af80-0d191ab259c9 tempest-GroupsV314Test-1886998862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-05199fd8-0077-45f0-b4b6-d19860397bfd.info" returned: 0 in 0.318s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:17:29 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-2fa3c704-4ff1-4eb9-af80-0d191ab259c9 tempest-GroupsV314Test-1886998862 None] Acquiring lock "cinder-quobyte-b5221aa6-cc38-4ff8-b428-847125f71f4e" by "_copy_volume_from_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:17:29 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-2fa3c704-4ff1-4eb9-af80-0d191ab259c9 tempest-GroupsV314Test-1886998862 None] Lock "cinder-quobyte-b5221aa6-cc38-4ff8-b428-847125f71f4e" acquired by "_copy_volume_from_snapshot" :: waited 0.036s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:17:29 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-2fa3c704-4ff1-4eb9-af80-0d191ab259c9 tempest-GroupsV314Test-1886998862 None] snapshot: 09025fc5-2266-4b84-a4fe-5cf0fb64818b, volume: b5221aa6-cc38-4ff8-b428-847125f71f4e, {{(pid=86111) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 29 01:17:29 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-2fa3c704-4ff1-4eb9-af80-0d191ab259c9 tempest-GroupsV314Test-1886998862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:17:29 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-2fa3c704-4ff1-4eb9-af80-0d191ab259c9 tempest-GroupsV314Test-1886998862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:17:29 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-2fa3c704-4ff1-4eb9-af80-0d191ab259c9 tempest-GroupsV314Test-1886998862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:17:29 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-2fa3c704-4ff1-4eb9-af80-0d191ab259c9 tempest-GroupsV314Test-1886998862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:17:29 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-2fa3c704-4ff1-4eb9-af80-0d191ab259c9 tempest-GroupsV314Test-1886998862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:17:29 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-3df86a43-0896-4b19-8a56-e1dffc3844dd tempest-VolumesActionsTest-258600632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:17:29 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-3df86a43-0896-4b19-8a56-e1dffc3844dd tempest-VolumesActionsTest-258600632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:17:29 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-3df86a43-0896-4b19-8a56-e1dffc3844dd tempest-VolumesActionsTest-258600632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:17:29 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-3df86a43-0896-4b19-8a56-e1dffc3844dd tempest-VolumesActionsTest-258600632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:17:29 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-3df86a43-0896-4b19-8a56-e1dffc3844dd tempest-VolumesActionsTest-258600632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:17:29 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-3df86a43-0896-4b19-8a56-e1dffc3844dd tempest-VolumesActionsTest-258600632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:17:29 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d2fec85-e2a9-463b-b373-e92242d7b1ec]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:17:29 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-2fa3c704-4ff1-4eb9-af80-0d191ab259c9 tempest-GroupsV314Test-1886998862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-05199fd8-0077-45f0-b4b6-d19860397bfd.09025fc5-2266-4b84-a4fe-5cf0fb64818b {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:17:29 devstack sudo[95092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:17:29 devstack sudo[95092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:17:29 devstack sudo[95093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-05199fd8-0077-45f0-b4b6-d19860397bfd.09025fc5-2266-4b84-a4fe-5cf0fb64818b Aug 29 01:17:29 devstack sudo[95093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:17:29 devstack sudo[95092]: pam_unix(sudo:session): session closed for user root Aug 29 01:17:29 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-3df86a43-0896-4b19-8a56-e1dffc3844dd tempest-VolumesActionsTest-258600632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.376s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:17:29 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-3df86a43-0896-4b19-8a56-e1dffc3844dd tempest-VolumesActionsTest-258600632 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:17:29 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-3df86a43-0896-4b19-8a56-e1dffc3844dd tempest-VolumesActionsTest-258600632 None] Deleted volume successfully. Aug 29 01:17:29 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-3df86a43-0896-4b19-8a56-e1dffc3844dd tempest-VolumesActionsTest-258600632 None] Lock "cinder-228ce9ce-1f9a-4453-971c-8dc58400f0ec-delete_volume" released by "delete_volume" :: held 1.512s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:17:29 devstack sudo[95093]: pam_unix(sudo:session): session closed for user root Aug 29 01:17:29 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-2fa3c704-4ff1-4eb9-af80-0d191ab259c9 tempest-GroupsV314Test-1886998862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-05199fd8-0077-45f0-b4b6-d19860397bfd.09025fc5-2266-4b84-a4fe-5cf0fb64818b" returned: 0 in 0.537s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:17:29 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-2fa3c704-4ff1-4eb9-af80-0d191ab259c9 tempest-GroupsV314Test-1886998862 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-05199fd8-0077-45f0-b4b6-d19860397bfd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 29 01:17:29 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0a6696e-7f08-41d1-a133-568ff77ed225]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:17:29 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-2fa3c704-4ff1-4eb9-af80-0d191ab259c9 tempest-GroupsV314Test-1886998862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-05199fd8-0077-45f0-b4b6-d19860397bfd {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:17:30 devstack sudo[95100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-05199fd8-0077-45f0-b4b6-d19860397bfd Aug 29 01:17:30 devstack sudo[95100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:17:30 devstack sudo[95100]: pam_unix(sudo:session): session closed for user root Aug 29 01:17:30 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-2fa3c704-4ff1-4eb9-af80-0d191ab259c9 tempest-GroupsV314Test-1886998862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-05199fd8-0077-45f0-b4b6-d19860397bfd" returned: 0 in 0.452s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:17:30 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-2fa3c704-4ff1-4eb9-af80-0d191ab259c9 tempest-GroupsV314Test-1886998862 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-05199fd8-0077-45f0-b4b6-d19860397bfd {{(pid=86111) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 29 01:17:30 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-2fa3c704-4ff1-4eb9-af80-0d191ab259c9 tempest-GroupsV314Test-1886998862 None] Creating direct copy from snapshot {{(pid=86111) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 29 01:17:30 devstack cinder-volume[86111]: DEBUG cinder.utils [None req-2fa3c704-4ff1-4eb9-af80-0d191ab259c9 tempest-GroupsV314Test-1886998862 None] Path /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-b5221aa6-cc38-4ff8-b428-847125f71f4e not found in is_blk_device check {{(pid=86111) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 29 01:17:30 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-2fa3c704-4ff1-4eb9-af80-0d191ab259c9 tempest-GroupsV314Test-1886998862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-05199fd8-0077-45f0-b4b6-d19860397bfd /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-b5221aa6-cc38-4ff8-b428-847125f71f4e {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:17:30 devstack sudo[95105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-05199fd8-0077-45f0-b4b6-d19860397bfd /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-b5221aa6-cc38-4ff8-b428-847125f71f4e Aug 29 01:17:30 devstack sudo[95105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:17:36 devstack sudo[95105]: pam_unix(sudo:session): session closed for user root Aug 29 01:17:36 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-2fa3c704-4ff1-4eb9-af80-0d191ab259c9 tempest-GroupsV314Test-1886998862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-05199fd8-0077-45f0-b4b6-d19860397bfd /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-b5221aa6-cc38-4ff8-b428-847125f71f4e" returned: 0 in 5.825s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:17:36 devstack cinder-volume[86111]: DEBUG cinder.image.image_utils [None req-2fa3c704-4ff1-4eb9-af80-0d191ab259c9 tempest-GroupsV314Test-1886998862 None] Image conversion details: src /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-05199fd8-0077-45f0-b4b6-d19860397bfd, size 1024.00 MB, duration 5.83 sec, destination /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-b5221aa6-cc38-4ff8-b428-847125f71f4e {{(pid=86111) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 29 01:17:36 devstack cinder-volume[86111]: INFO cinder.image.image_utils [None req-2fa3c704-4ff1-4eb9-af80-0d191ab259c9 tempest-GroupsV314Test-1886998862 None] Converted 1024.00 MB image at 175.70 MB/s Aug 29 01:17:36 devstack cinder-volume[86111]: WARNING cinder.volume.drivers.remotefs [None req-2fa3c704-4ff1-4eb9-af80-0d191ab259c9 tempest-GroupsV314Test-1886998862 None] /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-b5221aa6-cc38-4ff8-b428-847125f71f4e is being set with open permissions: ugo+rw: NotImplementedError Aug 29 01:17:36 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-2fa3c704-4ff1-4eb9-af80-0d191ab259c9 tempest-GroupsV314Test-1886998862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-b5221aa6-cc38-4ff8-b428-847125f71f4e {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:17:36 devstack sudo[95120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-b5221aa6-cc38-4ff8-b428-847125f71f4e Aug 29 01:17:36 devstack sudo[95120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:17:36 devstack sudo[95120]: pam_unix(sudo:session): session closed for user root Aug 29 01:17:36 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-2fa3c704-4ff1-4eb9-af80-0d191ab259c9 tempest-GroupsV314Test-1886998862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-b5221aa6-cc38-4ff8-b428-847125f71f4e" returned: 0 in 0.309s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:17:36 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-2fa3c704-4ff1-4eb9-af80-0d191ab259c9 tempest-GroupsV314Test-1886998862 None] Lock "cinder-quobyte-b5221aa6-cc38-4ff8-b428-847125f71f4e" released by "_copy_volume_from_snapshot" :: held 7.245s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:17:36 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-2fa3c704-4ff1-4eb9-af80-0d191ab259c9 tempest-GroupsV314Test-1886998862 None] Acquiring lock "cinder-quobyte-09025fc5-2266-4b84-a4fe-5cf0fb64818b" by "_delete_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:17:36 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-2fa3c704-4ff1-4eb9-af80-0d191ab259c9 tempest-GroupsV314Test-1886998862 None] Lock "cinder-quobyte-09025fc5-2266-4b84-a4fe-5cf0fb64818b" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:17:36 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-2fa3c704-4ff1-4eb9-af80-0d191ab259c9 tempest-GroupsV314Test-1886998862 None] Deleting offline snapshot 09025fc5-2266-4b84-a4fe-5cf0fb64818b of volume 05199fd8-0077-45f0-b4b6-d19860397bfd {{(pid=86111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 29 01:17:36 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-2fa3c704-4ff1-4eb9-af80-0d191ab259c9 tempest-GroupsV314Test-1886998862 None] snapshot_file for this snap is: volume-05199fd8-0077-45f0-b4b6-d19860397bfd.09025fc5-2266-4b84-a4fe-5cf0fb64818b {{(pid=86111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 29 01:17:36 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[fee5b818-b7fb-4846-b4d9-89d2526c2e8a]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:17:36 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-2fa3c704-4ff1-4eb9-af80-0d191ab259c9 tempest-GroupsV314Test-1886998862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-05199fd8-0077-45f0-b4b6-d19860397bfd.09025fc5-2266-4b84-a4fe-5cf0fb64818b {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:17:36 devstack sudo[95123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-05199fd8-0077-45f0-b4b6-d19860397bfd.09025fc5-2266-4b84-a4fe-5cf0fb64818b Aug 29 01:17:36 devstack sudo[95123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:17:36 devstack sudo[95123]: pam_unix(sudo:session): session closed for user root Aug 29 01:17:37 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-2fa3c704-4ff1-4eb9-af80-0d191ab259c9 tempest-GroupsV314Test-1886998862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-05199fd8-0077-45f0-b4b6-d19860397bfd.09025fc5-2266-4b84-a4fe-5cf0fb64818b" returned: 0 in 0.398s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:17:37 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-2fa3c704-4ff1-4eb9-af80-0d191ab259c9 tempest-GroupsV314Test-1886998862 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-05199fd8-0077-45f0-b4b6-d19860397bfd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 29 01:17:37 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6d1f42c-7fef-4951-9225-02f7eb10282c]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:17:37 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-2fa3c704-4ff1-4eb9-af80-0d191ab259c9 tempest-GroupsV314Test-1886998862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-05199fd8-0077-45f0-b4b6-d19860397bfd {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:17:37 devstack sudo[95128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-05199fd8-0077-45f0-b4b6-d19860397bfd Aug 29 01:17:37 devstack sudo[95128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:17:37 devstack sudo[95128]: pam_unix(sudo:session): session closed for user root Aug 29 01:17:37 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-2fa3c704-4ff1-4eb9-af80-0d191ab259c9 tempest-GroupsV314Test-1886998862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-05199fd8-0077-45f0-b4b6-d19860397bfd" returned: 0 in 0.735s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:17:37 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-2fa3c704-4ff1-4eb9-af80-0d191ab259c9 tempest-GroupsV314Test-1886998862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-05199fd8-0077-45f0-b4b6-d19860397bfd.09025fc5-2266-4b84-a4fe-5cf0fb64818b {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:17:37 devstack sudo[95134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-05199fd8-0077-45f0-b4b6-d19860397bfd.09025fc5-2266-4b84-a4fe-5cf0fb64818b Aug 29 01:17:37 devstack sudo[95134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:17:38 devstack sudo[95134]: pam_unix(sudo:session): session closed for user root Aug 29 01:17:38 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-2fa3c704-4ff1-4eb9-af80-0d191ab259c9 tempest-GroupsV314Test-1886998862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-05199fd8-0077-45f0-b4b6-d19860397bfd.09025fc5-2266-4b84-a4fe-5cf0fb64818b" returned: 0 in 0.446s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:17:38 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-2fa3c704-4ff1-4eb9-af80-0d191ab259c9 tempest-GroupsV314Test-1886998862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-05199fd8-0077-45f0-b4b6-d19860397bfd.09025fc5-2266-4b84-a4fe-5cf0fb64818b {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:17:38 devstack sudo[95139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-05199fd8-0077-45f0-b4b6-d19860397bfd.09025fc5-2266-4b84-a4fe-5cf0fb64818b Aug 29 01:17:38 devstack sudo[95139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:17:38 devstack sudo[95139]: pam_unix(sudo:session): session closed for user root Aug 29 01:17:38 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-2fa3c704-4ff1-4eb9-af80-0d191ab259c9 tempest-GroupsV314Test-1886998862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-05199fd8-0077-45f0-b4b6-d19860397bfd.09025fc5-2266-4b84-a4fe-5cf0fb64818b" returned: 0 in 0.322s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:17:38 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-2fa3c704-4ff1-4eb9-af80-0d191ab259c9 tempest-GroupsV314Test-1886998862 None] Lock "cinder-quobyte-09025fc5-2266-4b84-a4fe-5cf0fb64818b" released by "_delete_snapshot" :: held 2.028s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:17:38 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-2fa3c704-4ff1-4eb9-af80-0d191ab259c9 tempest-GroupsV314Test-1886998862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.741s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:17:38 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-2eede639-193f-4055-8a7e-c0a040e0f437 tempest-AttachVolumeNegativeTest-614873311 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.561s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:17:38 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-2eede639-193f-4055-8a7e-c0a040e0f437 tempest-AttachVolumeNegativeTest-614873311 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:17:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-891455675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7de1227-64f7-4764-ba98-fc77c7de7ae0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='159178f1d77e473eabc4e957f357dddb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:17:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:17:26Z,use_quota=True,user_id='c0630dbe1c18496e8ec320517ae79496',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:17:38 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-2eede639-193f-4055-8a7e-c0a040e0f437 tempest-AttachVolumeNegativeTest-614873311 None] Creating volume a7de1227-64f7-4764-ba98-fc77c7de7ae0 {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:17:38 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-2eede639-193f-4055-8a7e-c0a040e0f437 tempest-AttachVolumeNegativeTest-614873311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:17:38 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-2eede639-193f-4055-8a7e-c0a040e0f437 tempest-AttachVolumeNegativeTest-614873311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:17:38 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-2eede639-193f-4055-8a7e-c0a040e0f437 tempest-AttachVolumeNegativeTest-614873311 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:17:38 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-2eede639-193f-4055-8a7e-c0a040e0f437 tempest-AttachVolumeNegativeTest-614873311 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:17:38 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-2eede639-193f-4055-8a7e-c0a040e0f437 tempest-AttachVolumeNegativeTest-614873311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:17:38 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-2eede639-193f-4055-8a7e-c0a040e0f437 tempest-AttachVolumeNegativeTest-614873311 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:17:38 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-2eede639-193f-4055-8a7e-c0a040e0f437 tempest-AttachVolumeNegativeTest-614873311 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:17:38 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-2eede639-193f-4055-8a7e-c0a040e0f437 tempest-AttachVolumeNegativeTest-614873311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a7de1227-64f7-4764-ba98-fc77c7de7ae0 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:17:38 devstack sudo[95142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a7de1227-64f7-4764-ba98-fc77c7de7ae0 1073741824 Aug 29 01:17:38 devstack sudo[95142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:17:38 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-2fa3c704-4ff1-4eb9-af80-0d191ab259c9 tempest-GroupsV314Test-1886998862 None] Create group from source-group-d5f755a4-aa29-4005-858a-e3c3026a2971 completed successfully. Aug 29 01:17:39 devstack sudo[95142]: pam_unix(sudo:session): session closed for user root Aug 29 01:17:39 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-2eede639-193f-4055-8a7e-c0a040e0f437 tempest-AttachVolumeNegativeTest-614873311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a7de1227-64f7-4764-ba98-fc77c7de7ae0 1073741824" returned: 0 in 0.535s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:17:39 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-2eede639-193f-4055-8a7e-c0a040e0f437 tempest-AttachVolumeNegativeTest-614873311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a7de1227-64f7-4764-ba98-fc77c7de7ae0 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:17:39 devstack sudo[95149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a7de1227-64f7-4764-ba98-fc77c7de7ae0 Aug 29 01:17:39 devstack sudo[95149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:17:39 devstack sudo[95149]: pam_unix(sudo:session): session closed for user root Aug 29 01:17:39 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-2eede639-193f-4055-8a7e-c0a040e0f437 tempest-AttachVolumeNegativeTest-614873311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a7de1227-64f7-4764-ba98-fc77c7de7ae0" returned: 0 in 0.389s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:17:39 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-2eede639-193f-4055-8a7e-c0a040e0f437 tempest-AttachVolumeNegativeTest-614873311 None] <== create_volume: return (973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:17:39 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-2eede639-193f-4055-8a7e-c0a040e0f437 tempest-AttachVolumeNegativeTest-614873311 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.977s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:17:39 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-2eede639-193f-4055-8a7e-c0a040e0f437 tempest-AttachVolumeNegativeTest-614873311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96a1b142-61ac-4200-91cc-0d2c364c9b04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7de1227-64f7-4764-ba98-fc77c7de7ae0', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:17:39 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-2eede639-193f-4055-8a7e-c0a040e0f437 tempest-AttachVolumeNegativeTest-614873311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a90d5b4-d981-463b-858f-b88380f214b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:17:39 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-2eede639-193f-4055-8a7e-c0a040e0f437 tempest-AttachVolumeNegativeTest-614873311 None] Volume volume-a7de1227-64f7-4764-ba98-fc77c7de7ae0 (a7de1227-64f7-4764-ba98-fc77c7de7ae0): created successfully Aug 29 01:17:39 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-2eede639-193f-4055-8a7e-c0a040e0f437 tempest-AttachVolumeNegativeTest-614873311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a90d5b4-d981-463b-858f-b88380f214b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:17:39 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-2eede639-193f-4055-8a7e-c0a040e0f437 tempest-AttachVolumeNegativeTest-614873311 None] Flow 'volume_create_manager' (00e6af60-ff9d-4490-a0c5-43fa77d37da5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:17:39 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-2eede639-193f-4055-8a7e-c0a040e0f437 tempest-AttachVolumeNegativeTest-614873311 None] Created volume successfully. Aug 29 01:17:40 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-493858ad-3187-453e-a790-bc21bfb07bc0 tempest-GroupsV314Test-1886998862 None] Acquiring lock "cinder-quobyte-b5221aa6-cc38-4ff8-b428-847125f71f4e" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:17:40 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-493858ad-3187-453e-a790-bc21bfb07bc0 tempest-GroupsV314Test-1886998862 None] Lock "cinder-quobyte-b5221aa6-cc38-4ff8-b428-847125f71f4e" acquired by "delete_volume" :: waited 0.027s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:17:40 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[81f98380-2cb7-4e4b-9e7c-a096e241f012]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:17:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-493858ad-3187-453e-a790-bc21bfb07bc0 tempest-GroupsV314Test-1886998862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-b5221aa6-cc38-4ff8-b428-847125f71f4e {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:17:40 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f10b2f6-ca9c-4e8a-8248-703ba2ce6259 tempest-VolumesExtendTest-906497550 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:17:40 devstack sudo[95152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-b5221aa6-cc38-4ff8-b428-847125f71f4e Aug 29 01:17:40 devstack sudo[95152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:17:40 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-8f10b2f6-ca9c-4e8a-8248-703ba2ce6259 tempest-VolumesExtendTest-906497550 None] Flow 'volume_create_manager' (1467fe41-c9f9-4f2a-982d-75e9d1f5ec44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:17:40 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-8f10b2f6-ca9c-4e8a-8248-703ba2ce6259 tempest-VolumesExtendTest-906497550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4860dd43-b058-44c2-844e-85e5cb3ae61a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:17:40 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-8f10b2f6-ca9c-4e8a-8248-703ba2ce6259 tempest-VolumesExtendTest-906497550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4860dd43-b058-44c2-844e-85e5cb3ae61a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:17:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1578399026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7dd87c6b-e6f0-4b20-93ed-6de1f76ba612,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5e455a7c7ef4fb4aea3079196420e2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:17:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:17:40Z,use_quota=True,user_id='92d8da87562544b5900b0ce4c7f02368',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:17:40 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-8f10b2f6-ca9c-4e8a-8248-703ba2ce6259 tempest-VolumesExtendTest-906497550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0478788-e81a-4d05-82b8-5379d69f00f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:17:40 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-8f10b2f6-ca9c-4e8a-8248-703ba2ce6259 tempest-VolumesExtendTest-906497550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0478788-e81a-4d05-82b8-5379d69f00f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:17:40 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-8f10b2f6-ca9c-4e8a-8248-703ba2ce6259 tempest-VolumesExtendTest-906497550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cb0e180-14aa-442b-b80b-03fe9f7c833d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:17:40 devstack cinder-volume[86111]: DEBUG cinder.image.glance [None req-8f10b2f6-ca9c-4e8a-8248-703ba2ce6259 tempest-VolumesExtendTest-906497550 None] Creating Keystone auth plugin from conf {{(pid=86111) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 29 01:17:40 devstack cinder-volume[86111]: DEBUG oslo_service.periodic_task [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86111) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 29 01:17:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:17:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:17:40 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:17:40 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:17:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:17:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:17:40 devstack sudo[95157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:17:40 devstack sudo[95157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:17:40 devstack sudo[95152]: pam_unix(sudo:session): session closed for user root Aug 29 01:17:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-493858ad-3187-453e-a790-bc21bfb07bc0 tempest-GroupsV314Test-1886998862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-b5221aa6-cc38-4ff8-b428-847125f71f4e" returned: 0 in 0.548s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:17:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-493858ad-3187-453e-a790-bc21bfb07bc0 tempest-GroupsV314Test-1886998862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-b5221aa6-cc38-4ff8-b428-847125f71f4e {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:17:40 devstack sudo[95162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-b5221aa6-cc38-4ff8-b428-847125f71f4e Aug 29 01:17:41 devstack sudo[95162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:17:41 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-8f10b2f6-ca9c-4e8a-8248-703ba2ce6259 tempest-VolumesExtendTest-906497550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cb0e180-14aa-442b-b80b-03fe9f7c833d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7dd87c6b-e6f0-4b20-93ed-6de1f76ba612', 'volume_name': 'volume-7dd87c6b-e6f0-4b20-93ed-6de1f76ba612', 'volume_size': 1, 'image_id': 'f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8d940113004947258ae710723d273006', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab', 'created_at': datetime.datetime(2026, 8, 28, 23, 3, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 23, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:17:41 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-8f10b2f6-ca9c-4e8a-8248-703ba2ce6259 tempest-VolumesExtendTest-906497550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe82409e-6f01-40a2-86fa-35d2d94668f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:17:41 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-8f10b2f6-ca9c-4e8a-8248-703ba2ce6259 tempest-VolumesExtendTest-906497550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe82409e-6f01-40a2-86fa-35d2d94668f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:17:41 devstack sudo[95157]: pam_unix(sudo:session): session closed for user root Aug 29 01:17:41 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-8f10b2f6-ca9c-4e8a-8248-703ba2ce6259 tempest-VolumesExtendTest-906497550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (551188f4-f8e2-4274-8f81-84fd58e39bc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:17:41 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-8f10b2f6-ca9c-4e8a-8248-703ba2ce6259 tempest-VolumesExtendTest-906497550 None] Volume 7dd87c6b-e6f0-4b20-93ed-6de1f76ba612: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7dd87c6b-e6f0-4b20-93ed-6de1f76ba612', 'volume_size': 1, 'image_id': 'f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8d940113004947258ae710723d273006', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab', 'created_at': datetime.datetime(2026, 8, 28, 23, 3, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 23, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 29 01:17:41 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f10b2f6-ca9c-4e8a-8248-703ba2ce6259 tempest-VolumesExtendTest-906497550 None] Trying to clone 7dd87c6b-e6f0-4b20-93ed-6de1f76ba612 from image f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab at location (None, [{'url': 'file:///opt/stack/data/glance/images/f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab', 'metadata': {}}]). {{(pid=86111) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 29 01:17:41 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-de752545-d617-440e-8362-d04fae0901a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.390s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:17:41 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:17:41 devstack cinder-volume[86111]: DEBUG oslo_service.periodic_task [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Running periodic task VolumeManager._thread_info {{(pid=86111) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 29 01:17:41 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-de752545-d617-440e-8362-d04fae0901a5 None None] thread count: 28 {{(pid=86111) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 29 01:17:41 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-de752545-d617-440e-8362-d04fae0901a5 None None] thread info: [<_MainThread(MainThread, started 129173440548992)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86111) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 29 01:17:41 devstack sudo[95162]: pam_unix(sudo:session): session closed for user root Aug 29 01:17:41 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-493858ad-3187-453e-a790-bc21bfb07bc0 tempest-GroupsV314Test-1886998862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-b5221aa6-cc38-4ff8-b428-847125f71f4e" returned: 0 in 0.425s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:17:41 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-493858ad-3187-453e-a790-bc21bfb07bc0 tempest-GroupsV314Test-1886998862 None] Lock "cinder-quobyte-b5221aa6-cc38-4ff8-b428-847125f71f4e" released by "delete_volume" :: held 1.079s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:17:41 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-493858ad-3187-453e-a790-bc21bfb07bc0 tempest-GroupsV314Test-1886998862 None] Created reservations ['d4ac3972-c781-44f2-95de-69e5b2db8e7d'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:17:41 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [req-41d87ad9-aec5-4f88-817d-b27a1cef5b5c req-aa8edfb3-308d-43f9-ad62-d56f92442747 tempest-AttachVolumeNegativeTest-614873311 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:17:41 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [req-41d87ad9-aec5-4f88-817d-b27a1cef5b5c req-aa8edfb3-308d-43f9-ad62-d56f92442747 tempest-AttachVolumeNegativeTest-614873311 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:17:41 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [req-41d87ad9-aec5-4f88-817d-b27a1cef5b5c req-aa8edfb3-308d-43f9-ad62-d56f92442747 tempest-AttachVolumeNegativeTest-614873311 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.045s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:17:41 devstack cinder-volume[86111]: WARNING cinder.quota [None req-493858ad-3187-453e-a790-bc21bfb07bc0 tempest-GroupsV314Test-1886998862 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1319781718 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1319781718, it is now deprecated. Please use the default quota class for default quota. Aug 29 01:17:41 devstack cinder-volume[86111]: WARNING cinder.quota [None req-493858ad-3187-453e-a790-bc21bfb07bc0 tempest-GroupsV314Test-1886998862 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1319781718 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1319781718, it is now deprecated. Please use the default quota class for default quota. Aug 29 01:17:41 devstack cinder-volume[86111]: DEBUG cinder.image.image_utils [None req-8f10b2f6-ca9c-4e8a-8248-703ba2ce6259 tempest-VolumesExtendTest-906497550 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab_ue6pzc5ydevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86111) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 29 01:17:41 devstack cinder-volume[86111]: INFO cinder.image.image_utils [None req-8f10b2f6-ca9c-4e8a-8248-703ba2ce6259 tempest-VolumesExtendTest-906497550 None] Image download 20.69 MB at 20.69 MB/s Aug 29 01:17:41 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-493858ad-3187-453e-a790-bc21bfb07bc0 tempest-GroupsV314Test-1886998862 None] Created reservations ['e28c5537-8982-4f5a-8da5-97b86d13203c', '8ad8cbc8-d969-4891-ac8f-0305a47fb98a', '9dd443e3-c851-4f76-ae4c-16cfde560b1d', 'e048decd-f34b-40f0-b082-d01933893d39'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:17:41 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [req-41d87ad9-aec5-4f88-817d-b27a1cef5b5c req-aa8edfb3-308d-43f9-ad62-d56f92442747 tempest-AttachVolumeNegativeTest-614873311 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630', 'name': 'volume-a7de1227-64f7-4764-ba98-fc77c7de7ae0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a3074e07-c47f-40e6-9ac4-e7a9355b58f1', 'enforce_multipath': True} {{(pid=86111) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 29 01:17:41 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[89d847a0-4ed6-476d-a61d-d037029cba9a]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:17:41 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8f10b2f6-ca9c-4e8a-8248-703ba2ce6259 tempest-VolumesExtendTest-906497550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab_ue6pzc5ydevstack@QuobyteHD {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:17:41 devstack cinder-volume[86111]: INFO cinder.volume.manager [req-41d87ad9-aec5-4f88-817d-b27a1cef5b5c req-aa8edfb3-308d-43f9-ad62-d56f92442747 tempest-AttachVolumeNegativeTest-614873311 None] attachment_update completed successfully. Aug 29 01:17:41 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-493858ad-3187-453e-a790-bc21bfb07bc0 tempest-GroupsV314Test-1886998862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:17:41 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-493858ad-3187-453e-a790-bc21bfb07bc0 tempest-GroupsV314Test-1886998862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:17:41 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-493858ad-3187-453e-a790-bc21bfb07bc0 tempest-GroupsV314Test-1886998862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:17:41 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-493858ad-3187-453e-a790-bc21bfb07bc0 tempest-GroupsV314Test-1886998862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:17:41 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-493858ad-3187-453e-a790-bc21bfb07bc0 tempest-GroupsV314Test-1886998862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:17:41 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-493858ad-3187-453e-a790-bc21bfb07bc0 tempest-GroupsV314Test-1886998862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:17:41 devstack sudo[95175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab_ue6pzc5ydevstack@QuobyteHD Aug 29 01:17:41 devstack sudo[95175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:17:42 devstack sudo[95178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:17:42 devstack sudo[95178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:17:42 devstack sudo[95175]: pam_unix(sudo:session): session closed for user root Aug 29 01:17:42 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8f10b2f6-ca9c-4e8a-8248-703ba2ce6259 tempest-VolumesExtendTest-906497550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab_ue6pzc5ydevstack@QuobyteHD" returned: 0 in 0.447s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:17:42 devstack cinder-volume[86111]: DEBUG cinder.image.image_utils [None req-8f10b2f6-ca9c-4e8a-8248-703ba2ce6259 tempest-VolumesExtendTest-906497550 None] Temporary image f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab is fetched for user 92d8da87562544b5900b0ce4c7f02368. {{(pid=86111) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 29 01:17:42 devstack sudo[95178]: pam_unix(sudo:session): session closed for user root Aug 29 01:17:42 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-493858ad-3187-453e-a790-bc21bfb07bc0 tempest-GroupsV314Test-1886998862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.406s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:17:42 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-493858ad-3187-453e-a790-bc21bfb07bc0 tempest-GroupsV314Test-1886998862 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:17:42 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-493858ad-3187-453e-a790-bc21bfb07bc0 tempest-GroupsV314Test-1886998862 None] Delete group completed successfully. Aug 29 01:17:42 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[103f26cf-d4e0-465a-9be2-1077c974d4a2]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:17:42 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8f10b2f6-ca9c-4e8a-8248-703ba2ce6259 tempest-VolumesExtendTest-906497550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab_ue6pzc5ydevstack@QuobyteHD {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:17:42 devstack sudo[95565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab_ue6pzc5ydevstack@QuobyteHD Aug 29 01:17:42 devstack sudo[95565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:17:42 devstack sudo[95565]: pam_unix(sudo:session): session closed for user root Aug 29 01:17:42 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8f10b2f6-ca9c-4e8a-8248-703ba2ce6259 tempest-VolumesExtendTest-906497550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab_ue6pzc5ydevstack@QuobyteHD" returned: 0 in 0.457s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:17:42 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-8f10b2f6-ca9c-4e8a-8248-703ba2ce6259 tempest-VolumesExtendTest-906497550 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:17:42 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-8f10b2f6-ca9c-4e8a-8248-703ba2ce6259 tempest-VolumesExtendTest-906497550 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:17:42 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-8f10b2f6-ca9c-4e8a-8248-703ba2ce6259 tempest-VolumesExtendTest-906497550 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:17:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1578399026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7dd87c6b-e6f0-4b20-93ed-6de1f76ba612,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5e455a7c7ef4fb4aea3079196420e2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:17:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:17:40Z,use_quota=True,user_id='92d8da87562544b5900b0ce4c7f02368',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:17:42 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-8f10b2f6-ca9c-4e8a-8248-703ba2ce6259 tempest-VolumesExtendTest-906497550 None] Creating volume 7dd87c6b-e6f0-4b20-93ed-6de1f76ba612 {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:17:42 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-8f10b2f6-ca9c-4e8a-8248-703ba2ce6259 tempest-VolumesExtendTest-906497550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:17:42 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-8f10b2f6-ca9c-4e8a-8248-703ba2ce6259 tempest-VolumesExtendTest-906497550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:17:42 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-8f10b2f6-ca9c-4e8a-8248-703ba2ce6259 tempest-VolumesExtendTest-906497550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:17:42 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-8f10b2f6-ca9c-4e8a-8248-703ba2ce6259 tempest-VolumesExtendTest-906497550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:17:42 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-8f10b2f6-ca9c-4e8a-8248-703ba2ce6259 tempest-VolumesExtendTest-906497550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:17:42 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-8f10b2f6-ca9c-4e8a-8248-703ba2ce6259 tempest-VolumesExtendTest-906497550 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:17:42 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-8f10b2f6-ca9c-4e8a-8248-703ba2ce6259 tempest-VolumesExtendTest-906497550 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:17:42 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8f10b2f6-ca9c-4e8a-8248-703ba2ce6259 tempest-VolumesExtendTest-906497550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-7dd87c6b-e6f0-4b20-93ed-6de1f76ba612 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:17:42 devstack sudo[95572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-7dd87c6b-e6f0-4b20-93ed-6de1f76ba612 1073741824 Aug 29 01:17:42 devstack sudo[95572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:17:43 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-76aa6ef1-34f2-4c5d-bbed-a648782c6ba3 tempest-GroupsV314Test-1886998862 None] Acquiring lock "cinder-quobyte-05199fd8-0077-45f0-b4b6-d19860397bfd" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:17:43 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-76aa6ef1-34f2-4c5d-bbed-a648782c6ba3 tempest-GroupsV314Test-1886998862 None] Lock "cinder-quobyte-05199fd8-0077-45f0-b4b6-d19860397bfd" acquired by "delete_volume" :: waited 0.026s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:17:43 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[7723fe52-85c7-4aff-aa27-ad516e92f31d]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:17:43 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-76aa6ef1-34f2-4c5d-bbed-a648782c6ba3 tempest-GroupsV314Test-1886998862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-05199fd8-0077-45f0-b4b6-d19860397bfd {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:17:43 devstack sudo[95578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-05199fd8-0077-45f0-b4b6-d19860397bfd Aug 29 01:17:43 devstack sudo[95578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:17:43 devstack sudo[95572]: pam_unix(sudo:session): session closed for user root Aug 29 01:17:43 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8f10b2f6-ca9c-4e8a-8248-703ba2ce6259 tempest-VolumesExtendTest-906497550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-7dd87c6b-e6f0-4b20-93ed-6de1f76ba612 1073741824" returned: 0 in 0.576s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:17:43 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8f10b2f6-ca9c-4e8a-8248-703ba2ce6259 tempest-VolumesExtendTest-906497550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-7dd87c6b-e6f0-4b20-93ed-6de1f76ba612 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:17:43 devstack sudo[95580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-7dd87c6b-e6f0-4b20-93ed-6de1f76ba612 Aug 29 01:17:43 devstack sudo[95580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:17:43 devstack sudo[95578]: pam_unix(sudo:session): session closed for user root Aug 29 01:17:43 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-76aa6ef1-34f2-4c5d-bbed-a648782c6ba3 tempest-GroupsV314Test-1886998862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-05199fd8-0077-45f0-b4b6-d19860397bfd" returned: 0 in 0.483s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:17:43 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-76aa6ef1-34f2-4c5d-bbed-a648782c6ba3 tempest-GroupsV314Test-1886998862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-05199fd8-0077-45f0-b4b6-d19860397bfd {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:17:43 devstack sudo[95585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-05199fd8-0077-45f0-b4b6-d19860397bfd Aug 29 01:17:43 devstack sudo[95585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:17:43 devstack sudo[95580]: pam_unix(sudo:session): session closed for user root Aug 29 01:17:43 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8f10b2f6-ca9c-4e8a-8248-703ba2ce6259 tempest-VolumesExtendTest-906497550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-7dd87c6b-e6f0-4b20-93ed-6de1f76ba612" returned: 0 in 0.347s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:17:43 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-8f10b2f6-ca9c-4e8a-8248-703ba2ce6259 tempest-VolumesExtendTest-906497550 None] <== create_volume: return (985ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:17:43 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-8f10b2f6-ca9c-4e8a-8248-703ba2ce6259 tempest-VolumesExtendTest-906497550 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.988s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:17:43 devstack cinder-volume[86111]: DEBUG cinder.volume.volume_utils [None req-8f10b2f6-ca9c-4e8a-8248-703ba2ce6259 tempest-VolumesExtendTest-906497550 None] Attempting download of f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab ((None, [{'url': 'file:///opt/stack/data/glance/images/f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab', 'metadata': {}}])) to volume 7dd87c6b-e6f0-4b20-93ed-6de1f76ba612. {{(pid=86111) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 29 01:17:44 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdcc7e3f-3762-4f46-a961-1f42005cf901]: (4, 'raw') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:17:44 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8f10b2f6-ca9c-4e8a-8248-703ba2ce6259 tempest-VolumesExtendTest-906497550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab_4162kcmz {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:17:44 devstack sudo[95588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab_4162kcmz Aug 29 01:17:44 devstack sudo[95588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:17:44 devstack sudo[95585]: pam_unix(sudo:session): session closed for user root Aug 29 01:17:44 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-76aa6ef1-34f2-4c5d-bbed-a648782c6ba3 tempest-GroupsV314Test-1886998862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-05199fd8-0077-45f0-b4b6-d19860397bfd" returned: 0 in 0.424s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:17:44 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-76aa6ef1-34f2-4c5d-bbed-a648782c6ba3 tempest-GroupsV314Test-1886998862 None] Lock "cinder-quobyte-05199fd8-0077-45f0-b4b6-d19860397bfd" released by "delete_volume" :: held 0.987s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:17:44 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-76aa6ef1-34f2-4c5d-bbed-a648782c6ba3 tempest-GroupsV314Test-1886998862 None] Created reservations ['fb797ac7-a03a-4b87-a2fe-e86911dcb9ce'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:17:44 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-76aa6ef1-34f2-4c5d-bbed-a648782c6ba3 tempest-GroupsV314Test-1886998862 None] Created reservations ['2993a8fd-540f-4513-99b4-2fcee52110d1', '0c0226cf-b987-4f11-90b1-47782b8d4a39', '5a7f0a60-6f84-412b-bba0-0da5b9cc0caa', '6770eeca-520b-4457-b57e-282b3a6c24d3'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:17:44 devstack sudo[95588]: pam_unix(sudo:session): session closed for user root Aug 29 01:17:44 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-76aa6ef1-34f2-4c5d-bbed-a648782c6ba3 tempest-GroupsV314Test-1886998862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:17:44 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-76aa6ef1-34f2-4c5d-bbed-a648782c6ba3 tempest-GroupsV314Test-1886998862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:17:44 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-76aa6ef1-34f2-4c5d-bbed-a648782c6ba3 tempest-GroupsV314Test-1886998862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:17:44 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-76aa6ef1-34f2-4c5d-bbed-a648782c6ba3 tempest-GroupsV314Test-1886998862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:17:44 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-76aa6ef1-34f2-4c5d-bbed-a648782c6ba3 tempest-GroupsV314Test-1886998862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:17:44 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-76aa6ef1-34f2-4c5d-bbed-a648782c6ba3 tempest-GroupsV314Test-1886998862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:17:44 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8f10b2f6-ca9c-4e8a-8248-703ba2ce6259 tempest-VolumesExtendTest-906497550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab_4162kcmz" returned: 0 in 0.556s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:17:44 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8f10b2f6-ca9c-4e8a-8248-703ba2ce6259 tempest-VolumesExtendTest-906497550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab_4162kcmz {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:17:44 devstack sudo[95593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:17:44 devstack sudo[95593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:17:44 devstack sudo[95594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab_4162kcmz Aug 29 01:17:44 devstack sudo[95594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:17:44 devstack sudo[95594]: pam_unix(sudo:session): session closed for user root Aug 29 01:17:44 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8f10b2f6-ca9c-4e8a-8248-703ba2ce6259 tempest-VolumesExtendTest-906497550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab_4162kcmz" returned: 1 in 0.367s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:17:44 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8f10b2f6-ca9c-4e8a-8248-703ba2ce6259 tempest-VolumesExtendTest-906497550 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab_4162kcmz' failed. Not Retrying. {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 29 01:17:44 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8ea2147-9b0b-4e5a-8ddf-e3626ccf2481]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:17:44 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8f10b2f6-ca9c-4e8a-8248-703ba2ce6259 tempest-VolumesExtendTest-906497550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab_ue6pzc5ydevstack@QuobyteHD {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:17:45 devstack sudo[95593]: pam_unix(sudo:session): session closed for user root Aug 29 01:17:45 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-76aa6ef1-34f2-4c5d-bbed-a648782c6ba3 tempest-GroupsV314Test-1886998862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.476s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:17:45 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-76aa6ef1-34f2-4c5d-bbed-a648782c6ba3 tempest-GroupsV314Test-1886998862 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:17:45 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-76aa6ef1-34f2-4c5d-bbed-a648782c6ba3 tempest-GroupsV314Test-1886998862 None] Delete group completed successfully. Aug 29 01:17:45 devstack sudo[95600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab_ue6pzc5ydevstack@QuobyteHD Aug 29 01:17:45 devstack sudo[95600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:17:45 devstack sudo[95600]: pam_unix(sudo:session): session closed for user root Aug 29 01:17:45 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8f10b2f6-ca9c-4e8a-8248-703ba2ce6259 tempest-VolumesExtendTest-906497550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab_ue6pzc5ydevstack@QuobyteHD" returned: 0 in 0.392s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:17:45 devstack cinder-volume[86111]: DEBUG cinder.image.image_utils [None req-8f10b2f6-ca9c-4e8a-8248-703ba2ce6259 tempest-VolumesExtendTest-906497550 None] f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab was qcow2, converting to qcow2 {{(pid=86111) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 29 01:17:45 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8f10b2f6-ca9c-4e8a-8248-703ba2ce6259 tempest-VolumesExtendTest-906497550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab_ue6pzc5ydevstack@QuobyteHD /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-7dd87c6b-e6f0-4b20-93ed-6de1f76ba612 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:17:45 devstack sudo[95606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab_ue6pzc5ydevstack@QuobyteHD /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-7dd87c6b-e6f0-4b20-93ed-6de1f76ba612 Aug 29 01:17:45 devstack sudo[95606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:17:47 devstack sudo[95606]: pam_unix(sudo:session): session closed for user root Aug 29 01:17:47 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8f10b2f6-ca9c-4e8a-8248-703ba2ce6259 tempest-VolumesExtendTest-906497550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab_ue6pzc5ydevstack@QuobyteHD /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-7dd87c6b-e6f0-4b20-93ed-6de1f76ba612" returned: 0 in 2.487s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:17:47 devstack cinder-volume[86111]: DEBUG cinder.image.image_utils [None req-8f10b2f6-ca9c-4e8a-8248-703ba2ce6259 tempest-VolumesExtendTest-906497550 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab_ue6pzc5ydevstack@QuobyteHD, size 112.00 MB, duration 2.49 sec, destination /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-7dd87c6b-e6f0-4b20-93ed-6de1f76ba612 {{(pid=86111) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 29 01:17:47 devstack cinder-volume[86111]: INFO cinder.image.image_utils [None req-8f10b2f6-ca9c-4e8a-8248-703ba2ce6259 tempest-VolumesExtendTest-906497550 None] Converted 112.00 MB image at 45.01 MB/s Aug 29 01:17:47 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8f10b2f6-ca9c-4e8a-8248-703ba2ce6259 tempest-VolumesExtendTest-906497550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-7dd87c6b-e6f0-4b20-93ed-6de1f76ba612 1G {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:17:47 devstack sudo[95625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-7dd87c6b-e6f0-4b20-93ed-6de1f76ba612 1G Aug 29 01:17:47 devstack sudo[95625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:17:48 devstack sudo[95625]: pam_unix(sudo:session): session closed for user root Aug 29 01:17:48 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8f10b2f6-ca9c-4e8a-8248-703ba2ce6259 tempest-VolumesExtendTest-906497550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-7dd87c6b-e6f0-4b20-93ed-6de1f76ba612 1G" returned: 0 in 0.509s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:17:48 devstack cinder-volume[86111]: DEBUG cinder.volume.volume_utils [None req-8f10b2f6-ca9c-4e8a-8248-703ba2ce6259 tempest-VolumesExtendTest-906497550 None] Downloaded image f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab ((None, [{'url': 'file:///opt/stack/data/glance/images/f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab', 'metadata': {}}])) to volume 7dd87c6b-e6f0-4b20-93ed-6de1f76ba612 successfully. {{(pid=86111) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 29 01:17:48 devstack cinder-volume[86111]: DEBUG cinder.image.image_utils [None req-8f10b2f6-ca9c-4e8a-8248-703ba2ce6259 tempest-VolumesExtendTest-906497550 None] Temporary image f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab for user 92d8da87562544b5900b0ce4c7f02368 is deleted. {{(pid=86111) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 29 01:17:48 devstack cinder-volume[86111]: DEBUG cinder.volume.volume_utils [None req-8f10b2f6-ca9c-4e8a-8248-703ba2ce6259 tempest-VolumesExtendTest-906497550 None] Marking volume 7dd87c6b-e6f0-4b20-93ed-6de1f76ba612 as bootable. {{(pid=86111) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 29 01:17:48 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f10b2f6-ca9c-4e8a-8248-703ba2ce6259 tempest-VolumesExtendTest-906497550 None] Copying metadata from image f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab to 7dd87c6b-e6f0-4b20-93ed-6de1f76ba612. {{(pid=86111) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 29 01:17:48 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f10b2f6-ca9c-4e8a-8248-703ba2ce6259 tempest-VolumesExtendTest-906497550 None] Creating volume glance metadata for volume 7dd87c6b-e6f0-4b20-93ed-6de1f76ba612 backed by image f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86111) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 29 01:17:48 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-8f10b2f6-ca9c-4e8a-8248-703ba2ce6259 tempest-VolumesExtendTest-906497550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (551188f4-f8e2-4274-8f81-84fd58e39bc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7dd87c6b-e6f0-4b20-93ed-6de1f76ba612', 'volume_size': 1, 'image_id': 'f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8d940113004947258ae710723d273006', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab', 'created_at': datetime.datetime(2026, 8, 28, 23, 3, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 23, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:17:48 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-8f10b2f6-ca9c-4e8a-8248-703ba2ce6259 tempest-VolumesExtendTest-906497550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2692f5db-798e-44b3-aec6-bab225a9ec5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:17:48 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-8f10b2f6-ca9c-4e8a-8248-703ba2ce6259 tempest-VolumesExtendTest-906497550 None] Volume volume-7dd87c6b-e6f0-4b20-93ed-6de1f76ba612 (7dd87c6b-e6f0-4b20-93ed-6de1f76ba612): created successfully Aug 29 01:17:48 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-8f10b2f6-ca9c-4e8a-8248-703ba2ce6259 tempest-VolumesExtendTest-906497550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2692f5db-798e-44b3-aec6-bab225a9ec5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:17:48 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-8f10b2f6-ca9c-4e8a-8248-703ba2ce6259 tempest-VolumesExtendTest-906497550 None] Flow 'volume_create_manager' (1467fe41-c9f9-4f2a-982d-75e9d1f5ec44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:17:48 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-8f10b2f6-ca9c-4e8a-8248-703ba2ce6259 tempest-VolumesExtendTest-906497550 None] Created volume successfully. Aug 29 01:17:49 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-9f9e7c46-cbd1-45f8-a277-823fb57130cf tempest-VolumesExtendTest-906497550 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:17:49 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-9f9e7c46-cbd1-45f8-a277-823fb57130cf tempest-VolumesExtendTest-906497550 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:17:49 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[2094bbb7-ce6f-41d7-9b85-5218686d1cf0]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:17:49 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-9f9e7c46-cbd1-45f8-a277-823fb57130cf tempest-VolumesExtendTest-906497550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-7dd87c6b-e6f0-4b20-93ed-6de1f76ba612 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:17:49 devstack sudo[95635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-7dd87c6b-e6f0-4b20-93ed-6de1f76ba612 Aug 29 01:17:49 devstack sudo[95635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:17:49 devstack sudo[95635]: pam_unix(sudo:session): session closed for user root Aug 29 01:17:49 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-9f9e7c46-cbd1-45f8-a277-823fb57130cf tempest-VolumesExtendTest-906497550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-7dd87c6b-e6f0-4b20-93ed-6de1f76ba612" returned: 0 in 0.477s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:17:49 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-9f9e7c46-cbd1-45f8-a277-823fb57130cf tempest-VolumesExtendTest-906497550 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-7dd87c6b-e6f0-4b20-93ed-6de1f76ba612 2G {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:17:50 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-9f9e7c46-cbd1-45f8-a277-823fb57130cf tempest-VolumesExtendTest-906497550 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-7dd87c6b-e6f0-4b20-93ed-6de1f76ba612 2G" returned: 0 in 0.180s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:17:50 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-9f9e7c46-cbd1-45f8-a277-823fb57130cf tempest-VolumesExtendTest-906497550 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.693s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:17:50 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-9f9e7c46-cbd1-45f8-a277-823fb57130cf tempest-VolumesExtendTest-906497550 None] Extend volume completed successfully. Aug 29 01:17:50 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-5debc77e-018c-4459-9ead-be953f633dd6 tempest-VolumesExtendTest-906497550 None] Acquiring lock "cinder-7dd87c6b-e6f0-4b20-93ed-6de1f76ba612-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:17:50 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-5debc77e-018c-4459-9ead-be953f633dd6 tempest-VolumesExtendTest-906497550 None] Lock "cinder-7dd87c6b-e6f0-4b20-93ed-6de1f76ba612-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:17:50 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-5debc77e-018c-4459-9ead-be953f633dd6 tempest-VolumesExtendTest-906497550 None] Acquiring lock "cinder-quobyte-7dd87c6b-e6f0-4b20-93ed-6de1f76ba612" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:17:50 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-5debc77e-018c-4459-9ead-be953f633dd6 tempest-VolumesExtendTest-906497550 None] Lock "cinder-quobyte-7dd87c6b-e6f0-4b20-93ed-6de1f76ba612" acquired by "delete_volume" :: waited 0.027s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:17:51 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[c89dd984-a30d-4892-904a-ba007d5ce6f5]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:17:51 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-5debc77e-018c-4459-9ead-be953f633dd6 tempest-VolumesExtendTest-906497550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-7dd87c6b-e6f0-4b20-93ed-6de1f76ba612 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:17:51 devstack sudo[95654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-7dd87c6b-e6f0-4b20-93ed-6de1f76ba612 Aug 29 01:17:51 devstack sudo[95654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:17:51 devstack sudo[95654]: pam_unix(sudo:session): session closed for user root Aug 29 01:17:51 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-5debc77e-018c-4459-9ead-be953f633dd6 tempest-VolumesExtendTest-906497550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-7dd87c6b-e6f0-4b20-93ed-6de1f76ba612" returned: 0 in 0.614s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:17:51 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-5debc77e-018c-4459-9ead-be953f633dd6 tempest-VolumesExtendTest-906497550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-7dd87c6b-e6f0-4b20-93ed-6de1f76ba612 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:17:51 devstack sudo[95664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-7dd87c6b-e6f0-4b20-93ed-6de1f76ba612 Aug 29 01:17:51 devstack sudo[95664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:17:52 devstack sudo[95664]: pam_unix(sudo:session): session closed for user root Aug 29 01:17:52 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-5debc77e-018c-4459-9ead-be953f633dd6 tempest-VolumesExtendTest-906497550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-7dd87c6b-e6f0-4b20-93ed-6de1f76ba612" returned: 0 in 0.436s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:17:52 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-5debc77e-018c-4459-9ead-be953f633dd6 tempest-VolumesExtendTest-906497550 None] Lock "cinder-quobyte-7dd87c6b-e6f0-4b20-93ed-6de1f76ba612" released by "delete_volume" :: held 1.125s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:17:52 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-5debc77e-018c-4459-9ead-be953f633dd6 tempest-VolumesExtendTest-906497550 None] Created reservations ['6277e582-897c-41ae-8ed3-c31a1b0a2030', 'fc84fe5e-1068-48b6-9e74-afd2f3f6c339', '412f4794-ea8e-4a56-b284-de8732e374fa', '590de596-afc8-4bba-a22f-d68afc5e9e58'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:17:52 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-5debc77e-018c-4459-9ead-be953f633dd6 tempest-VolumesExtendTest-906497550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:17:52 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-5debc77e-018c-4459-9ead-be953f633dd6 tempest-VolumesExtendTest-906497550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:17:52 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-5debc77e-018c-4459-9ead-be953f633dd6 tempest-VolumesExtendTest-906497550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:17:52 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-5debc77e-018c-4459-9ead-be953f633dd6 tempest-VolumesExtendTest-906497550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:17:52 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-5debc77e-018c-4459-9ead-be953f633dd6 tempest-VolumesExtendTest-906497550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:17:52 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-5debc77e-018c-4459-9ead-be953f633dd6 tempest-VolumesExtendTest-906497550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:17:52 devstack sudo[95667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:17:52 devstack sudo[95667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:17:52 devstack sudo[95667]: pam_unix(sudo:session): session closed for user root Aug 29 01:17:52 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-5debc77e-018c-4459-9ead-be953f633dd6 tempest-VolumesExtendTest-906497550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.332s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:17:52 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-5debc77e-018c-4459-9ead-be953f633dd6 tempest-VolumesExtendTest-906497550 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:17:52 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-5debc77e-018c-4459-9ead-be953f633dd6 tempest-VolumesExtendTest-906497550 None] Deleted volume successfully. Aug 29 01:17:52 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-5debc77e-018c-4459-9ead-be953f633dd6 tempest-VolumesExtendTest-906497550 None] Lock "cinder-7dd87c6b-e6f0-4b20-93ed-6de1f76ba612-delete_volume" released by "delete_volume" :: held 1.748s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:17:53 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-6390f48b-617e-40ef-a9fb-2da34f8a3417 tempest-VolumesExtendTest-906497550 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:17:53 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6390f48b-617e-40ef-a9fb-2da34f8a3417 tempest-VolumesExtendTest-906497550 None] Flow 'volume_create_manager' (e2c29d84-44b6-43ea-9d57-eebd40898118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:17:53 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6390f48b-617e-40ef-a9fb-2da34f8a3417 tempest-VolumesExtendTest-906497550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85f6dda7-e9bc-469c-8e18-68399234d167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:17:53 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6390f48b-617e-40ef-a9fb-2da34f8a3417 tempest-VolumesExtendTest-906497550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85f6dda7-e9bc-469c-8e18-68399234d167) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:17:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1742858043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3763a1e2-2b36-44c5-81a1-64bc81958483,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5e455a7c7ef4fb4aea3079196420e2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:17:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:17:54Z,use_quota=True,user_id='92d8da87562544b5900b0ce4c7f02368',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:17:53 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6390f48b-617e-40ef-a9fb-2da34f8a3417 tempest-VolumesExtendTest-906497550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecb0ec98-7688-45c6-89e8-07614f071288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:17:53 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6390f48b-617e-40ef-a9fb-2da34f8a3417 tempest-VolumesExtendTest-906497550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecb0ec98-7688-45c6-89e8-07614f071288) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:17:53 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6390f48b-617e-40ef-a9fb-2da34f8a3417 tempest-VolumesExtendTest-906497550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55f46e64-2055-4fc2-a841-ac46f06fd1cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:17:53 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6390f48b-617e-40ef-a9fb-2da34f8a3417 tempest-VolumesExtendTest-906497550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55f46e64-2055-4fc2-a841-ac46f06fd1cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3763a1e2-2b36-44c5-81a1-64bc81958483', 'volume_name': 'volume-3763a1e2-2b36-44c5-81a1-64bc81958483', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:17:53 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6390f48b-617e-40ef-a9fb-2da34f8a3417 tempest-VolumesExtendTest-906497550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93775f01-cba3-423c-a0a7-388fc6a9e40b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:17:53 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6390f48b-617e-40ef-a9fb-2da34f8a3417 tempest-VolumesExtendTest-906497550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93775f01-cba3-423c-a0a7-388fc6a9e40b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:17:53 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6390f48b-617e-40ef-a9fb-2da34f8a3417 tempest-VolumesExtendTest-906497550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c76163e1-f042-4df3-a9ff-a685ce74aa47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:17:53 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-6390f48b-617e-40ef-a9fb-2da34f8a3417 tempest-VolumesExtendTest-906497550 None] Volume 3763a1e2-2b36-44c5-81a1-64bc81958483: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3763a1e2-2b36-44c5-81a1-64bc81958483', 'volume_size': 1} Aug 29 01:17:53 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-6390f48b-617e-40ef-a9fb-2da34f8a3417 tempest-VolumesExtendTest-906497550 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:17:53 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-6390f48b-617e-40ef-a9fb-2da34f8a3417 tempest-VolumesExtendTest-906497550 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:17:53 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-6390f48b-617e-40ef-a9fb-2da34f8a3417 tempest-VolumesExtendTest-906497550 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:17:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1742858043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3763a1e2-2b36-44c5-81a1-64bc81958483,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5e455a7c7ef4fb4aea3079196420e2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:17:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:17:54Z,use_quota=True,user_id='92d8da87562544b5900b0ce4c7f02368',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:17:53 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-6390f48b-617e-40ef-a9fb-2da34f8a3417 tempest-VolumesExtendTest-906497550 None] Creating volume 3763a1e2-2b36-44c5-81a1-64bc81958483 {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:17:53 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-6390f48b-617e-40ef-a9fb-2da34f8a3417 tempest-VolumesExtendTest-906497550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:17:53 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-6390f48b-617e-40ef-a9fb-2da34f8a3417 tempest-VolumesExtendTest-906497550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:17:53 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-6390f48b-617e-40ef-a9fb-2da34f8a3417 tempest-VolumesExtendTest-906497550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:17:53 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-6390f48b-617e-40ef-a9fb-2da34f8a3417 tempest-VolumesExtendTest-906497550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:17:53 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-6390f48b-617e-40ef-a9fb-2da34f8a3417 tempest-VolumesExtendTest-906497550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:17:53 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-6390f48b-617e-40ef-a9fb-2da34f8a3417 tempest-VolumesExtendTest-906497550 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:17:53 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-6390f48b-617e-40ef-a9fb-2da34f8a3417 tempest-VolumesExtendTest-906497550 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:17:53 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-6390f48b-617e-40ef-a9fb-2da34f8a3417 tempest-VolumesExtendTest-906497550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3763a1e2-2b36-44c5-81a1-64bc81958483 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:17:53 devstack sudo[95671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3763a1e2-2b36-44c5-81a1-64bc81958483 1073741824 Aug 29 01:17:53 devstack sudo[95671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:17:54 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-757a31c1-f549-4396-b265-7a4dd0198d52 tempest-SnapshotsActionsTest-1924917168 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:17:54 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-757a31c1-f549-4396-b265-7a4dd0198d52 tempest-SnapshotsActionsTest-1924917168 None] Flow 'volume_create_manager' (1cfebd3a-5f65-491d-9810-8c08c20d14aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:17:54 devstack sudo[95671]: pam_unix(sudo:session): session closed for user root Aug 29 01:17:54 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-757a31c1-f549-4396-b265-7a4dd0198d52 tempest-SnapshotsActionsTest-1924917168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce132e6f-6889-4197-8d18-94b09dd1a319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:17:54 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-6390f48b-617e-40ef-a9fb-2da34f8a3417 tempest-VolumesExtendTest-906497550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3763a1e2-2b36-44c5-81a1-64bc81958483 1073741824" returned: 0 in 0.989s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:17:54 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-757a31c1-f549-4396-b265-7a4dd0198d52 tempest-SnapshotsActionsTest-1924917168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce132e6f-6889-4197-8d18-94b09dd1a319) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:17:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-83791031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e056373-2aa3-4fa0-922e-3bbf1c28628b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63b2d08d12b8478b8949c343ec48bca4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:17:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:17:55Z,use_quota=True,user_id='af05068e1fe6462eb60ce8209c39653b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:17:54 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-757a31c1-f549-4396-b265-7a4dd0198d52 tempest-SnapshotsActionsTest-1924917168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bee3078-a2ce-434d-bde8-dddde72c443c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:17:54 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-757a31c1-f549-4396-b265-7a4dd0198d52 tempest-SnapshotsActionsTest-1924917168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bee3078-a2ce-434d-bde8-dddde72c443c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:17:54 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-757a31c1-f549-4396-b265-7a4dd0198d52 tempest-SnapshotsActionsTest-1924917168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b93f45db-35c5-45d7-a623-7fbb784088fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:17:54 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-757a31c1-f549-4396-b265-7a4dd0198d52 tempest-SnapshotsActionsTest-1924917168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b93f45db-35c5-45d7-a623-7fbb784088fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e056373-2aa3-4fa0-922e-3bbf1c28628b', 'volume_name': 'volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:17:54 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-757a31c1-f549-4396-b265-7a4dd0198d52 tempest-SnapshotsActionsTest-1924917168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a7ce0ad-3133-439b-a3ee-3e79f97101e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:17:54 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-757a31c1-f549-4396-b265-7a4dd0198d52 tempest-SnapshotsActionsTest-1924917168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a7ce0ad-3133-439b-a3ee-3e79f97101e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:17:54 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-757a31c1-f549-4396-b265-7a4dd0198d52 tempest-SnapshotsActionsTest-1924917168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55df3faa-f96f-49db-96d0-ec96dac4bca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:17:54 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-757a31c1-f549-4396-b265-7a4dd0198d52 tempest-SnapshotsActionsTest-1924917168 None] Volume 3e056373-2aa3-4fa0-922e-3bbf1c28628b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b', 'volume_size': 1} Aug 29 01:17:54 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-757a31c1-f549-4396-b265-7a4dd0198d52 tempest-SnapshotsActionsTest-1924917168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:17:54 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-6390f48b-617e-40ef-a9fb-2da34f8a3417 tempest-VolumesExtendTest-906497550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3763a1e2-2b36-44c5-81a1-64bc81958483 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:17:55 devstack sudo[95716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3763a1e2-2b36-44c5-81a1-64bc81958483 Aug 29 01:17:55 devstack sudo[95716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:17:55 devstack sudo[95716]: pam_unix(sudo:session): session closed for user root Aug 29 01:17:55 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-6390f48b-617e-40ef-a9fb-2da34f8a3417 tempest-VolumesExtendTest-906497550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3763a1e2-2b36-44c5-81a1-64bc81958483" returned: 0 in 0.412s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:17:55 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-6390f48b-617e-40ef-a9fb-2da34f8a3417 tempest-VolumesExtendTest-906497550 None] <== create_volume: return (1517ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:17:55 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-6390f48b-617e-40ef-a9fb-2da34f8a3417 tempest-VolumesExtendTest-906497550 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.521s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:17:55 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-757a31c1-f549-4396-b265-7a4dd0198d52 tempest-SnapshotsActionsTest-1924917168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.457s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:17:55 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-757a31c1-f549-4396-b265-7a4dd0198d52 tempest-SnapshotsActionsTest-1924917168 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:17:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-83791031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e056373-2aa3-4fa0-922e-3bbf1c28628b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63b2d08d12b8478b8949c343ec48bca4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:17:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:17:55Z,use_quota=True,user_id='af05068e1fe6462eb60ce8209c39653b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:17:55 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-757a31c1-f549-4396-b265-7a4dd0198d52 tempest-SnapshotsActionsTest-1924917168 None] Creating volume 3e056373-2aa3-4fa0-922e-3bbf1c28628b {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:17:55 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-757a31c1-f549-4396-b265-7a4dd0198d52 tempest-SnapshotsActionsTest-1924917168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:17:55 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-757a31c1-f549-4396-b265-7a4dd0198d52 tempest-SnapshotsActionsTest-1924917168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:17:55 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-757a31c1-f549-4396-b265-7a4dd0198d52 tempest-SnapshotsActionsTest-1924917168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:17:55 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-757a31c1-f549-4396-b265-7a4dd0198d52 tempest-SnapshotsActionsTest-1924917168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:17:55 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-757a31c1-f549-4396-b265-7a4dd0198d52 tempest-SnapshotsActionsTest-1924917168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:17:55 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-757a31c1-f549-4396-b265-7a4dd0198d52 tempest-SnapshotsActionsTest-1924917168 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:17:55 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-757a31c1-f549-4396-b265-7a4dd0198d52 tempest-SnapshotsActionsTest-1924917168 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:17:55 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-757a31c1-f549-4396-b265-7a4dd0198d52 tempest-SnapshotsActionsTest-1924917168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:17:55 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6390f48b-617e-40ef-a9fb-2da34f8a3417 tempest-VolumesExtendTest-906497550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c76163e1-f042-4df3-a9ff-a685ce74aa47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3763a1e2-2b36-44c5-81a1-64bc81958483', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:17:55 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6390f48b-617e-40ef-a9fb-2da34f8a3417 tempest-VolumesExtendTest-906497550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb9f6ca3-da1f-4f43-99d1-a4a2e06125f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:17:55 devstack sudo[95719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b 1073741824 Aug 29 01:17:55 devstack sudo[95719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:17:55 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-6390f48b-617e-40ef-a9fb-2da34f8a3417 tempest-VolumesExtendTest-906497550 None] Volume volume-3763a1e2-2b36-44c5-81a1-64bc81958483 (3763a1e2-2b36-44c5-81a1-64bc81958483): created successfully Aug 29 01:17:55 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6390f48b-617e-40ef-a9fb-2da34f8a3417 tempest-VolumesExtendTest-906497550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb9f6ca3-da1f-4f43-99d1-a4a2e06125f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:17:55 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6390f48b-617e-40ef-a9fb-2da34f8a3417 tempest-VolumesExtendTest-906497550 None] Flow 'volume_create_manager' (e2c29d84-44b6-43ea-9d57-eebd40898118) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:17:55 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-6390f48b-617e-40ef-a9fb-2da34f8a3417 tempest-VolumesExtendTest-906497550 None] Created volume successfully. Aug 29 01:17:56 devstack sudo[95719]: pam_unix(sudo:session): session closed for user root Aug 29 01:17:56 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-757a31c1-f549-4396-b265-7a4dd0198d52 tempest-SnapshotsActionsTest-1924917168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b 1073741824" returned: 0 in 0.631s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:17:56 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-757a31c1-f549-4396-b265-7a4dd0198d52 tempest-SnapshotsActionsTest-1924917168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:17:56 devstack sudo[95728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b Aug 29 01:17:56 devstack sudo[95728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:17:56 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-8726e008-fd89-4a5e-8fda-f6f0ff28056b tempest-VolumesExtendTest-906497550 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:17:56 devstack sudo[95728]: pam_unix(sudo:session): session closed for user root Aug 29 01:17:56 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-757a31c1-f549-4396-b265-7a4dd0198d52 tempest-SnapshotsActionsTest-1924917168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b" returned: 0 in 0.582s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:17:56 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-757a31c1-f549-4396-b265-7a4dd0198d52 tempest-SnapshotsActionsTest-1924917168 None] <== create_volume: return (1442ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:17:56 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-757a31c1-f549-4396-b265-7a4dd0198d52 tempest-SnapshotsActionsTest-1924917168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.445s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:17:56 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-8726e008-fd89-4a5e-8fda-f6f0ff28056b tempest-VolumesExtendTest-906497550 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.378s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:17:56 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-8726e008-fd89-4a5e-8fda-f6f0ff28056b tempest-VolumesExtendTest-906497550 None] Creating offline snapshot edadb793-aebb-48f6-b286-6eebfe613cd6 of volume 3763a1e2-2b36-44c5-81a1-64bc81958483 {{(pid=86111) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 29 01:17:56 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-757a31c1-f549-4396-b265-7a4dd0198d52 tempest-SnapshotsActionsTest-1924917168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55df3faa-f96f-49db-96d0-ec96dac4bca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:17:56 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-757a31c1-f549-4396-b265-7a4dd0198d52 tempest-SnapshotsActionsTest-1924917168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4866589b-b4ae-44aa-8739-23975e22c10c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:17:56 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[30704815-9c98-423c-9835-21b07b398fd0]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:17:56 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8726e008-fd89-4a5e-8fda-f6f0ff28056b tempest-VolumesExtendTest-906497550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3763a1e2-2b36-44c5-81a1-64bc81958483 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:17:56 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-757a31c1-f549-4396-b265-7a4dd0198d52 tempest-SnapshotsActionsTest-1924917168 None] Volume volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b (3e056373-2aa3-4fa0-922e-3bbf1c28628b): created successfully Aug 29 01:17:56 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-757a31c1-f549-4396-b265-7a4dd0198d52 tempest-SnapshotsActionsTest-1924917168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4866589b-b4ae-44aa-8739-23975e22c10c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:17:56 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-757a31c1-f549-4396-b265-7a4dd0198d52 tempest-SnapshotsActionsTest-1924917168 None] Flow 'volume_create_manager' (1cfebd3a-5f65-491d-9810-8c08c20d14aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:17:56 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-757a31c1-f549-4396-b265-7a4dd0198d52 tempest-SnapshotsActionsTest-1924917168 None] Created volume successfully. Aug 29 01:17:57 devstack sudo[95731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3763a1e2-2b36-44c5-81a1-64bc81958483 Aug 29 01:17:57 devstack sudo[95731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:17:57 devstack sudo[95731]: pam_unix(sudo:session): session closed for user root Aug 29 01:17:57 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8726e008-fd89-4a5e-8fda-f6f0ff28056b tempest-VolumesExtendTest-906497550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3763a1e2-2b36-44c5-81a1-64bc81958483" returned: 0 in 0.558s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:17:57 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8726e008-fd89-4a5e-8fda-f6f0ff28056b tempest-VolumesExtendTest-906497550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3763a1e2-2b36-44c5-81a1-64bc81958483,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3763a1e2-2b36-44c5-81a1-64bc81958483.edadb793-aebb-48f6-b286-6eebfe613cd6 1G {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:17:57 devstack sudo[95736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3763a1e2-2b36-44c5-81a1-64bc81958483,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3763a1e2-2b36-44c5-81a1-64bc81958483.edadb793-aebb-48f6-b286-6eebfe613cd6 1G Aug 29 01:17:57 devstack sudo[95736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:17:58 devstack sudo[95736]: pam_unix(sudo:session): session closed for user root Aug 29 01:17:58 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8726e008-fd89-4a5e-8fda-f6f0ff28056b tempest-VolumesExtendTest-906497550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3763a1e2-2b36-44c5-81a1-64bc81958483,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3763a1e2-2b36-44c5-81a1-64bc81958483.edadb793-aebb-48f6-b286-6eebfe613cd6 1G" returned: 0 in 0.803s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:17:58 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8726e008-fd89-4a5e-8fda-f6f0ff28056b tempest-VolumesExtendTest-906497550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3763a1e2-2b36-44c5-81a1-64bc81958483 -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3763a1e2-2b36-44c5-81a1-64bc81958483.edadb793-aebb-48f6-b286-6eebfe613cd6 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:17:58 devstack sudo[95742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3763a1e2-2b36-44c5-81a1-64bc81958483 -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3763a1e2-2b36-44c5-81a1-64bc81958483.edadb793-aebb-48f6-b286-6eebfe613cd6 Aug 29 01:17:58 devstack sudo[95742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:17:58 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-bd01dd52-d33c-4ef5-bd7a-3a89091ae8ad tempest-SnapshotsActionsTest-1924917168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:17:58 devstack sudo[95742]: pam_unix(sudo:session): session closed for user root Aug 29 01:17:58 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8726e008-fd89-4a5e-8fda-f6f0ff28056b tempest-VolumesExtendTest-906497550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3763a1e2-2b36-44c5-81a1-64bc81958483 -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3763a1e2-2b36-44c5-81a1-64bc81958483.edadb793-aebb-48f6-b286-6eebfe613cd6" returned: 0 in 0.558s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:17:58 devstack cinder-volume[86111]: WARNING cinder.volume.drivers.remotefs [None req-8726e008-fd89-4a5e-8fda-f6f0ff28056b tempest-VolumesExtendTest-906497550 None] /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3763a1e2-2b36-44c5-81a1-64bc81958483.edadb793-aebb-48f6-b286-6eebfe613cd6 is being set with open permissions: ugo+rw Aug 29 01:17:58 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8726e008-fd89-4a5e-8fda-f6f0ff28056b tempest-VolumesExtendTest-906497550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3763a1e2-2b36-44c5-81a1-64bc81958483.edadb793-aebb-48f6-b286-6eebfe613cd6 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:17:58 devstack sudo[95748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3763a1e2-2b36-44c5-81a1-64bc81958483.edadb793-aebb-48f6-b286-6eebfe613cd6 Aug 29 01:17:58 devstack sudo[95748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:17:59 devstack sudo[95748]: pam_unix(sudo:session): session closed for user root Aug 29 01:17:59 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8726e008-fd89-4a5e-8fda-f6f0ff28056b tempest-VolumesExtendTest-906497550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3763a1e2-2b36-44c5-81a1-64bc81958483.edadb793-aebb-48f6-b286-6eebfe613cd6" returned: 0 in 0.307s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:17:59 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8726e008-fd89-4a5e-8fda-f6f0ff28056b tempest-VolumesExtendTest-906497550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3763a1e2-2b36-44c5-81a1-64bc81958483.info {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:17:59 devstack sudo[95751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3763a1e2-2b36-44c5-81a1-64bc81958483.info Aug 29 01:17:59 devstack sudo[95751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:17:59 devstack sudo[95751]: pam_unix(sudo:session): session closed for user root Aug 29 01:17:59 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8726e008-fd89-4a5e-8fda-f6f0ff28056b tempest-VolumesExtendTest-906497550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3763a1e2-2b36-44c5-81a1-64bc81958483.info" returned: 0 in 0.378s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:17:59 devstack cinder-volume[86111]: WARNING cinder.volume.drivers.remotefs [None req-8726e008-fd89-4a5e-8fda-f6f0ff28056b tempest-VolumesExtendTest-906497550 None] /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3763a1e2-2b36-44c5-81a1-64bc81958483.info is being set with open permissions: ugo+rw Aug 29 01:17:59 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8726e008-fd89-4a5e-8fda-f6f0ff28056b tempest-VolumesExtendTest-906497550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3763a1e2-2b36-44c5-81a1-64bc81958483.info {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:17:59 devstack sudo[95754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3763a1e2-2b36-44c5-81a1-64bc81958483.info Aug 29 01:17:59 devstack sudo[95754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:17:59 devstack sudo[95754]: pam_unix(sudo:session): session closed for user root Aug 29 01:17:59 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8726e008-fd89-4a5e-8fda-f6f0ff28056b tempest-VolumesExtendTest-906497550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3763a1e2-2b36-44c5-81a1-64bc81958483.info" returned: 0 in 0.394s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:17:59 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-8726e008-fd89-4a5e-8fda-f6f0ff28056b tempest-VolumesExtendTest-906497550 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.153s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:17:59 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-bd01dd52-d33c-4ef5-bd7a-3a89091ae8ad tempest-SnapshotsActionsTest-1924917168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.702s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:18:00 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-bd01dd52-d33c-4ef5-bd7a-3a89091ae8ad tempest-SnapshotsActionsTest-1924917168 None] Creating offline snapshot b3d39712-bb6a-47b8-95a0-a2391b942cc0 of volume 3e056373-2aa3-4fa0-922e-3bbf1c28628b {{(pid=86111) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 29 01:18:00 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-8726e008-fd89-4a5e-8fda-f6f0ff28056b tempest-VolumesExtendTest-906497550 None] Create snapshot completed successfully Aug 29 01:18:00 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b6ed4e8-006a-4e27-b9d7-ef6b9c3fac1e]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:18:00 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-bd01dd52-d33c-4ef5-bd7a-3a89091ae8ad tempest-SnapshotsActionsTest-1924917168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:18:00 devstack sudo[95757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b Aug 29 01:18:00 devstack sudo[95757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:18:00 devstack sudo[95757]: pam_unix(sudo:session): session closed for user root Aug 29 01:18:00 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-bd01dd52-d33c-4ef5-bd7a-3a89091ae8ad tempest-SnapshotsActionsTest-1924917168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b" returned: 0 in 0.638s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:18:00 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-bd01dd52-d33c-4ef5-bd7a-3a89091ae8ad tempest-SnapshotsActionsTest-1924917168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.b3d39712-bb6a-47b8-95a0-a2391b942cc0 1G {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:18:00 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-35619d40-019e-4dec-b8f8-ec7304b02c60 tempest-VolumesExtendTest-906497550 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:18:00 devstack sudo[95762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.b3d39712-bb6a-47b8-95a0-a2391b942cc0 1G Aug 29 01:18:00 devstack sudo[95762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:18:01 devstack sudo[95762]: pam_unix(sudo:session): session closed for user root Aug 29 01:18:01 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-bd01dd52-d33c-4ef5-bd7a-3a89091ae8ad tempest-SnapshotsActionsTest-1924917168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.b3d39712-bb6a-47b8-95a0-a2391b942cc0 1G" returned: 0 in 0.685s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:18:01 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-bd01dd52-d33c-4ef5-bd7a-3a89091ae8ad tempest-SnapshotsActionsTest-1924917168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.b3d39712-bb6a-47b8-95a0-a2391b942cc0 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:18:01 devstack sudo[95769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.b3d39712-bb6a-47b8-95a0-a2391b942cc0 Aug 29 01:18:01 devstack sudo[95769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:18:01 devstack sudo[95769]: pam_unix(sudo:session): session closed for user root Aug 29 01:18:01 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-bd01dd52-d33c-4ef5-bd7a-3a89091ae8ad tempest-SnapshotsActionsTest-1924917168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.b3d39712-bb6a-47b8-95a0-a2391b942cc0" returned: 0 in 0.356s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:18:01 devstack cinder-volume[86111]: WARNING cinder.volume.drivers.remotefs [None req-bd01dd52-d33c-4ef5-bd7a-3a89091ae8ad tempest-SnapshotsActionsTest-1924917168 None] /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.b3d39712-bb6a-47b8-95a0-a2391b942cc0 is being set with open permissions: ugo+rw Aug 29 01:18:01 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-bd01dd52-d33c-4ef5-bd7a-3a89091ae8ad tempest-SnapshotsActionsTest-1924917168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.b3d39712-bb6a-47b8-95a0-a2391b942cc0 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:18:01 devstack sudo[95775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.b3d39712-bb6a-47b8-95a0-a2391b942cc0 Aug 29 01:18:01 devstack sudo[95775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:18:02 devstack sudo[95775]: pam_unix(sudo:session): session closed for user root Aug 29 01:18:02 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-bd01dd52-d33c-4ef5-bd7a-3a89091ae8ad tempest-SnapshotsActionsTest-1924917168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.b3d39712-bb6a-47b8-95a0-a2391b942cc0" returned: 0 in 0.430s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:18:02 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-bd01dd52-d33c-4ef5-bd7a-3a89091ae8ad tempest-SnapshotsActionsTest-1924917168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.info {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:18:02 devstack sudo[95803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.info Aug 29 01:18:02 devstack sudo[95803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:18:02 devstack sudo[95803]: pam_unix(sudo:session): session closed for user root Aug 29 01:18:02 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-bd01dd52-d33c-4ef5-bd7a-3a89091ae8ad tempest-SnapshotsActionsTest-1924917168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.info" returned: 0 in 0.395s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:18:02 devstack cinder-volume[86111]: WARNING cinder.volume.drivers.remotefs [None req-bd01dd52-d33c-4ef5-bd7a-3a89091ae8ad tempest-SnapshotsActionsTest-1924917168 None] /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.info is being set with open permissions: ugo+rw Aug 29 01:18:02 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-bd01dd52-d33c-4ef5-bd7a-3a89091ae8ad tempest-SnapshotsActionsTest-1924917168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.info {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:18:02 devstack sudo[95806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.info Aug 29 01:18:02 devstack sudo[95806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:18:03 devstack sudo[95806]: pam_unix(sudo:session): session closed for user root Aug 29 01:18:03 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-bd01dd52-d33c-4ef5-bd7a-3a89091ae8ad tempest-SnapshotsActionsTest-1924917168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.info" returned: 0 in 0.393s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:18:03 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-bd01dd52-d33c-4ef5-bd7a-3a89091ae8ad tempest-SnapshotsActionsTest-1924917168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.119s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:18:03 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-35619d40-019e-4dec-b8f8-ec7304b02c60 tempest-VolumesExtendTest-906497550 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 2.368s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:18:03 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-bd01dd52-d33c-4ef5-bd7a-3a89091ae8ad tempest-SnapshotsActionsTest-1924917168 None] Create snapshot completed successfully Aug 29 01:18:03 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[6edfa99b-c1e4-4ba3-860e-966527f0a358]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:18:03 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-35619d40-019e-4dec-b8f8-ec7304b02c60 tempest-VolumesExtendTest-906497550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3763a1e2-2b36-44c5-81a1-64bc81958483 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:18:03 devstack sudo[95810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3763a1e2-2b36-44c5-81a1-64bc81958483 Aug 29 01:18:03 devstack sudo[95810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:18:03 devstack sudo[95810]: pam_unix(sudo:session): session closed for user root Aug 29 01:18:03 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-35619d40-019e-4dec-b8f8-ec7304b02c60 tempest-VolumesExtendTest-906497550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3763a1e2-2b36-44c5-81a1-64bc81958483" returned: 0 in 0.520s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:18:03 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-35619d40-019e-4dec-b8f8-ec7304b02c60 tempest-VolumesExtendTest-906497550 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3763a1e2-2b36-44c5-81a1-64bc81958483.edadb793-aebb-48f6-b286-6eebfe613cd6 2G {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:18:03 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-35619d40-019e-4dec-b8f8-ec7304b02c60 tempest-VolumesExtendTest-906497550 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3763a1e2-2b36-44c5-81a1-64bc81958483.edadb793-aebb-48f6-b286-6eebfe613cd6 2G" returned: 0 in 0.175s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:18:03 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-35619d40-019e-4dec-b8f8-ec7304b02c60 tempest-VolumesExtendTest-906497550 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.761s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:18:03 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-35619d40-019e-4dec-b8f8-ec7304b02c60 tempest-VolumesExtendTest-906497550 None] Extend volume completed successfully. Aug 29 01:18:04 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-f7a09905-d8c9-461e-a9e7-c0f3e8646cb2 tempest-SnapshotsActionsTest-1924917168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:18:04 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-f7a09905-d8c9-461e-a9e7-c0f3e8646cb2 tempest-SnapshotsActionsTest-1924917168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:18:04 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-f7a09905-d8c9-461e-a9e7-c0f3e8646cb2 tempest-SnapshotsActionsTest-1924917168 None] Creating offline snapshot 54af883a-dff8-4a6e-8ad8-3e6d2d0466d4 of volume 3e056373-2aa3-4fa0-922e-3bbf1c28628b {{(pid=86111) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 29 01:18:04 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[42844750-634c-4120-a1c6-5c1fd65b2d98]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:18:04 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-f7a09905-d8c9-461e-a9e7-c0f3e8646cb2 tempest-SnapshotsActionsTest-1924917168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.b3d39712-bb6a-47b8-95a0-a2391b942cc0 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:18:04 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-1ae42186-194b-468b-a4fc-021ed3452423 tempest-VolumesExtendTest-906497550 None] Acquiring lock "cinder-edadb793-aebb-48f6-b286-6eebfe613cd6-delete_snapshot" by "delete_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:18:04 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-1ae42186-194b-468b-a4fc-021ed3452423 tempest-VolumesExtendTest-906497550 None] Lock "cinder-edadb793-aebb-48f6-b286-6eebfe613cd6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:18:04 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-1ae42186-194b-468b-a4fc-021ed3452423 tempest-VolumesExtendTest-906497550 None] Acquiring lock "cinder-quobyte-3763a1e2-2b36-44c5-81a1-64bc81958483" by "delete_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:18:04 devstack sudo[95819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.b3d39712-bb6a-47b8-95a0-a2391b942cc0 Aug 29 01:18:04 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-1ae42186-194b-468b-a4fc-021ed3452423 tempest-VolumesExtendTest-906497550 None] Lock "cinder-quobyte-3763a1e2-2b36-44c5-81a1-64bc81958483" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:18:04 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-1ae42186-194b-468b-a4fc-021ed3452423 tempest-VolumesExtendTest-906497550 None] Acquiring lock "cinder-quobyte-edadb793-aebb-48f6-b286-6eebfe613cd6" by "_delete_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:18:04 devstack sudo[95819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:18:04 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-1ae42186-194b-468b-a4fc-021ed3452423 tempest-VolumesExtendTest-906497550 None] Lock "cinder-quobyte-edadb793-aebb-48f6-b286-6eebfe613cd6" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:18:04 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-1ae42186-194b-468b-a4fc-021ed3452423 tempest-VolumesExtendTest-906497550 None] Deleting offline snapshot edadb793-aebb-48f6-b286-6eebfe613cd6 of volume 3763a1e2-2b36-44c5-81a1-64bc81958483 {{(pid=86111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 29 01:18:04 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-1ae42186-194b-468b-a4fc-021ed3452423 tempest-VolumesExtendTest-906497550 None] snapshot_file for this snap is: volume-3763a1e2-2b36-44c5-81a1-64bc81958483.edadb793-aebb-48f6-b286-6eebfe613cd6 {{(pid=86111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 29 01:18:04 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[150b0215-554c-42cb-875f-e13208f3d549]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:18:04 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-1ae42186-194b-468b-a4fc-021ed3452423 tempest-VolumesExtendTest-906497550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3763a1e2-2b36-44c5-81a1-64bc81958483.edadb793-aebb-48f6-b286-6eebfe613cd6 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:18:04 devstack sudo[95821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3763a1e2-2b36-44c5-81a1-64bc81958483.edadb793-aebb-48f6-b286-6eebfe613cd6 Aug 29 01:18:04 devstack sudo[95821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:18:04 devstack sudo[95819]: pam_unix(sudo:session): session closed for user root Aug 29 01:18:04 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-f7a09905-d8c9-461e-a9e7-c0f3e8646cb2 tempest-SnapshotsActionsTest-1924917168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.b3d39712-bb6a-47b8-95a0-a2391b942cc0" returned: 0 in 0.555s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:18:04 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-f7a09905-d8c9-461e-a9e7-c0f3e8646cb2 tempest-SnapshotsActionsTest-1924917168 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 29 01:18:04 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-f7a09905-d8c9-461e-a9e7-c0f3e8646cb2 tempest-SnapshotsActionsTest-1924917168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.b3d39712-bb6a-47b8-95a0-a2391b942cc0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.54af883a-dff8-4a6e-8ad8-3e6d2d0466d4 1G {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:18:04 devstack sudo[95826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.b3d39712-bb6a-47b8-95a0-a2391b942cc0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.54af883a-dff8-4a6e-8ad8-3e6d2d0466d4 1G Aug 29 01:18:04 devstack sudo[95826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:18:04 devstack sudo[95821]: pam_unix(sudo:session): session closed for user root Aug 29 01:18:04 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-1ae42186-194b-468b-a4fc-021ed3452423 tempest-VolumesExtendTest-906497550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3763a1e2-2b36-44c5-81a1-64bc81958483.edadb793-aebb-48f6-b286-6eebfe613cd6" returned: 0 in 0.451s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:18:04 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-1ae42186-194b-468b-a4fc-021ed3452423 tempest-VolumesExtendTest-906497550 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3763a1e2-2b36-44c5-81a1-64bc81958483(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 29 01:18:04 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[0287fc53-85b7-4df2-b7db-d0bbb07591a2]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:18:04 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-1ae42186-194b-468b-a4fc-021ed3452423 tempest-VolumesExtendTest-906497550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3763a1e2-2b36-44c5-81a1-64bc81958483 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:18:05 devstack sudo[95831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3763a1e2-2b36-44c5-81a1-64bc81958483 Aug 29 01:18:05 devstack sudo[95831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:18:05 devstack sudo[95826]: pam_unix(sudo:session): session closed for user root Aug 29 01:18:05 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-f7a09905-d8c9-461e-a9e7-c0f3e8646cb2 tempest-SnapshotsActionsTest-1924917168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.b3d39712-bb6a-47b8-95a0-a2391b942cc0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.54af883a-dff8-4a6e-8ad8-3e6d2d0466d4 1G" returned: 0 in 0.674s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:18:05 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-f7a09905-d8c9-461e-a9e7-c0f3e8646cb2 tempest-SnapshotsActionsTest-1924917168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.b3d39712-bb6a-47b8-95a0-a2391b942cc0 -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.54af883a-dff8-4a6e-8ad8-3e6d2d0466d4 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:18:05 devstack sudo[95838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.b3d39712-bb6a-47b8-95a0-a2391b942cc0 -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.54af883a-dff8-4a6e-8ad8-3e6d2d0466d4 Aug 29 01:18:05 devstack sudo[95838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:18:05 devstack sudo[95831]: pam_unix(sudo:session): session closed for user root Aug 29 01:18:05 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-1ae42186-194b-468b-a4fc-021ed3452423 tempest-VolumesExtendTest-906497550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3763a1e2-2b36-44c5-81a1-64bc81958483" returned: 0 in 0.540s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:18:05 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-1ae42186-194b-468b-a4fc-021ed3452423 tempest-VolumesExtendTest-906497550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3763a1e2-2b36-44c5-81a1-64bc81958483.edadb793-aebb-48f6-b286-6eebfe613cd6 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:18:05 devstack sudo[95841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3763a1e2-2b36-44c5-81a1-64bc81958483.edadb793-aebb-48f6-b286-6eebfe613cd6 Aug 29 01:18:05 devstack sudo[95841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:18:05 devstack sudo[95838]: pam_unix(sudo:session): session closed for user root Aug 29 01:18:05 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-f7a09905-d8c9-461e-a9e7-c0f3e8646cb2 tempest-SnapshotsActionsTest-1924917168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.b3d39712-bb6a-47b8-95a0-a2391b942cc0 -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.54af883a-dff8-4a6e-8ad8-3e6d2d0466d4" returned: 0 in 0.360s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:18:05 devstack cinder-volume[86111]: WARNING cinder.volume.drivers.remotefs [None req-f7a09905-d8c9-461e-a9e7-c0f3e8646cb2 tempest-SnapshotsActionsTest-1924917168 None] /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.54af883a-dff8-4a6e-8ad8-3e6d2d0466d4 is being set with open permissions: ugo+rw Aug 29 01:18:05 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-f7a09905-d8c9-461e-a9e7-c0f3e8646cb2 tempest-SnapshotsActionsTest-1924917168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.54af883a-dff8-4a6e-8ad8-3e6d2d0466d4 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:18:05 devstack sudo[95850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.54af883a-dff8-4a6e-8ad8-3e6d2d0466d4 Aug 29 01:18:05 devstack sudo[95850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:18:05 devstack sudo[95841]: pam_unix(sudo:session): session closed for user root Aug 29 01:18:05 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-1ae42186-194b-468b-a4fc-021ed3452423 tempest-VolumesExtendTest-906497550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3763a1e2-2b36-44c5-81a1-64bc81958483.edadb793-aebb-48f6-b286-6eebfe613cd6" returned: 0 in 0.445s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:18:05 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-1ae42186-194b-468b-a4fc-021ed3452423 tempest-VolumesExtendTest-906497550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3763a1e2-2b36-44c5-81a1-64bc81958483.edadb793-aebb-48f6-b286-6eebfe613cd6 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:18:05 devstack sudo[95853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3763a1e2-2b36-44c5-81a1-64bc81958483.edadb793-aebb-48f6-b286-6eebfe613cd6 Aug 29 01:18:05 devstack sudo[95853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:18:06 devstack sudo[95850]: pam_unix(sudo:session): session closed for user root Aug 29 01:18:06 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-f7a09905-d8c9-461e-a9e7-c0f3e8646cb2 tempest-SnapshotsActionsTest-1924917168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.54af883a-dff8-4a6e-8ad8-3e6d2d0466d4" returned: 0 in 0.311s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:18:06 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-f7a09905-d8c9-461e-a9e7-c0f3e8646cb2 tempest-SnapshotsActionsTest-1924917168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.026s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:18:06 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-f7a09905-d8c9-461e-a9e7-c0f3e8646cb2 tempest-SnapshotsActionsTest-1924917168 None] Create snapshot completed successfully Aug 29 01:18:06 devstack sudo[95853]: pam_unix(sudo:session): session closed for user root Aug 29 01:18:06 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-1ae42186-194b-468b-a4fc-021ed3452423 tempest-VolumesExtendTest-906497550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3763a1e2-2b36-44c5-81a1-64bc81958483.edadb793-aebb-48f6-b286-6eebfe613cd6" returned: 0 in 0.308s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:18:06 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-1ae42186-194b-468b-a4fc-021ed3452423 tempest-VolumesExtendTest-906497550 None] Lock "cinder-quobyte-edadb793-aebb-48f6-b286-6eebfe613cd6" released by "_delete_snapshot" :: held 1.893s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:18:06 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-1ae42186-194b-468b-a4fc-021ed3452423 tempest-VolumesExtendTest-906497550 None] Lock "cinder-quobyte-3763a1e2-2b36-44c5-81a1-64bc81958483" released by "delete_snapshot" :: held 1.926s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:18:06 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-70f87790-0981-4a3f-8efa-0923aea8fe3c tempest-SnapshotsActionsTest-1165394092 None] Acquiring lock "cinder-54af883a-dff8-4a6e-8ad8-3e6d2d0466d4-delete_snapshot" by "delete_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:18:06 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-1ae42186-194b-468b-a4fc-021ed3452423 tempest-VolumesExtendTest-906497550 None] Created reservations ['0397f912-f561-488e-a0e5-26303d6c6e98', '0761644f-0dc8-44a6-ab1a-bb03bb80fc52', '85a63b9c-8612-42c1-84a9-fa149c40f7df', '4ecaae0f-9c46-4079-a80a-633dfc745afe'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:18:06 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-70f87790-0981-4a3f-8efa-0923aea8fe3c tempest-SnapshotsActionsTest-1165394092 None] Lock "cinder-54af883a-dff8-4a6e-8ad8-3e6d2d0466d4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:18:06 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-70f87790-0981-4a3f-8efa-0923aea8fe3c tempest-SnapshotsActionsTest-1165394092 None] Acquiring lock "cinder-quobyte-3e056373-2aa3-4fa0-922e-3bbf1c28628b" by "delete_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:18:06 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-70f87790-0981-4a3f-8efa-0923aea8fe3c tempest-SnapshotsActionsTest-1165394092 None] Lock "cinder-quobyte-3e056373-2aa3-4fa0-922e-3bbf1c28628b" acquired by "delete_snapshot" :: waited 0.046s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:18:06 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-70f87790-0981-4a3f-8efa-0923aea8fe3c tempest-SnapshotsActionsTest-1165394092 None] Acquiring lock "cinder-quobyte-54af883a-dff8-4a6e-8ad8-3e6d2d0466d4" by "_delete_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:18:06 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-1ae42186-194b-468b-a4fc-021ed3452423 tempest-VolumesExtendTest-906497550 None] Delete snapshot completed successfully. Aug 29 01:18:06 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-1ae42186-194b-468b-a4fc-021ed3452423 tempest-VolumesExtendTest-906497550 None] Lock "cinder-edadb793-aebb-48f6-b286-6eebfe613cd6-delete_snapshot" released by "delete_snapshot" :: held 2.188s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:18:06 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-70f87790-0981-4a3f-8efa-0923aea8fe3c tempest-SnapshotsActionsTest-1165394092 None] Lock "cinder-quobyte-54af883a-dff8-4a6e-8ad8-3e6d2d0466d4" acquired by "_delete_snapshot" :: waited 0.054s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:18:06 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-70f87790-0981-4a3f-8efa-0923aea8fe3c tempest-SnapshotsActionsTest-1165394092 None] Deleting offline snapshot 54af883a-dff8-4a6e-8ad8-3e6d2d0466d4 of volume 3e056373-2aa3-4fa0-922e-3bbf1c28628b {{(pid=86111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 29 01:18:06 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-70f87790-0981-4a3f-8efa-0923aea8fe3c tempest-SnapshotsActionsTest-1165394092 None] snapshot_file for this snap is: volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.54af883a-dff8-4a6e-8ad8-3e6d2d0466d4 {{(pid=86111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 29 01:18:06 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[45dc155b-f8ae-46e7-a952-df616baa6d52]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:18:06 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-70f87790-0981-4a3f-8efa-0923aea8fe3c tempest-SnapshotsActionsTest-1165394092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.54af883a-dff8-4a6e-8ad8-3e6d2d0466d4 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:18:06 devstack sudo[95857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.54af883a-dff8-4a6e-8ad8-3e6d2d0466d4 Aug 29 01:18:06 devstack sudo[95857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:18:07 devstack sudo[95857]: pam_unix(sudo:session): session closed for user root Aug 29 01:18:07 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-70f87790-0981-4a3f-8efa-0923aea8fe3c tempest-SnapshotsActionsTest-1165394092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.54af883a-dff8-4a6e-8ad8-3e6d2d0466d4" returned: 0 in 0.404s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:18:07 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-70f87790-0981-4a3f-8efa-0923aea8fe3c tempest-SnapshotsActionsTest-1165394092 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 29 01:18:07 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[a309b5aa-565b-4a25-89a2-8a879f371ce2]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:18:07 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-70f87790-0981-4a3f-8efa-0923aea8fe3c tempest-SnapshotsActionsTest-1165394092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.b3d39712-bb6a-47b8-95a0-a2391b942cc0 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:18:07 devstack sudo[95862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.b3d39712-bb6a-47b8-95a0-a2391b942cc0 Aug 29 01:18:07 devstack sudo[95862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:18:07 devstack sudo[95862]: pam_unix(sudo:session): session closed for user root Aug 29 01:18:07 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-70f87790-0981-4a3f-8efa-0923aea8fe3c tempest-SnapshotsActionsTest-1165394092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.b3d39712-bb6a-47b8-95a0-a2391b942cc0" returned: 0 in 0.420s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:18:07 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-70f87790-0981-4a3f-8efa-0923aea8fe3c tempest-SnapshotsActionsTest-1165394092 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 29 01:18:07 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-70f87790-0981-4a3f-8efa-0923aea8fe3c tempest-SnapshotsActionsTest-1165394092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.54af883a-dff8-4a6e-8ad8-3e6d2d0466d4 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:18:07 devstack sudo[95868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.54af883a-dff8-4a6e-8ad8-3e6d2d0466d4 Aug 29 01:18:07 devstack sudo[95868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:18:07 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-69f74704-d966-43d9-aac2-3d3b9a6f71be tempest-VolumesExtendTest-906497550 None] Acquiring lock "cinder-3763a1e2-2b36-44c5-81a1-64bc81958483-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:18:07 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-69f74704-d966-43d9-aac2-3d3b9a6f71be tempest-VolumesExtendTest-906497550 None] Lock "cinder-3763a1e2-2b36-44c5-81a1-64bc81958483-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:18:07 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-69f74704-d966-43d9-aac2-3d3b9a6f71be tempest-VolumesExtendTest-906497550 None] Acquiring lock "cinder-quobyte-3763a1e2-2b36-44c5-81a1-64bc81958483" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:18:07 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-69f74704-d966-43d9-aac2-3d3b9a6f71be tempest-VolumesExtendTest-906497550 None] Lock "cinder-quobyte-3763a1e2-2b36-44c5-81a1-64bc81958483" acquired by "delete_volume" :: waited 0.029s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:18:07 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[62fece14-438b-42dc-bed7-308df106f9e9]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:18:07 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-69f74704-d966-43d9-aac2-3d3b9a6f71be tempest-VolumesExtendTest-906497550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3763a1e2-2b36-44c5-81a1-64bc81958483 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:18:08 devstack sudo[95868]: pam_unix(sudo:session): session closed for user root Aug 29 01:18:08 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-70f87790-0981-4a3f-8efa-0923aea8fe3c tempest-SnapshotsActionsTest-1165394092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.54af883a-dff8-4a6e-8ad8-3e6d2d0466d4" returned: 0 in 0.533s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:18:08 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-70f87790-0981-4a3f-8efa-0923aea8fe3c tempest-SnapshotsActionsTest-1165394092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.54af883a-dff8-4a6e-8ad8-3e6d2d0466d4 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:18:08 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5e82b89-e010-4ce1-8195-efad03f7c0b1 tempest-TestInstancesWithCinderVolumes-192732122 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:18:08 devstack sudo[95875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.54af883a-dff8-4a6e-8ad8-3e6d2d0466d4 Aug 29 01:18:08 devstack sudo[95875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:18:08 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-d5e82b89-e010-4ce1-8195-efad03f7c0b1 tempest-TestInstancesWithCinderVolumes-192732122 None] Flow 'volume_create_manager' (2428afc3-5aca-4dc2-9b4c-ed6ca2d51054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:18:08 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-d5e82b89-e010-4ce1-8195-efad03f7c0b1 tempest-TestInstancesWithCinderVolumes-192732122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5f810f3-a4f4-4887-b04b-77436f40f959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:18:08 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-d5e82b89-e010-4ce1-8195-efad03f7c0b1 tempest-TestInstancesWithCinderVolumes-192732122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5f810f3-a4f4-4887-b04b-77436f40f959) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:18:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1372801769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2bb1fb0-957d-44ab-9fbb-d8fd0e74f3e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8daf2e93f6443b281ac011df81e97c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:18:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:18:08Z,use_quota=True,user_id='8c890d2625514fad939b9734680dae85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85588bf8-510f-4667-8bff-acc99fb779f0),volume_type_id=85588bf8-510f-4667-8bff-acc99fb779f0)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:18:08 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-d5e82b89-e010-4ce1-8195-efad03f7c0b1 tempest-TestInstancesWithCinderVolumes-192732122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (912bfb08-1ec0-4903-8302-48b1de95c8b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:18:08 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-d5e82b89-e010-4ce1-8195-efad03f7c0b1 tempest-TestInstancesWithCinderVolumes-192732122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (912bfb08-1ec0-4903-8302-48b1de95c8b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:18:08 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-d5e82b89-e010-4ce1-8195-efad03f7c0b1 tempest-TestInstancesWithCinderVolumes-192732122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64d5c465-9d7b-48e4-ae10-af546048f26d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:18:08 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-d5e82b89-e010-4ce1-8195-efad03f7c0b1 tempest-TestInstancesWithCinderVolumes-192732122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64d5c465-9d7b-48e4-ae10-af546048f26d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2bb1fb0-957d-44ab-9fbb-d8fd0e74f3e3', 'volume_name': 'volume-f2bb1fb0-957d-44ab-9fbb-d8fd0e74f3e3', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:18:08 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-d5e82b89-e010-4ce1-8195-efad03f7c0b1 tempest-TestInstancesWithCinderVolumes-192732122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7675f1c-f090-404d-97ea-071d7d5cd462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:18:08 devstack sudo[95874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3763a1e2-2b36-44c5-81a1-64bc81958483 Aug 29 01:18:08 devstack sudo[95874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:18:08 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-d5e82b89-e010-4ce1-8195-efad03f7c0b1 tempest-TestInstancesWithCinderVolumes-192732122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7675f1c-f090-404d-97ea-071d7d5cd462) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:18:08 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-d5e82b89-e010-4ce1-8195-efad03f7c0b1 tempest-TestInstancesWithCinderVolumes-192732122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (882adc00-9988-4972-a9cf-7ea8d77bb3c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:18:08 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-d5e82b89-e010-4ce1-8195-efad03f7c0b1 tempest-TestInstancesWithCinderVolumes-192732122 None] Volume f2bb1fb0-957d-44ab-9fbb-d8fd0e74f3e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2bb1fb0-957d-44ab-9fbb-d8fd0e74f3e3', 'volume_size': 1} Aug 29 01:18:08 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-d5e82b89-e010-4ce1-8195-efad03f7c0b1 tempest-TestInstancesWithCinderVolumes-192732122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:18:08 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-d5e82b89-e010-4ce1-8195-efad03f7c0b1 tempest-TestInstancesWithCinderVolumes-192732122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:18:08 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-d5e82b89-e010-4ce1-8195-efad03f7c0b1 tempest-TestInstancesWithCinderVolumes-192732122 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:18:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1372801769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2bb1fb0-957d-44ab-9fbb-d8fd0e74f3e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8daf2e93f6443b281ac011df81e97c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:18:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:18:08Z,use_quota=True,user_id='8c890d2625514fad939b9734680dae85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85588bf8-510f-4667-8bff-acc99fb779f0),volume_type_id=85588bf8-510f-4667-8bff-acc99fb779f0)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:18:08 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-d5e82b89-e010-4ce1-8195-efad03f7c0b1 tempest-TestInstancesWithCinderVolumes-192732122 None] Creating volume f2bb1fb0-957d-44ab-9fbb-d8fd0e74f3e3 {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:18:08 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-d5e82b89-e010-4ce1-8195-efad03f7c0b1 tempest-TestInstancesWithCinderVolumes-192732122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:18:08 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-d5e82b89-e010-4ce1-8195-efad03f7c0b1 tempest-TestInstancesWithCinderVolumes-192732122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:18:08 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-d5e82b89-e010-4ce1-8195-efad03f7c0b1 tempest-TestInstancesWithCinderVolumes-192732122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:18:08 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-d5e82b89-e010-4ce1-8195-efad03f7c0b1 tempest-TestInstancesWithCinderVolumes-192732122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:18:08 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-d5e82b89-e010-4ce1-8195-efad03f7c0b1 tempest-TestInstancesWithCinderVolumes-192732122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:18:08 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-d5e82b89-e010-4ce1-8195-efad03f7c0b1 tempest-TestInstancesWithCinderVolumes-192732122 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:18:08 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-d5e82b89-e010-4ce1-8195-efad03f7c0b1 tempest-TestInstancesWithCinderVolumes-192732122 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:18:08 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d5e82b89-e010-4ce1-8195-efad03f7c0b1 tempest-TestInstancesWithCinderVolumes-192732122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-f2bb1fb0-957d-44ab-9fbb-d8fd0e74f3e3 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:18:08 devstack sudo[95878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-f2bb1fb0-957d-44ab-9fbb-d8fd0e74f3e3 1073741824 Aug 29 01:18:08 devstack sudo[95878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:18:08 devstack sudo[95875]: pam_unix(sudo:session): session closed for user root Aug 29 01:18:08 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-70f87790-0981-4a3f-8efa-0923aea8fe3c tempest-SnapshotsActionsTest-1165394092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.54af883a-dff8-4a6e-8ad8-3e6d2d0466d4" returned: 0 in 0.403s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:18:08 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-70f87790-0981-4a3f-8efa-0923aea8fe3c tempest-SnapshotsActionsTest-1165394092 None] Lock "cinder-quobyte-54af883a-dff8-4a6e-8ad8-3e6d2d0466d4" released by "_delete_snapshot" :: held 1.932s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:18:08 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-70f87790-0981-4a3f-8efa-0923aea8fe3c tempest-SnapshotsActionsTest-1165394092 None] Lock "cinder-quobyte-3e056373-2aa3-4fa0-922e-3bbf1c28628b" released by "delete_snapshot" :: held 2.009s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:18:08 devstack sudo[95874]: pam_unix(sudo:session): session closed for user root Aug 29 01:18:08 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-70f87790-0981-4a3f-8efa-0923aea8fe3c tempest-SnapshotsActionsTest-1165394092 None] Created reservations ['9b53f6d4-6816-4888-9d1d-540b672e89e1', 'e8d71e94-ff58-40ba-819c-72c51f66f536', '06da8478-5bbd-4451-9e83-716c09f7528b', '9c525c30-f806-4dc0-a635-52d36d3ab085'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:18:08 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-69f74704-d966-43d9-aac2-3d3b9a6f71be tempest-VolumesExtendTest-906497550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3763a1e2-2b36-44c5-81a1-64bc81958483" returned: 0 in 0.697s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:18:08 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-69f74704-d966-43d9-aac2-3d3b9a6f71be tempest-VolumesExtendTest-906497550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3763a1e2-2b36-44c5-81a1-64bc81958483 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:18:08 devstack sudo[95908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3763a1e2-2b36-44c5-81a1-64bc81958483 Aug 29 01:18:08 devstack sudo[95908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:18:08 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-70f87790-0981-4a3f-8efa-0923aea8fe3c tempest-SnapshotsActionsTest-1165394092 None] Delete snapshot completed successfully. Aug 29 01:18:08 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-70f87790-0981-4a3f-8efa-0923aea8fe3c tempest-SnapshotsActionsTest-1165394092 None] Lock "cinder-54af883a-dff8-4a6e-8ad8-3e6d2d0466d4-delete_snapshot" released by "delete_snapshot" :: held 2.404s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:18:08 devstack sudo[95878]: pam_unix(sudo:session): session closed for user root Aug 29 01:18:08 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d5e82b89-e010-4ce1-8195-efad03f7c0b1 tempest-TestInstancesWithCinderVolumes-192732122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-f2bb1fb0-957d-44ab-9fbb-d8fd0e74f3e3 1073741824" returned: 0 in 0.761s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:18:08 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-1864bbcc-9aa6-4d7b-91df-76d18fd59dbd tempest-TestInstancesWithCinderVolumes-192732122 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:18:09 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-1864bbcc-9aa6-4d7b-91df-76d18fd59dbd tempest-TestInstancesWithCinderVolumes-192732122 None] Flow 'volume_create_manager' (1667b909-6c37-49a6-9a6e-dde67a16fd13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:18:09 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-1864bbcc-9aa6-4d7b-91df-76d18fd59dbd tempest-TestInstancesWithCinderVolumes-192732122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61159ad8-fa79-4958-8a04-08c37ae26410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:18:09 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d5e82b89-e010-4ce1-8195-efad03f7c0b1 tempest-TestInstancesWithCinderVolumes-192732122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-f2bb1fb0-957d-44ab-9fbb-d8fd0e74f3e3 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:18:09 devstack sudo[95908]: pam_unix(sudo:session): session closed for user root Aug 29 01:18:09 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-1864bbcc-9aa6-4d7b-91df-76d18fd59dbd tempest-TestInstancesWithCinderVolumes-192732122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61159ad8-fa79-4958-8a04-08c37ae26410) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:18:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-325217701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=343b0092-42e6-406d-bc65-7b0d0b6d0f05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8daf2e93f6443b281ac011df81e97c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:18:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:18:09Z,use_quota=True,user_id='8c890d2625514fad939b9734680dae85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1df8ad70-a901-452d-a392-f1ff0c9a5ac0),volume_type_id=1df8ad70-a901-452d-a392-f1ff0c9a5ac0)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:18:09 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-1864bbcc-9aa6-4d7b-91df-76d18fd59dbd tempest-TestInstancesWithCinderVolumes-192732122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b79f528a-42e8-43a5-a2fa-cca243e2c66a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:18:09 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-1864bbcc-9aa6-4d7b-91df-76d18fd59dbd tempest-TestInstancesWithCinderVolumes-192732122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b79f528a-42e8-43a5-a2fa-cca243e2c66a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:18:09 devstack sudo[95913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-f2bb1fb0-957d-44ab-9fbb-d8fd0e74f3e3 Aug 29 01:18:09 devstack sudo[95913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:18:09 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-1864bbcc-9aa6-4d7b-91df-76d18fd59dbd tempest-TestInstancesWithCinderVolumes-192732122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca6db9de-1c09-425f-86ad-6729df902bad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:18:09 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-1864bbcc-9aa6-4d7b-91df-76d18fd59dbd tempest-TestInstancesWithCinderVolumes-192732122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca6db9de-1c09-425f-86ad-6729df902bad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '343b0092-42e6-406d-bc65-7b0d0b6d0f05', 'volume_name': 'volume-343b0092-42e6-406d-bc65-7b0d0b6d0f05', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:18:09 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-1864bbcc-9aa6-4d7b-91df-76d18fd59dbd tempest-TestInstancesWithCinderVolumes-192732122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a8ef97a-b305-4629-987e-da8ebf547b42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:18:09 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-1864bbcc-9aa6-4d7b-91df-76d18fd59dbd tempest-TestInstancesWithCinderVolumes-192732122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a8ef97a-b305-4629-987e-da8ebf547b42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:18:09 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-1864bbcc-9aa6-4d7b-91df-76d18fd59dbd tempest-TestInstancesWithCinderVolumes-192732122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c505920-8e40-468e-b3ff-5a1978f22871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:18:09 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-1864bbcc-9aa6-4d7b-91df-76d18fd59dbd tempest-TestInstancesWithCinderVolumes-192732122 None] Volume 343b0092-42e6-406d-bc65-7b0d0b6d0f05: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-343b0092-42e6-406d-bc65-7b0d0b6d0f05', 'volume_size': 1} Aug 29 01:18:09 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-1864bbcc-9aa6-4d7b-91df-76d18fd59dbd tempest-TestInstancesWithCinderVolumes-192732122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:18:09 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-69f74704-d966-43d9-aac2-3d3b9a6f71be tempest-VolumesExtendTest-906497550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3763a1e2-2b36-44c5-81a1-64bc81958483" returned: 0 in 0.461s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:18:09 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-69f74704-d966-43d9-aac2-3d3b9a6f71be tempest-VolumesExtendTest-906497550 None] Lock "cinder-quobyte-3763a1e2-2b36-44c5-81a1-64bc81958483" released by "delete_volume" :: held 1.240s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:18:09 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-69f74704-d966-43d9-aac2-3d3b9a6f71be tempest-VolumesExtendTest-906497550 None] Created reservations ['9af4a904-2c9a-4dab-8710-184247468d7e', '650a2a00-03db-445f-b1be-e63bc4a5ae9c', 'f732fe5e-50e4-4cda-99f4-7aa2e279263d', 'acf63737-99dc-4979-b868-17042defd6d1'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:18:09 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-69f74704-d966-43d9-aac2-3d3b9a6f71be tempest-VolumesExtendTest-906497550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:18:09 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-69f74704-d966-43d9-aac2-3d3b9a6f71be tempest-VolumesExtendTest-906497550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:18:09 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-69f74704-d966-43d9-aac2-3d3b9a6f71be tempest-VolumesExtendTest-906497550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:18:09 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-69f74704-d966-43d9-aac2-3d3b9a6f71be tempest-VolumesExtendTest-906497550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:18:09 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-69f74704-d966-43d9-aac2-3d3b9a6f71be tempest-VolumesExtendTest-906497550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:18:09 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-69f74704-d966-43d9-aac2-3d3b9a6f71be tempest-VolumesExtendTest-906497550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:18:09 devstack sudo[95916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:18:09 devstack sudo[95916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:18:09 devstack sudo[95913]: pam_unix(sudo:session): session closed for user root Aug 29 01:18:09 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d5e82b89-e010-4ce1-8195-efad03f7c0b1 tempest-TestInstancesWithCinderVolumes-192732122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-f2bb1fb0-957d-44ab-9fbb-d8fd0e74f3e3" returned: 0 in 0.294s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:18:09 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-d5e82b89-e010-4ce1-8195-efad03f7c0b1 tempest-TestInstancesWithCinderVolumes-192732122 None] <== create_volume: return (1174ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:18:09 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-d5e82b89-e010-4ce1-8195-efad03f7c0b1 tempest-TestInstancesWithCinderVolumes-192732122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.178s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:18:09 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-1864bbcc-9aa6-4d7b-91df-76d18fd59dbd tempest-TestInstancesWithCinderVolumes-192732122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.238s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:18:09 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-1864bbcc-9aa6-4d7b-91df-76d18fd59dbd tempest-TestInstancesWithCinderVolumes-192732122 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:18:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-325217701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=343b0092-42e6-406d-bc65-7b0d0b6d0f05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8daf2e93f6443b281ac011df81e97c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:18:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:18:09Z,use_quota=True,user_id='8c890d2625514fad939b9734680dae85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1df8ad70-a901-452d-a392-f1ff0c9a5ac0),volume_type_id=1df8ad70-a901-452d-a392-f1ff0c9a5ac0)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:18:09 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-1864bbcc-9aa6-4d7b-91df-76d18fd59dbd tempest-TestInstancesWithCinderVolumes-192732122 None] Creating volume 343b0092-42e6-406d-bc65-7b0d0b6d0f05 {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:18:09 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-1864bbcc-9aa6-4d7b-91df-76d18fd59dbd tempest-TestInstancesWithCinderVolumes-192732122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:18:09 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-1864bbcc-9aa6-4d7b-91df-76d18fd59dbd tempest-TestInstancesWithCinderVolumes-192732122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:18:09 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-1864bbcc-9aa6-4d7b-91df-76d18fd59dbd tempest-TestInstancesWithCinderVolumes-192732122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:18:09 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-1864bbcc-9aa6-4d7b-91df-76d18fd59dbd tempest-TestInstancesWithCinderVolumes-192732122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:18:09 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-1864bbcc-9aa6-4d7b-91df-76d18fd59dbd tempest-TestInstancesWithCinderVolumes-192732122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:18:09 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-1864bbcc-9aa6-4d7b-91df-76d18fd59dbd tempest-TestInstancesWithCinderVolumes-192732122 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:18:09 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-1864bbcc-9aa6-4d7b-91df-76d18fd59dbd tempest-TestInstancesWithCinderVolumes-192732122 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:18:09 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-1864bbcc-9aa6-4d7b-91df-76d18fd59dbd tempest-TestInstancesWithCinderVolumes-192732122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-343b0092-42e6-406d-bc65-7b0d0b6d0f05 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:18:09 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-d5e82b89-e010-4ce1-8195-efad03f7c0b1 tempest-TestInstancesWithCinderVolumes-192732122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (882adc00-9988-4972-a9cf-7ea8d77bb3c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2bb1fb0-957d-44ab-9fbb-d8fd0e74f3e3', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:18:09 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-d5e82b89-e010-4ce1-8195-efad03f7c0b1 tempest-TestInstancesWithCinderVolumes-192732122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa70e997-2ce0-41b0-8257-d91f3f29f7b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:18:09 devstack sudo[95918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-343b0092-42e6-406d-bc65-7b0d0b6d0f05 1073741824 Aug 29 01:18:09 devstack sudo[95918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:18:09 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-d5e82b89-e010-4ce1-8195-efad03f7c0b1 tempest-TestInstancesWithCinderVolumes-192732122 None] Volume volume-f2bb1fb0-957d-44ab-9fbb-d8fd0e74f3e3 (f2bb1fb0-957d-44ab-9fbb-d8fd0e74f3e3): created successfully Aug 29 01:18:09 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-d5e82b89-e010-4ce1-8195-efad03f7c0b1 tempest-TestInstancesWithCinderVolumes-192732122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa70e997-2ce0-41b0-8257-d91f3f29f7b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:18:09 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-d5e82b89-e010-4ce1-8195-efad03f7c0b1 tempest-TestInstancesWithCinderVolumes-192732122 None] Flow 'volume_create_manager' (2428afc3-5aca-4dc2-9b4c-ed6ca2d51054) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:18:09 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-d5e82b89-e010-4ce1-8195-efad03f7c0b1 tempest-TestInstancesWithCinderVolumes-192732122 None] Created volume successfully. Aug 29 01:18:09 devstack sudo[95916]: pam_unix(sudo:session): session closed for user root Aug 29 01:18:09 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-69f74704-d966-43d9-aac2-3d3b9a6f71be tempest-VolumesExtendTest-906497550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.320s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:18:09 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-69f74704-d966-43d9-aac2-3d3b9a6f71be tempest-VolumesExtendTest-906497550 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:18:09 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-69f74704-d966-43d9-aac2-3d3b9a6f71be tempest-VolumesExtendTest-906497550 None] Deleted volume successfully. Aug 29 01:18:09 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-69f74704-d966-43d9-aac2-3d3b9a6f71be tempest-VolumesExtendTest-906497550 None] Lock "cinder-3763a1e2-2b36-44c5-81a1-64bc81958483-delete_volume" released by "delete_volume" :: held 1.835s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:18:09 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2b8bb9d-260e-4c97-85e9-f125c6f3b50b tempest-TestInstancesWithCinderVolumes-192732122 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:18:09 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-a2b8bb9d-260e-4c97-85e9-f125c6f3b50b tempest-TestInstancesWithCinderVolumes-192732122 None] Flow 'volume_create_manager' (9da04cac-09e3-40c2-ac94-31f5bb924350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:18:09 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-a2b8bb9d-260e-4c97-85e9-f125c6f3b50b tempest-TestInstancesWithCinderVolumes-192732122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76f22f20-6433-44b2-87aa-95e3133b130b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:18:09 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-a2b8bb9d-260e-4c97-85e9-f125c6f3b50b tempest-TestInstancesWithCinderVolumes-192732122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76f22f20-6433-44b2-87aa-95e3133b130b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:18:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-128249989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3178d0e-ea20-4d5e-9c79-9e4165e50dd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8daf2e93f6443b281ac011df81e97c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:18:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:18:10Z,use_quota=True,user_id='8c890d2625514fad939b9734680dae85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1618b9a2-ca7d-4f44-b0d3-86c9a111bae6),volume_type_id=1618b9a2-ca7d-4f44-b0d3-86c9a111bae6)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:18:09 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-a2b8bb9d-260e-4c97-85e9-f125c6f3b50b tempest-TestInstancesWithCinderVolumes-192732122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a47b29ea-2249-4d63-ae8e-ed308bbe1918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:18:09 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-a2b8bb9d-260e-4c97-85e9-f125c6f3b50b tempest-TestInstancesWithCinderVolumes-192732122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a47b29ea-2249-4d63-ae8e-ed308bbe1918) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:18:09 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-a2b8bb9d-260e-4c97-85e9-f125c6f3b50b tempest-TestInstancesWithCinderVolumes-192732122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (548559da-729f-43fe-ad2f-7987a7cd35cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:18:09 devstack cinder-volume[86111]: DEBUG cinder.image.glance [None req-a2b8bb9d-260e-4c97-85e9-f125c6f3b50b tempest-TestInstancesWithCinderVolumes-192732122 None] Creating Keystone auth plugin from conf {{(pid=86111) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 29 01:18:09 devstack sudo[95918]: pam_unix(sudo:session): session closed for user root Aug 29 01:18:09 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-1864bbcc-9aa6-4d7b-91df-76d18fd59dbd tempest-TestInstancesWithCinderVolumes-192732122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-343b0092-42e6-406d-bc65-7b0d0b6d0f05 1073741824" returned: 0 in 0.544s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:18:09 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-1864bbcc-9aa6-4d7b-91df-76d18fd59dbd tempest-TestInstancesWithCinderVolumes-192732122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-343b0092-42e6-406d-bc65-7b0d0b6d0f05 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:18:09 devstack sudo[95925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-343b0092-42e6-406d-bc65-7b0d0b6d0f05 Aug 29 01:18:09 devstack sudo[95925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:18:10 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-8b059bc9-c553-4f53-9d3e-7418a28f853f tempest-SnapshotsActionsTest-1924917168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:18:10 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-a2b8bb9d-260e-4c97-85e9-f125c6f3b50b tempest-TestInstancesWithCinderVolumes-192732122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (548559da-729f-43fe-ad2f-7987a7cd35cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e3178d0e-ea20-4d5e-9c79-9e4165e50dd5', 'volume_name': 'volume-e3178d0e-ea20-4d5e-9c79-9e4165e50dd5', 'volume_size': 1, 'image_id': '96b7c69d-b377-4230-ab44-d1a2da5adc69', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/96b7c69d-b377-4230-ab44-d1a2da5adc69', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--4197395', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e8daf2e93f6443b281ac011df81e97c8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '96b7c69d-b377-4230-ab44-d1a2da5adc69', 'created_at': datetime.datetime(2026, 8, 28, 23, 18, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 23, 18, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/96b7c69d-b377-4230-ab44-d1a2da5adc69/file', 'properties': {}}, 'image_service': }' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:18:10 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-a2b8bb9d-260e-4c97-85e9-f125c6f3b50b tempest-TestInstancesWithCinderVolumes-192732122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdcbb504-f27f-4271-83f7-52db72e5d051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:18:10 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-a2b8bb9d-260e-4c97-85e9-f125c6f3b50b tempest-TestInstancesWithCinderVolumes-192732122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdcbb504-f27f-4271-83f7-52db72e5d051) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:18:10 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-a2b8bb9d-260e-4c97-85e9-f125c6f3b50b tempest-TestInstancesWithCinderVolumes-192732122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d22e5f12-ca24-4d74-8443-42c75b796a80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:18:10 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-a2b8bb9d-260e-4c97-85e9-f125c6f3b50b tempest-TestInstancesWithCinderVolumes-192732122 None] Volume e3178d0e-ea20-4d5e-9c79-9e4165e50dd5: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e3178d0e-ea20-4d5e-9c79-9e4165e50dd5', 'volume_size': 1, 'image_id': '96b7c69d-b377-4230-ab44-d1a2da5adc69', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/96b7c69d-b377-4230-ab44-d1a2da5adc69', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--4197395', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e8daf2e93f6443b281ac011df81e97c8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '96b7c69d-b377-4230-ab44-d1a2da5adc69', 'created_at': datetime.datetime(2026, 8, 28, 23, 18, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 23, 18, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/96b7c69d-b377-4230-ab44-d1a2da5adc69/file', 'properties': {}}, 'image_service': } Aug 29 01:18:10 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2b8bb9d-260e-4c97-85e9-f125c6f3b50b tempest-TestInstancesWithCinderVolumes-192732122 None] Trying to clone e3178d0e-ea20-4d5e-9c79-9e4165e50dd5 from image 96b7c69d-b377-4230-ab44-d1a2da5adc69 at location (None, [{'url': 'file:///opt/stack/data/glance/images/96b7c69d-b377-4230-ab44-d1a2da5adc69', 'metadata': {}}]). {{(pid=86111) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 29 01:18:10 devstack sudo[95925]: pam_unix(sudo:session): session closed for user root Aug 29 01:18:10 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-1864bbcc-9aa6-4d7b-91df-76d18fd59dbd tempest-TestInstancesWithCinderVolumes-192732122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-343b0092-42e6-406d-bc65-7b0d0b6d0f05" returned: 0 in 0.305s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:18:10 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-1864bbcc-9aa6-4d7b-91df-76d18fd59dbd tempest-TestInstancesWithCinderVolumes-192732122 None] <== create_volume: return (908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:18:10 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-1864bbcc-9aa6-4d7b-91df-76d18fd59dbd tempest-TestInstancesWithCinderVolumes-192732122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.911s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:18:10 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-8b059bc9-c553-4f53-9d3e-7418a28f853f tempest-SnapshotsActionsTest-1924917168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.166s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:18:10 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-8b059bc9-c553-4f53-9d3e-7418a28f853f tempest-SnapshotsActionsTest-1924917168 None] Creating offline snapshot 0c3a9768-d3d0-433a-b2b1-1b405b0ccab9 of volume 3e056373-2aa3-4fa0-922e-3bbf1c28628b {{(pid=86111) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 29 01:18:10 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-1864bbcc-9aa6-4d7b-91df-76d18fd59dbd tempest-TestInstancesWithCinderVolumes-192732122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c505920-8e40-468e-b3ff-5a1978f22871) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-343b0092-42e6-406d-bc65-7b0d0b6d0f05', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:18:10 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-1864bbcc-9aa6-4d7b-91df-76d18fd59dbd tempest-TestInstancesWithCinderVolumes-192732122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41829087-48e1-4633-9b50-051a0df07fe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:18:10 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[03dcf199-e6f9-4dbf-a1bb-2ef361200ff6]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:18:10 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8b059bc9-c553-4f53-9d3e-7418a28f853f tempest-SnapshotsActionsTest-1924917168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.b3d39712-bb6a-47b8-95a0-a2391b942cc0 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:18:10 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-1864bbcc-9aa6-4d7b-91df-76d18fd59dbd tempest-TestInstancesWithCinderVolumes-192732122 None] Volume volume-343b0092-42e6-406d-bc65-7b0d0b6d0f05 (343b0092-42e6-406d-bc65-7b0d0b6d0f05): created successfully Aug 29 01:18:10 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-1864bbcc-9aa6-4d7b-91df-76d18fd59dbd tempest-TestInstancesWithCinderVolumes-192732122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41829087-48e1-4633-9b50-051a0df07fe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:18:10 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-1864bbcc-9aa6-4d7b-91df-76d18fd59dbd tempest-TestInstancesWithCinderVolumes-192732122 None] Flow 'volume_create_manager' (1667b909-6c37-49a6-9a6e-dde67a16fd13) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:18:10 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-1864bbcc-9aa6-4d7b-91df-76d18fd59dbd tempest-TestInstancesWithCinderVolumes-192732122 None] Created volume successfully. Aug 29 01:18:10 devstack sudo[95928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.b3d39712-bb6a-47b8-95a0-a2391b942cc0 Aug 29 01:18:10 devstack sudo[95928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:18:10 devstack sudo[95928]: pam_unix(sudo:session): session closed for user root Aug 29 01:18:10 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8b059bc9-c553-4f53-9d3e-7418a28f853f tempest-SnapshotsActionsTest-1924917168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.b3d39712-bb6a-47b8-95a0-a2391b942cc0" returned: 0 in 0.395s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:18:10 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-8b059bc9-c553-4f53-9d3e-7418a28f853f tempest-SnapshotsActionsTest-1924917168 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 29 01:18:10 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8b059bc9-c553-4f53-9d3e-7418a28f853f tempest-SnapshotsActionsTest-1924917168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.b3d39712-bb6a-47b8-95a0-a2391b942cc0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.0c3a9768-d3d0-433a-b2b1-1b405b0ccab9 1G {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:18:10 devstack sudo[95933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.b3d39712-bb6a-47b8-95a0-a2391b942cc0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.0c3a9768-d3d0-433a-b2b1-1b405b0ccab9 1G Aug 29 01:18:10 devstack sudo[95933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:18:11 devstack sudo[95933]: pam_unix(sudo:session): session closed for user root Aug 29 01:18:11 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8b059bc9-c553-4f53-9d3e-7418a28f853f tempest-SnapshotsActionsTest-1924917168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.b3d39712-bb6a-47b8-95a0-a2391b942cc0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.0c3a9768-d3d0-433a-b2b1-1b405b0ccab9 1G" returned: 0 in 0.582s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:18:11 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8b059bc9-c553-4f53-9d3e-7418a28f853f tempest-SnapshotsActionsTest-1924917168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.b3d39712-bb6a-47b8-95a0-a2391b942cc0 -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.0c3a9768-d3d0-433a-b2b1-1b405b0ccab9 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:18:11 devstack sudo[95939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.b3d39712-bb6a-47b8-95a0-a2391b942cc0 -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.0c3a9768-d3d0-433a-b2b1-1b405b0ccab9 Aug 29 01:18:11 devstack sudo[95939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:18:11 devstack sudo[95939]: pam_unix(sudo:session): session closed for user root Aug 29 01:18:11 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8b059bc9-c553-4f53-9d3e-7418a28f853f tempest-SnapshotsActionsTest-1924917168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.b3d39712-bb6a-47b8-95a0-a2391b942cc0 -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.0c3a9768-d3d0-433a-b2b1-1b405b0ccab9" returned: 0 in 0.347s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:18:11 devstack cinder-volume[86111]: WARNING cinder.volume.drivers.remotefs [None req-8b059bc9-c553-4f53-9d3e-7418a28f853f tempest-SnapshotsActionsTest-1924917168 None] /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.0c3a9768-d3d0-433a-b2b1-1b405b0ccab9 is being set with open permissions: ugo+rw Aug 29 01:18:11 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8b059bc9-c553-4f53-9d3e-7418a28f853f tempest-SnapshotsActionsTest-1924917168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.0c3a9768-d3d0-433a-b2b1-1b405b0ccab9 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:18:11 devstack sudo[95944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.0c3a9768-d3d0-433a-b2b1-1b405b0ccab9 Aug 29 01:18:11 devstack sudo[95944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:18:11 devstack sudo[95944]: pam_unix(sudo:session): session closed for user root Aug 29 01:18:11 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8b059bc9-c553-4f53-9d3e-7418a28f853f tempest-SnapshotsActionsTest-1924917168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.0c3a9768-d3d0-433a-b2b1-1b405b0ccab9" returned: 0 in 0.283s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:18:11 devstack cinder-volume[86111]: DEBUG dbcounter [-] [86111] Writing DB stats cinder:UPDATE=120,cinder:INSERT=37,cinder:DELETE=8,cinder:SELECT=116 {{(pid=86111) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 29 01:18:11 devstack cinder-volume[86111]: DEBUG dbcounter [-] [86111] Writing DB stats cinder:SELECT=103,cinder:UPDATE=122,cinder:INSERT=30,cinder:DELETE=9 {{(pid=86111) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 29 01:18:12 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-8b059bc9-c553-4f53-9d3e-7418a28f853f tempest-SnapshotsActionsTest-1924917168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.745s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:18:12 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-8b059bc9-c553-4f53-9d3e-7418a28f853f tempest-SnapshotsActionsTest-1924917168 None] Create snapshot completed successfully Aug 29 01:18:12 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-a17e754e-4349-464a-8ad6-89eeea007fa4 tempest-SnapshotsActionsTest-1165394092 None] Acquiring lock "cinder-0c3a9768-d3d0-433a-b2b1-1b405b0ccab9-delete_snapshot" by "delete_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:18:12 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-a17e754e-4349-464a-8ad6-89eeea007fa4 tempest-SnapshotsActionsTest-1165394092 None] Lock "cinder-0c3a9768-d3d0-433a-b2b1-1b405b0ccab9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:18:12 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-a17e754e-4349-464a-8ad6-89eeea007fa4 tempest-SnapshotsActionsTest-1165394092 None] Acquiring lock "cinder-quobyte-3e056373-2aa3-4fa0-922e-3bbf1c28628b" by "delete_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:18:12 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-a17e754e-4349-464a-8ad6-89eeea007fa4 tempest-SnapshotsActionsTest-1165394092 None] Lock "cinder-quobyte-3e056373-2aa3-4fa0-922e-3bbf1c28628b" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:18:12 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-a17e754e-4349-464a-8ad6-89eeea007fa4 tempest-SnapshotsActionsTest-1165394092 None] Acquiring lock "cinder-quobyte-0c3a9768-d3d0-433a-b2b1-1b405b0ccab9" by "_delete_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:18:12 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-a17e754e-4349-464a-8ad6-89eeea007fa4 tempest-SnapshotsActionsTest-1165394092 None] Lock "cinder-quobyte-0c3a9768-d3d0-433a-b2b1-1b405b0ccab9" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:18:12 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-a17e754e-4349-464a-8ad6-89eeea007fa4 tempest-SnapshotsActionsTest-1165394092 None] Deleting offline snapshot 0c3a9768-d3d0-433a-b2b1-1b405b0ccab9 of volume 3e056373-2aa3-4fa0-922e-3bbf1c28628b {{(pid=86111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 29 01:18:12 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-a17e754e-4349-464a-8ad6-89eeea007fa4 tempest-SnapshotsActionsTest-1165394092 None] snapshot_file for this snap is: volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.0c3a9768-d3d0-433a-b2b1-1b405b0ccab9 {{(pid=86111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 29 01:18:12 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[660dcaf2-b609-4332-9f73-14a35211f71a]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:18:12 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-a17e754e-4349-464a-8ad6-89eeea007fa4 tempest-SnapshotsActionsTest-1165394092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.0c3a9768-d3d0-433a-b2b1-1b405b0ccab9 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:18:12 devstack sudo[95947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.0c3a9768-d3d0-433a-b2b1-1b405b0ccab9 Aug 29 01:18:12 devstack sudo[95947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:18:12 devstack sudo[95947]: pam_unix(sudo:session): session closed for user root Aug 29 01:18:12 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-a17e754e-4349-464a-8ad6-89eeea007fa4 tempest-SnapshotsActionsTest-1165394092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.0c3a9768-d3d0-433a-b2b1-1b405b0ccab9" returned: 0 in 0.413s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:18:12 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-a17e754e-4349-464a-8ad6-89eeea007fa4 tempest-SnapshotsActionsTest-1165394092 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 29 01:18:12 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[0659a9d2-f781-41f8-a079-d31063c97fbe]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:18:12 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-a17e754e-4349-464a-8ad6-89eeea007fa4 tempest-SnapshotsActionsTest-1165394092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.b3d39712-bb6a-47b8-95a0-a2391b942cc0 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:18:13 devstack sudo[95952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.b3d39712-bb6a-47b8-95a0-a2391b942cc0 Aug 29 01:18:13 devstack sudo[95952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:18:13 devstack sudo[95952]: pam_unix(sudo:session): session closed for user root Aug 29 01:18:13 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-a17e754e-4349-464a-8ad6-89eeea007fa4 tempest-SnapshotsActionsTest-1165394092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.b3d39712-bb6a-47b8-95a0-a2391b942cc0" returned: 0 in 0.428s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:18:13 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-a17e754e-4349-464a-8ad6-89eeea007fa4 tempest-SnapshotsActionsTest-1165394092 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 29 01:18:13 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-a17e754e-4349-464a-8ad6-89eeea007fa4 tempest-SnapshotsActionsTest-1165394092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.0c3a9768-d3d0-433a-b2b1-1b405b0ccab9 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:18:13 devstack sudo[95957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.0c3a9768-d3d0-433a-b2b1-1b405b0ccab9 Aug 29 01:18:13 devstack sudo[95957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:18:13 devstack sudo[95957]: pam_unix(sudo:session): session closed for user root Aug 29 01:18:13 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-a17e754e-4349-464a-8ad6-89eeea007fa4 tempest-SnapshotsActionsTest-1165394092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.0c3a9768-d3d0-433a-b2b1-1b405b0ccab9" returned: 0 in 0.449s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:18:13 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-a17e754e-4349-464a-8ad6-89eeea007fa4 tempest-SnapshotsActionsTest-1165394092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.0c3a9768-d3d0-433a-b2b1-1b405b0ccab9 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:18:13 devstack sudo[95963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.0c3a9768-d3d0-433a-b2b1-1b405b0ccab9 Aug 29 01:18:13 devstack sudo[95963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:18:14 devstack sudo[95963]: pam_unix(sudo:session): session closed for user root Aug 29 01:18:14 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-a17e754e-4349-464a-8ad6-89eeea007fa4 tempest-SnapshotsActionsTest-1165394092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.0c3a9768-d3d0-433a-b2b1-1b405b0ccab9" returned: 0 in 0.295s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:18:14 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-a17e754e-4349-464a-8ad6-89eeea007fa4 tempest-SnapshotsActionsTest-1165394092 None] Lock "cinder-quobyte-0c3a9768-d3d0-433a-b2b1-1b405b0ccab9" released by "_delete_snapshot" :: held 1.698s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:18:14 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-a17e754e-4349-464a-8ad6-89eeea007fa4 tempest-SnapshotsActionsTest-1165394092 None] Lock "cinder-quobyte-3e056373-2aa3-4fa0-922e-3bbf1c28628b" released by "delete_snapshot" :: held 1.731s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:18:14 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-a17e754e-4349-464a-8ad6-89eeea007fa4 tempest-SnapshotsActionsTest-1165394092 None] Created reservations ['35f8d568-127e-4063-b455-0dc0e5c6b8c8', 'b9b79e02-cedb-4d79-b181-9aa33cd1df0f', '9b07d7c5-60eb-4097-a344-bf01be02453e', 'a8dbfcb4-4e35-411c-bcbe-b3bdd2160dea'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:18:14 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-a17e754e-4349-464a-8ad6-89eeea007fa4 tempest-SnapshotsActionsTest-1165394092 None] Delete snapshot completed successfully. Aug 29 01:18:14 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-a17e754e-4349-464a-8ad6-89eeea007fa4 tempest-SnapshotsActionsTest-1165394092 None] Lock "cinder-0c3a9768-d3d0-433a-b2b1-1b405b0ccab9-delete_snapshot" released by "delete_snapshot" :: held 1.924s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:18:14 devstack cinder-volume[86111]: DEBUG cinder.image.image_utils [None req-a2b8bb9d-260e-4c97-85e9-f125c6f3b50b tempest-TestInstancesWithCinderVolumes-192732122 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_96b7c69d-b377-4230-ab44-d1a2da5adc69_vv3cvud0devstack@QuobyteHD, size 20.69 MB, duration 4.24 sec {{(pid=86111) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 29 01:18:14 devstack cinder-volume[86111]: INFO cinder.image.image_utils [None req-a2b8bb9d-260e-4c97-85e9-f125c6f3b50b tempest-TestInstancesWithCinderVolumes-192732122 None] Image download 20.69 MB at 4.88 MB/s Aug 29 01:18:14 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eb6fe20-5d83-487b-bfb5-30e071b5e065]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:18:14 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-a2b8bb9d-260e-4c97-85e9-f125c6f3b50b tempest-TestInstancesWithCinderVolumes-192732122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_96b7c69d-b377-4230-ab44-d1a2da5adc69_vv3cvud0devstack@QuobyteHD {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:18:14 devstack sudo[95966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_96b7c69d-b377-4230-ab44-d1a2da5adc69_vv3cvud0devstack@QuobyteHD Aug 29 01:18:14 devstack sudo[95966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:18:14 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-116456a6-92d9-4bee-9e66-e0ea39ab79ea tempest-SnapshotsActionsTest-1924917168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:18:14 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-116456a6-92d9-4bee-9e66-e0ea39ab79ea tempest-SnapshotsActionsTest-1924917168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:18:14 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-116456a6-92d9-4bee-9e66-e0ea39ab79ea tempest-SnapshotsActionsTest-1924917168 None] Creating offline snapshot fe480e67-f297-4731-bdb1-51900acac190 of volume 3e056373-2aa3-4fa0-922e-3bbf1c28628b {{(pid=86111) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 29 01:18:14 devstack sudo[95966]: pam_unix(sudo:session): session closed for user root Aug 29 01:18:14 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-a2b8bb9d-260e-4c97-85e9-f125c6f3b50b tempest-TestInstancesWithCinderVolumes-192732122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_96b7c69d-b377-4230-ab44-d1a2da5adc69_vv3cvud0devstack@QuobyteHD" returned: 0 in 0.457s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:18:14 devstack cinder-volume[86111]: DEBUG cinder.image.image_utils [None req-a2b8bb9d-260e-4c97-85e9-f125c6f3b50b tempest-TestInstancesWithCinderVolumes-192732122 None] Temporary image 96b7c69d-b377-4230-ab44-d1a2da5adc69 is fetched for user 8c890d2625514fad939b9734680dae85. {{(pid=86111) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 29 01:18:14 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0f7b1e6-cce1-4d47-942a-44a24d661023]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:18:14 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-116456a6-92d9-4bee-9e66-e0ea39ab79ea tempest-SnapshotsActionsTest-1924917168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.b3d39712-bb6a-47b8-95a0-a2391b942cc0 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:18:15 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[05b5d4fc-e589-490e-b489-3176e04471bd]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:18:15 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-a2b8bb9d-260e-4c97-85e9-f125c6f3b50b tempest-TestInstancesWithCinderVolumes-192732122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_96b7c69d-b377-4230-ab44-d1a2da5adc69_vv3cvud0devstack@QuobyteHD {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:18:15 devstack sudo[95972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.b3d39712-bb6a-47b8-95a0-a2391b942cc0 Aug 29 01:18:15 devstack sudo[95972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:18:15 devstack sudo[95973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_96b7c69d-b377-4230-ab44-d1a2da5adc69_vv3cvud0devstack@QuobyteHD Aug 29 01:18:15 devstack sudo[95973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:18:15 devstack sudo[95972]: pam_unix(sudo:session): session closed for user root Aug 29 01:18:15 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-116456a6-92d9-4bee-9e66-e0ea39ab79ea tempest-SnapshotsActionsTest-1924917168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.b3d39712-bb6a-47b8-95a0-a2391b942cc0" returned: 0 in 0.511s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:18:15 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-116456a6-92d9-4bee-9e66-e0ea39ab79ea tempest-SnapshotsActionsTest-1924917168 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 29 01:18:15 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-116456a6-92d9-4bee-9e66-e0ea39ab79ea tempest-SnapshotsActionsTest-1924917168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.b3d39712-bb6a-47b8-95a0-a2391b942cc0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.fe480e67-f297-4731-bdb1-51900acac190 1G {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:18:15 devstack sudo[95973]: pam_unix(sudo:session): session closed for user root Aug 29 01:18:15 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-a2b8bb9d-260e-4c97-85e9-f125c6f3b50b tempest-TestInstancesWithCinderVolumes-192732122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_96b7c69d-b377-4230-ab44-d1a2da5adc69_vv3cvud0devstack@QuobyteHD" returned: 0 in 0.426s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:18:15 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-a2b8bb9d-260e-4c97-85e9-f125c6f3b50b tempest-TestInstancesWithCinderVolumes-192732122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:18:15 devstack sudo[95982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.b3d39712-bb6a-47b8-95a0-a2391b942cc0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.fe480e67-f297-4731-bdb1-51900acac190 1G Aug 29 01:18:15 devstack sudo[95982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:18:15 devstack sudo[95982]: pam_unix(sudo:session): session closed for user root Aug 29 01:18:15 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-116456a6-92d9-4bee-9e66-e0ea39ab79ea tempest-SnapshotsActionsTest-1924917168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.b3d39712-bb6a-47b8-95a0-a2391b942cc0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.fe480e67-f297-4731-bdb1-51900acac190 1G" returned: 0 in 0.504s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:18:15 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-116456a6-92d9-4bee-9e66-e0ea39ab79ea tempest-SnapshotsActionsTest-1924917168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.b3d39712-bb6a-47b8-95a0-a2391b942cc0 -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.fe480e67-f297-4731-bdb1-51900acac190 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:18:16 devstack sudo[95987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.b3d39712-bb6a-47b8-95a0-a2391b942cc0 -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.fe480e67-f297-4731-bdb1-51900acac190 Aug 29 01:18:16 devstack sudo[95987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:18:16 devstack sudo[95987]: pam_unix(sudo:session): session closed for user root Aug 29 01:18:16 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-116456a6-92d9-4bee-9e66-e0ea39ab79ea tempest-SnapshotsActionsTest-1924917168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.b3d39712-bb6a-47b8-95a0-a2391b942cc0 -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.fe480e67-f297-4731-bdb1-51900acac190" returned: 0 in 0.305s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:18:16 devstack cinder-volume[86111]: WARNING cinder.volume.drivers.remotefs [None req-116456a6-92d9-4bee-9e66-e0ea39ab79ea tempest-SnapshotsActionsTest-1924917168 None] /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.fe480e67-f297-4731-bdb1-51900acac190 is being set with open permissions: ugo+rw Aug 29 01:18:16 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-116456a6-92d9-4bee-9e66-e0ea39ab79ea tempest-SnapshotsActionsTest-1924917168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.fe480e67-f297-4731-bdb1-51900acac190 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:18:16 devstack sudo[95992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.fe480e67-f297-4731-bdb1-51900acac190 Aug 29 01:18:16 devstack sudo[95992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:18:16 devstack sudo[95992]: pam_unix(sudo:session): session closed for user root Aug 29 01:18:16 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-116456a6-92d9-4bee-9e66-e0ea39ab79ea tempest-SnapshotsActionsTest-1924917168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.fe480e67-f297-4731-bdb1-51900acac190" returned: 0 in 0.330s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:18:16 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-116456a6-92d9-4bee-9e66-e0ea39ab79ea tempest-SnapshotsActionsTest-1924917168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.791s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:18:16 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-a2b8bb9d-260e-4c97-85e9-f125c6f3b50b tempest-TestInstancesWithCinderVolumes-192732122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.164s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:18:16 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-a2b8bb9d-260e-4c97-85e9-f125c6f3b50b tempest-TestInstancesWithCinderVolumes-192732122 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:18:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-128249989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3178d0e-ea20-4d5e-9c79-9e4165e50dd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8daf2e93f6443b281ac011df81e97c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:18:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:18:10Z,use_quota=True,user_id='8c890d2625514fad939b9734680dae85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1618b9a2-ca7d-4f44-b0d3-86c9a111bae6),volume_type_id=1618b9a2-ca7d-4f44-b0d3-86c9a111bae6)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:18:16 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-a2b8bb9d-260e-4c97-85e9-f125c6f3b50b tempest-TestInstancesWithCinderVolumes-192732122 None] Creating volume e3178d0e-ea20-4d5e-9c79-9e4165e50dd5 {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:18:16 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-a2b8bb9d-260e-4c97-85e9-f125c6f3b50b tempest-TestInstancesWithCinderVolumes-192732122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:18:16 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-a2b8bb9d-260e-4c97-85e9-f125c6f3b50b tempest-TestInstancesWithCinderVolumes-192732122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:18:16 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-a2b8bb9d-260e-4c97-85e9-f125c6f3b50b tempest-TestInstancesWithCinderVolumes-192732122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:18:16 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-a2b8bb9d-260e-4c97-85e9-f125c6f3b50b tempest-TestInstancesWithCinderVolumes-192732122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:18:16 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-a2b8bb9d-260e-4c97-85e9-f125c6f3b50b tempest-TestInstancesWithCinderVolumes-192732122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:18:16 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-a2b8bb9d-260e-4c97-85e9-f125c6f3b50b tempest-TestInstancesWithCinderVolumes-192732122 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:18:16 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-a2b8bb9d-260e-4c97-85e9-f125c6f3b50b tempest-TestInstancesWithCinderVolumes-192732122 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:18:16 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-a2b8bb9d-260e-4c97-85e9-f125c6f3b50b tempest-TestInstancesWithCinderVolumes-192732122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-e3178d0e-ea20-4d5e-9c79-9e4165e50dd5 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:18:16 devstack sudo[95995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-e3178d0e-ea20-4d5e-9c79-9e4165e50dd5 1073741824 Aug 29 01:18:16 devstack sudo[95995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:18:16 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-116456a6-92d9-4bee-9e66-e0ea39ab79ea tempest-SnapshotsActionsTest-1924917168 None] Create snapshot completed successfully Aug 29 01:18:17 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-bda0ab19-e04f-4e34-b016-0f9882e4a41e tempest-SnapshotsActionsTest-1165394092 None] Acquiring lock "cinder-fe480e67-f297-4731-bdb1-51900acac190-delete_snapshot" by "delete_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:18:17 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-bda0ab19-e04f-4e34-b016-0f9882e4a41e tempest-SnapshotsActionsTest-1165394092 None] Lock "cinder-fe480e67-f297-4731-bdb1-51900acac190-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:18:17 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-bda0ab19-e04f-4e34-b016-0f9882e4a41e tempest-SnapshotsActionsTest-1165394092 None] Acquiring lock "cinder-quobyte-3e056373-2aa3-4fa0-922e-3bbf1c28628b" by "delete_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:18:17 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-bda0ab19-e04f-4e34-b016-0f9882e4a41e tempest-SnapshotsActionsTest-1165394092 None] Lock "cinder-quobyte-3e056373-2aa3-4fa0-922e-3bbf1c28628b" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:18:17 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-bda0ab19-e04f-4e34-b016-0f9882e4a41e tempest-SnapshotsActionsTest-1165394092 None] Acquiring lock "cinder-quobyte-fe480e67-f297-4731-bdb1-51900acac190" by "_delete_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:18:17 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-bda0ab19-e04f-4e34-b016-0f9882e4a41e tempest-SnapshotsActionsTest-1165394092 None] Lock "cinder-quobyte-fe480e67-f297-4731-bdb1-51900acac190" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:18:17 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-bda0ab19-e04f-4e34-b016-0f9882e4a41e tempest-SnapshotsActionsTest-1165394092 None] Deleting offline snapshot fe480e67-f297-4731-bdb1-51900acac190 of volume 3e056373-2aa3-4fa0-922e-3bbf1c28628b {{(pid=86111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 29 01:18:17 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-bda0ab19-e04f-4e34-b016-0f9882e4a41e tempest-SnapshotsActionsTest-1165394092 None] snapshot_file for this snap is: volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.fe480e67-f297-4731-bdb1-51900acac190 {{(pid=86111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 29 01:18:17 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f0b13f2-075c-4206-a45f-e9d382ec83e5]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:18:17 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-bda0ab19-e04f-4e34-b016-0f9882e4a41e tempest-SnapshotsActionsTest-1165394092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.fe480e67-f297-4731-bdb1-51900acac190 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:18:17 devstack sudo[95995]: pam_unix(sudo:session): session closed for user root Aug 29 01:18:17 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-a2b8bb9d-260e-4c97-85e9-f125c6f3b50b tempest-TestInstancesWithCinderVolumes-192732122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-e3178d0e-ea20-4d5e-9c79-9e4165e50dd5 1073741824" returned: 0 in 0.582s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:18:17 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-a2b8bb9d-260e-4c97-85e9-f125c6f3b50b tempest-TestInstancesWithCinderVolumes-192732122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-e3178d0e-ea20-4d5e-9c79-9e4165e50dd5 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:18:17 devstack sudo[96002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-e3178d0e-ea20-4d5e-9c79-9e4165e50dd5 Aug 29 01:18:17 devstack sudo[96002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:18:17 devstack sudo[96001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.fe480e67-f297-4731-bdb1-51900acac190 Aug 29 01:18:17 devstack sudo[96001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:18:17 devstack sudo[96002]: pam_unix(sudo:session): session closed for user root Aug 29 01:18:17 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-a2b8bb9d-260e-4c97-85e9-f125c6f3b50b tempest-TestInstancesWithCinderVolumes-192732122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-e3178d0e-ea20-4d5e-9c79-9e4165e50dd5" returned: 0 in 0.275s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:18:17 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-a2b8bb9d-260e-4c97-85e9-f125c6f3b50b tempest-TestInstancesWithCinderVolumes-192732122 None] <== create_volume: return (913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:18:17 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-a2b8bb9d-260e-4c97-85e9-f125c6f3b50b tempest-TestInstancesWithCinderVolumes-192732122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.916s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:18:17 devstack sudo[96001]: pam_unix(sudo:session): session closed for user root Aug 29 01:18:17 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-bda0ab19-e04f-4e34-b016-0f9882e4a41e tempest-SnapshotsActionsTest-1165394092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.fe480e67-f297-4731-bdb1-51900acac190" returned: 0 in 0.388s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:18:17 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-bda0ab19-e04f-4e34-b016-0f9882e4a41e tempest-SnapshotsActionsTest-1165394092 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 29 01:18:17 devstack cinder-volume[86111]: DEBUG cinder.volume.volume_utils [None req-a2b8bb9d-260e-4c97-85e9-f125c6f3b50b tempest-TestInstancesWithCinderVolumes-192732122 None] Attempting download of 96b7c69d-b377-4230-ab44-d1a2da5adc69 ((None, [{'url': 'file:///opt/stack/data/glance/images/96b7c69d-b377-4230-ab44-d1a2da5adc69', 'metadata': {}}])) to volume e3178d0e-ea20-4d5e-9c79-9e4165e50dd5. {{(pid=86111) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 29 01:18:17 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[223c2bca-7754-41be-8bb5-906fd61311ba]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:18:17 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-bda0ab19-e04f-4e34-b016-0f9882e4a41e tempest-SnapshotsActionsTest-1165394092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.b3d39712-bb6a-47b8-95a0-a2391b942cc0 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:18:17 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a259af2-f486-4e74-aea4-69a979bfe5cd]: (4, 'raw') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:18:17 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-a2b8bb9d-260e-4c97-85e9-f125c6f3b50b tempest-TestInstancesWithCinderVolumes-192732122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_96b7c69d-b377-4230-ab44-d1a2da5adc69_t3r7jts1 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:18:17 devstack sudo[96009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.b3d39712-bb6a-47b8-95a0-a2391b942cc0 Aug 29 01:18:17 devstack sudo[96009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:18:17 devstack sudo[96010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_96b7c69d-b377-4230-ab44-d1a2da5adc69_t3r7jts1 Aug 29 01:18:17 devstack sudo[96010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:18:18 devstack sudo[96009]: pam_unix(sudo:session): session closed for user root Aug 29 01:18:18 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-bda0ab19-e04f-4e34-b016-0f9882e4a41e tempest-SnapshotsActionsTest-1165394092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.b3d39712-bb6a-47b8-95a0-a2391b942cc0" returned: 0 in 0.496s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:18:18 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-bda0ab19-e04f-4e34-b016-0f9882e4a41e tempest-SnapshotsActionsTest-1165394092 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 29 01:18:18 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-bda0ab19-e04f-4e34-b016-0f9882e4a41e tempest-SnapshotsActionsTest-1165394092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.fe480e67-f297-4731-bdb1-51900acac190 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:18:18 devstack sudo[96010]: pam_unix(sudo:session): session closed for user root Aug 29 01:18:18 devstack sudo[96019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.fe480e67-f297-4731-bdb1-51900acac190 Aug 29 01:18:18 devstack sudo[96019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:18:18 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-a2b8bb9d-260e-4c97-85e9-f125c6f3b50b tempest-TestInstancesWithCinderVolumes-192732122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_96b7c69d-b377-4230-ab44-d1a2da5adc69_t3r7jts1" returned: 0 in 0.401s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:18:18 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-a2b8bb9d-260e-4c97-85e9-f125c6f3b50b tempest-TestInstancesWithCinderVolumes-192732122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_96b7c69d-b377-4230-ab44-d1a2da5adc69_t3r7jts1 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:18:18 devstack sudo[96021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_96b7c69d-b377-4230-ab44-d1a2da5adc69_t3r7jts1 Aug 29 01:18:18 devstack sudo[96021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:18:18 devstack sudo[96021]: pam_unix(sudo:session): session closed for user root Aug 29 01:18:18 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-a2b8bb9d-260e-4c97-85e9-f125c6f3b50b tempest-TestInstancesWithCinderVolumes-192732122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_96b7c69d-b377-4230-ab44-d1a2da5adc69_t3r7jts1" returned: 1 in 0.399s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:18:18 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-a2b8bb9d-260e-4c97-85e9-f125c6f3b50b tempest-TestInstancesWithCinderVolumes-192732122 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_96b7c69d-b377-4230-ab44-d1a2da5adc69_t3r7jts1' failed. Not Retrying. {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 29 01:18:18 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[8714cdf0-452d-4d65-871a-a233d4367e4f]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:18:18 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-a2b8bb9d-260e-4c97-85e9-f125c6f3b50b tempest-TestInstancesWithCinderVolumes-192732122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_96b7c69d-b377-4230-ab44-d1a2da5adc69_vv3cvud0devstack@QuobyteHD {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:18:18 devstack sudo[96019]: pam_unix(sudo:session): session closed for user root Aug 29 01:18:18 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-bda0ab19-e04f-4e34-b016-0f9882e4a41e tempest-SnapshotsActionsTest-1165394092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.fe480e67-f297-4731-bdb1-51900acac190" returned: 0 in 0.473s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:18:18 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-bda0ab19-e04f-4e34-b016-0f9882e4a41e tempest-SnapshotsActionsTest-1165394092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.fe480e67-f297-4731-bdb1-51900acac190 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:18:18 devstack sudo[96030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.fe480e67-f297-4731-bdb1-51900acac190 Aug 29 01:18:18 devstack sudo[96030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:18:18 devstack sudo[96029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_96b7c69d-b377-4230-ab44-d1a2da5adc69_vv3cvud0devstack@QuobyteHD Aug 29 01:18:18 devstack sudo[96029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:18:18 devstack sudo[96030]: pam_unix(sudo:session): session closed for user root Aug 29 01:18:18 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-bda0ab19-e04f-4e34-b016-0f9882e4a41e tempest-SnapshotsActionsTest-1165394092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.fe480e67-f297-4731-bdb1-51900acac190" returned: 0 in 0.331s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:18:19 devstack sudo[96029]: pam_unix(sudo:session): session closed for user root Aug 29 01:18:19 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-bda0ab19-e04f-4e34-b016-0f9882e4a41e tempest-SnapshotsActionsTest-1165394092 None] Lock "cinder-quobyte-fe480e67-f297-4731-bdb1-51900acac190" released by "_delete_snapshot" :: held 1.843s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:18:19 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-a2b8bb9d-260e-4c97-85e9-f125c6f3b50b tempest-TestInstancesWithCinderVolumes-192732122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_96b7c69d-b377-4230-ab44-d1a2da5adc69_vv3cvud0devstack@QuobyteHD" returned: 0 in 0.403s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:18:19 devstack cinder-volume[86111]: DEBUG cinder.image.image_utils [None req-a2b8bb9d-260e-4c97-85e9-f125c6f3b50b tempest-TestInstancesWithCinderVolumes-192732122 None] 96b7c69d-b377-4230-ab44-d1a2da5adc69 was qcow2, converting to qcow2 {{(pid=86111) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 29 01:18:19 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-a2b8bb9d-260e-4c97-85e9-f125c6f3b50b tempest-TestInstancesWithCinderVolumes-192732122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_96b7c69d-b377-4230-ab44-d1a2da5adc69_vv3cvud0devstack@QuobyteHD /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-e3178d0e-ea20-4d5e-9c79-9e4165e50dd5 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:18:19 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-bda0ab19-e04f-4e34-b016-0f9882e4a41e tempest-SnapshotsActionsTest-1165394092 None] Lock "cinder-quobyte-3e056373-2aa3-4fa0-922e-3bbf1c28628b" released by "delete_snapshot" :: held 1.888s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:18:19 devstack sudo[96038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_96b7c69d-b377-4230-ab44-d1a2da5adc69_vv3cvud0devstack@QuobyteHD /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-e3178d0e-ea20-4d5e-9c79-9e4165e50dd5 Aug 29 01:18:19 devstack sudo[96038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:18:19 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-bda0ab19-e04f-4e34-b016-0f9882e4a41e tempest-SnapshotsActionsTest-1165394092 None] Created reservations ['b5fca4a2-0936-4687-a8eb-f6157ca5d13e', '1e7884f9-327a-422a-8efe-e661a66b7ffc', '7f988944-511a-46de-ad38-f899bf44cac7', '67669ff9-c955-4764-94a9-4246bbc0bc90'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:18:19 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-bda0ab19-e04f-4e34-b016-0f9882e4a41e tempest-SnapshotsActionsTest-1165394092 None] Delete snapshot completed successfully. Aug 29 01:18:19 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-bda0ab19-e04f-4e34-b016-0f9882e4a41e tempest-SnapshotsActionsTest-1165394092 None] Lock "cinder-fe480e67-f297-4731-bdb1-51900acac190-delete_snapshot" released by "delete_snapshot" :: held 2.094s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:18:19 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-1bed534e-8d4f-45fa-9aff-0be620614726 tempest-SnapshotsActionsTest-1924917168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:18:19 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-1bed534e-8d4f-45fa-9aff-0be620614726 tempest-SnapshotsActionsTest-1924917168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:18:19 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-1bed534e-8d4f-45fa-9aff-0be620614726 tempest-SnapshotsActionsTest-1924917168 None] Creating offline snapshot 12699aa7-9f8e-43bf-859e-c7b1124296bf of volume 3e056373-2aa3-4fa0-922e-3bbf1c28628b {{(pid=86111) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 29 01:18:19 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c4998e0-afc9-40b9-8bdb-d4627a1b53bc]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:18:19 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-1bed534e-8d4f-45fa-9aff-0be620614726 tempest-SnapshotsActionsTest-1924917168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.b3d39712-bb6a-47b8-95a0-a2391b942cc0 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:18:19 devstack sudo[96045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.b3d39712-bb6a-47b8-95a0-a2391b942cc0 Aug 29 01:18:19 devstack sudo[96045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:18:20 devstack sudo[96045]: pam_unix(sudo:session): session closed for user root Aug 29 01:18:20 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-1bed534e-8d4f-45fa-9aff-0be620614726 tempest-SnapshotsActionsTest-1924917168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.b3d39712-bb6a-47b8-95a0-a2391b942cc0" returned: 0 in 0.529s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:18:20 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-1bed534e-8d4f-45fa-9aff-0be620614726 tempest-SnapshotsActionsTest-1924917168 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 29 01:18:20 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-1bed534e-8d4f-45fa-9aff-0be620614726 tempest-SnapshotsActionsTest-1924917168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.b3d39712-bb6a-47b8-95a0-a2391b942cc0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.12699aa7-9f8e-43bf-859e-c7b1124296bf 1G {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:18:20 devstack sudo[96050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.b3d39712-bb6a-47b8-95a0-a2391b942cc0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.12699aa7-9f8e-43bf-859e-c7b1124296bf 1G Aug 29 01:18:20 devstack sudo[96050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:18:20 devstack sudo[96050]: pam_unix(sudo:session): session closed for user root Aug 29 01:18:20 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-1bed534e-8d4f-45fa-9aff-0be620614726 tempest-SnapshotsActionsTest-1924917168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.b3d39712-bb6a-47b8-95a0-a2391b942cc0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.12699aa7-9f8e-43bf-859e-c7b1124296bf 1G" returned: 0 in 0.572s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:18:20 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-1bed534e-8d4f-45fa-9aff-0be620614726 tempest-SnapshotsActionsTest-1924917168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.b3d39712-bb6a-47b8-95a0-a2391b942cc0 -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.12699aa7-9f8e-43bf-859e-c7b1124296bf {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:18:20 devstack sudo[96057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.b3d39712-bb6a-47b8-95a0-a2391b942cc0 -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.12699aa7-9f8e-43bf-859e-c7b1124296bf Aug 29 01:18:20 devstack sudo[96057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:18:21 devstack sudo[96057]: pam_unix(sudo:session): session closed for user root Aug 29 01:18:21 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-1bed534e-8d4f-45fa-9aff-0be620614726 tempest-SnapshotsActionsTest-1924917168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.b3d39712-bb6a-47b8-95a0-a2391b942cc0 -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.12699aa7-9f8e-43bf-859e-c7b1124296bf" returned: 0 in 0.349s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:18:21 devstack cinder-volume[86111]: WARNING cinder.volume.drivers.remotefs [None req-1bed534e-8d4f-45fa-9aff-0be620614726 tempest-SnapshotsActionsTest-1924917168 None] /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.12699aa7-9f8e-43bf-859e-c7b1124296bf is being set with open permissions: ugo+rw Aug 29 01:18:21 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-1bed534e-8d4f-45fa-9aff-0be620614726 tempest-SnapshotsActionsTest-1924917168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.12699aa7-9f8e-43bf-859e-c7b1124296bf {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:18:21 devstack sudo[96062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.12699aa7-9f8e-43bf-859e-c7b1124296bf Aug 29 01:18:21 devstack sudo[96062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:18:21 devstack sudo[96038]: pam_unix(sudo:session): session closed for user root Aug 29 01:18:21 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-a2b8bb9d-260e-4c97-85e9-f125c6f3b50b tempest-TestInstancesWithCinderVolumes-192732122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_96b7c69d-b377-4230-ab44-d1a2da5adc69_vv3cvud0devstack@QuobyteHD /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-e3178d0e-ea20-4d5e-9c79-9e4165e50dd5" returned: 0 in 2.307s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:18:21 devstack cinder-volume[86111]: DEBUG cinder.image.image_utils [None req-a2b8bb9d-260e-4c97-85e9-f125c6f3b50b tempest-TestInstancesWithCinderVolumes-192732122 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_96b7c69d-b377-4230-ab44-d1a2da5adc69_vv3cvud0devstack@QuobyteHD, size 112.00 MB, duration 2.31 sec, destination /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-e3178d0e-ea20-4d5e-9c79-9e4165e50dd5 {{(pid=86111) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 29 01:18:21 devstack cinder-volume[86111]: INFO cinder.image.image_utils [None req-a2b8bb9d-260e-4c97-85e9-f125c6f3b50b tempest-TestInstancesWithCinderVolumes-192732122 None] Converted 112.00 MB image at 48.51 MB/s Aug 29 01:18:21 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-a2b8bb9d-260e-4c97-85e9-f125c6f3b50b tempest-TestInstancesWithCinderVolumes-192732122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-e3178d0e-ea20-4d5e-9c79-9e4165e50dd5 1G {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:18:21 devstack sudo[96064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-e3178d0e-ea20-4d5e-9c79-9e4165e50dd5 1G Aug 29 01:18:21 devstack sudo[96064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:18:21 devstack sudo[96062]: pam_unix(sudo:session): session closed for user root Aug 29 01:18:21 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-1bed534e-8d4f-45fa-9aff-0be620614726 tempest-SnapshotsActionsTest-1924917168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.12699aa7-9f8e-43bf-859e-c7b1124296bf" returned: 0 in 0.310s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:18:21 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-1bed534e-8d4f-45fa-9aff-0be620614726 tempest-SnapshotsActionsTest-1924917168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.929s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:18:21 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-1bed534e-8d4f-45fa-9aff-0be620614726 tempest-SnapshotsActionsTest-1924917168 None] Create snapshot completed successfully Aug 29 01:18:21 devstack sudo[96064]: pam_unix(sudo:session): session closed for user root Aug 29 01:18:21 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-a2b8bb9d-260e-4c97-85e9-f125c6f3b50b tempest-TestInstancesWithCinderVolumes-192732122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-e3178d0e-ea20-4d5e-9c79-9e4165e50dd5 1G" returned: 0 in 0.449s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:18:21 devstack cinder-volume[86111]: DEBUG cinder.volume.volume_utils [None req-a2b8bb9d-260e-4c97-85e9-f125c6f3b50b tempest-TestInstancesWithCinderVolumes-192732122 None] Downloaded image 96b7c69d-b377-4230-ab44-d1a2da5adc69 ((None, [{'url': 'file:///opt/stack/data/glance/images/96b7c69d-b377-4230-ab44-d1a2da5adc69', 'metadata': {}}])) to volume e3178d0e-ea20-4d5e-9c79-9e4165e50dd5 successfully. {{(pid=86111) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 29 01:18:21 devstack cinder-volume[86111]: DEBUG cinder.image.image_utils [None req-a2b8bb9d-260e-4c97-85e9-f125c6f3b50b tempest-TestInstancesWithCinderVolumes-192732122 None] Temporary image 96b7c69d-b377-4230-ab44-d1a2da5adc69 for user 8c890d2625514fad939b9734680dae85 is deleted. {{(pid=86111) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 29 01:18:21 devstack cinder-volume[86111]: DEBUG cinder.volume.volume_utils [None req-a2b8bb9d-260e-4c97-85e9-f125c6f3b50b tempest-TestInstancesWithCinderVolumes-192732122 None] Marking volume e3178d0e-ea20-4d5e-9c79-9e4165e50dd5 as bootable. {{(pid=86111) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 29 01:18:21 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2b8bb9d-260e-4c97-85e9-f125c6f3b50b tempest-TestInstancesWithCinderVolumes-192732122 None] Copying metadata from image 96b7c69d-b377-4230-ab44-d1a2da5adc69 to e3178d0e-ea20-4d5e-9c79-9e4165e50dd5. {{(pid=86111) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 29 01:18:21 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2b8bb9d-260e-4c97-85e9-f125c6f3b50b tempest-TestInstancesWithCinderVolumes-192732122 None] Creating volume glance metadata for volume e3178d0e-ea20-4d5e-9c79-9e4165e50dd5 backed by image 96b7c69d-b377-4230-ab44-d1a2da5adc69 with: {'image_id': '96b7c69d-b377-4230-ab44-d1a2da5adc69', 'image_name': 'tempest-scenario-img--4197395', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86111) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 29 01:18:21 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-a2b8bb9d-260e-4c97-85e9-f125c6f3b50b tempest-TestInstancesWithCinderVolumes-192732122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d22e5f12-ca24-4d74-8443-42c75b796a80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3178d0e-ea20-4d5e-9c79-9e4165e50dd5', 'volume_size': 1, 'image_id': '96b7c69d-b377-4230-ab44-d1a2da5adc69', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/96b7c69d-b377-4230-ab44-d1a2da5adc69', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--4197395', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e8daf2e93f6443b281ac011df81e97c8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '96b7c69d-b377-4230-ab44-d1a2da5adc69', 'created_at': datetime.datetime(2026, 8, 28, 23, 18, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 23, 18, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/96b7c69d-b377-4230-ab44-d1a2da5adc69/file', 'properties': {}}, 'image_service': }' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:18:21 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-a2b8bb9d-260e-4c97-85e9-f125c6f3b50b tempest-TestInstancesWithCinderVolumes-192732122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b486e8d-5060-4c4e-920a-fd521f3cdf3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:18:21 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-a2b8bb9d-260e-4c97-85e9-f125c6f3b50b tempest-TestInstancesWithCinderVolumes-192732122 None] Volume volume-e3178d0e-ea20-4d5e-9c79-9e4165e50dd5 (e3178d0e-ea20-4d5e-9c79-9e4165e50dd5): created successfully Aug 29 01:18:21 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-a2b8bb9d-260e-4c97-85e9-f125c6f3b50b tempest-TestInstancesWithCinderVolumes-192732122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b486e8d-5060-4c4e-920a-fd521f3cdf3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:18:21 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-a2b8bb9d-260e-4c97-85e9-f125c6f3b50b tempest-TestInstancesWithCinderVolumes-192732122 None] Flow 'volume_create_manager' (9da04cac-09e3-40c2-ac94-31f5bb924350) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:18:21 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-a2b8bb9d-260e-4c97-85e9-f125c6f3b50b tempest-TestInstancesWithCinderVolumes-192732122 None] Created volume successfully. Aug 29 01:18:22 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-3a066003-b5fb-410e-8785-5eb020f75d29 tempest-SnapshotsActionsTest-1165394092 None] Acquiring lock "cinder-12699aa7-9f8e-43bf-859e-c7b1124296bf-delete_snapshot" by "delete_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:18:22 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-3a066003-b5fb-410e-8785-5eb020f75d29 tempest-SnapshotsActionsTest-1165394092 None] Lock "cinder-12699aa7-9f8e-43bf-859e-c7b1124296bf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:18:22 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-3a066003-b5fb-410e-8785-5eb020f75d29 tempest-SnapshotsActionsTest-1165394092 None] Acquiring lock "cinder-quobyte-3e056373-2aa3-4fa0-922e-3bbf1c28628b" by "delete_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:18:22 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-3a066003-b5fb-410e-8785-5eb020f75d29 tempest-SnapshotsActionsTest-1165394092 None] Lock "cinder-quobyte-3e056373-2aa3-4fa0-922e-3bbf1c28628b" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:18:22 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-3a066003-b5fb-410e-8785-5eb020f75d29 tempest-SnapshotsActionsTest-1165394092 None] Acquiring lock "cinder-quobyte-12699aa7-9f8e-43bf-859e-c7b1124296bf" by "_delete_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:18:22 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-3a066003-b5fb-410e-8785-5eb020f75d29 tempest-SnapshotsActionsTest-1165394092 None] Lock "cinder-quobyte-12699aa7-9f8e-43bf-859e-c7b1124296bf" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:18:22 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-3a066003-b5fb-410e-8785-5eb020f75d29 tempest-SnapshotsActionsTest-1165394092 None] Deleting offline snapshot 12699aa7-9f8e-43bf-859e-c7b1124296bf of volume 3e056373-2aa3-4fa0-922e-3bbf1c28628b {{(pid=86111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 29 01:18:22 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-3a066003-b5fb-410e-8785-5eb020f75d29 tempest-SnapshotsActionsTest-1165394092 None] snapshot_file for this snap is: volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.12699aa7-9f8e-43bf-859e-c7b1124296bf {{(pid=86111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 29 01:18:22 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[a44d209c-0802-4a3d-9502-d4000414e556]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:18:22 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-3a066003-b5fb-410e-8785-5eb020f75d29 tempest-SnapshotsActionsTest-1165394092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.12699aa7-9f8e-43bf-859e-c7b1124296bf {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:18:22 devstack sudo[96080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.12699aa7-9f8e-43bf-859e-c7b1124296bf Aug 29 01:18:22 devstack sudo[96080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:18:22 devstack sudo[96080]: pam_unix(sudo:session): session closed for user root Aug 29 01:18:22 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-3a066003-b5fb-410e-8785-5eb020f75d29 tempest-SnapshotsActionsTest-1165394092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.12699aa7-9f8e-43bf-859e-c7b1124296bf" returned: 0 in 0.506s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:18:22 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-3a066003-b5fb-410e-8785-5eb020f75d29 tempest-SnapshotsActionsTest-1165394092 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 29 01:18:22 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[839fa3a0-7fe5-4fa0-a043-b55d49970800]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:18:22 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-3a066003-b5fb-410e-8785-5eb020f75d29 tempest-SnapshotsActionsTest-1165394092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.b3d39712-bb6a-47b8-95a0-a2391b942cc0 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:18:22 devstack sudo[96087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.b3d39712-bb6a-47b8-95a0-a2391b942cc0 Aug 29 01:18:22 devstack sudo[96087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:18:23 devstack sudo[96087]: pam_unix(sudo:session): session closed for user root Aug 29 01:18:23 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-3a066003-b5fb-410e-8785-5eb020f75d29 tempest-SnapshotsActionsTest-1165394092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.b3d39712-bb6a-47b8-95a0-a2391b942cc0" returned: 0 in 0.659s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:18:23 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-3a066003-b5fb-410e-8785-5eb020f75d29 tempest-SnapshotsActionsTest-1165394092 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 29 01:18:23 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-3a066003-b5fb-410e-8785-5eb020f75d29 tempest-SnapshotsActionsTest-1165394092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.12699aa7-9f8e-43bf-859e-c7b1124296bf {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:18:23 devstack sudo[96114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.12699aa7-9f8e-43bf-859e-c7b1124296bf Aug 29 01:18:23 devstack sudo[96114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:18:23 devstack sudo[96114]: pam_unix(sudo:session): session closed for user root Aug 29 01:18:23 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-3a066003-b5fb-410e-8785-5eb020f75d29 tempest-SnapshotsActionsTest-1165394092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.12699aa7-9f8e-43bf-859e-c7b1124296bf" returned: 0 in 0.543s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:18:23 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-3a066003-b5fb-410e-8785-5eb020f75d29 tempest-SnapshotsActionsTest-1165394092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.12699aa7-9f8e-43bf-859e-c7b1124296bf {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:18:23 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-d99c9b42-582f-4159-b1b9-ffc15d0b7a6f tempest-VolumesSnapshotTestJSON-1982727637 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:18:23 devstack sudo[96120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.12699aa7-9f8e-43bf-859e-c7b1124296bf Aug 29 01:18:23 devstack sudo[96120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:18:23 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-d99c9b42-582f-4159-b1b9-ffc15d0b7a6f tempest-VolumesSnapshotTestJSON-1982727637 None] Flow 'volume_create_manager' (2b021243-5326-447b-85ce-86d712cca9b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:18:23 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-d99c9b42-582f-4159-b1b9-ffc15d0b7a6f tempest-VolumesSnapshotTestJSON-1982727637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cddca55a-8690-4da2-b64b-b3c045381c91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:18:23 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-d99c9b42-582f-4159-b1b9-ffc15d0b7a6f tempest-VolumesSnapshotTestJSON-1982727637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cddca55a-8690-4da2-b64b-b3c045381c91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:18:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-61884601',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b54f6649-e793-4498-b73a-3ca73ed9261d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7bf2d2db8a14115afd9c2ec5d80764e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:18:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:18:24Z,use_quota=True,user_id='0a960c2d40c44669aace6e57fa7accb7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:18:23 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-d99c9b42-582f-4159-b1b9-ffc15d0b7a6f tempest-VolumesSnapshotTestJSON-1982727637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b29167c0-9f45-451e-bf3b-cf7e9ead9e94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:18:23 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-d99c9b42-582f-4159-b1b9-ffc15d0b7a6f tempest-VolumesSnapshotTestJSON-1982727637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b29167c0-9f45-451e-bf3b-cf7e9ead9e94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:18:23 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-d99c9b42-582f-4159-b1b9-ffc15d0b7a6f tempest-VolumesSnapshotTestJSON-1982727637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c439d84-f88b-4214-8611-692dea4a2094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:18:23 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-d99c9b42-582f-4159-b1b9-ffc15d0b7a6f tempest-VolumesSnapshotTestJSON-1982727637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c439d84-f88b-4214-8611-692dea4a2094) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b54f6649-e793-4498-b73a-3ca73ed9261d', 'volume_name': 'volume-b54f6649-e793-4498-b73a-3ca73ed9261d', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:18:23 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-d99c9b42-582f-4159-b1b9-ffc15d0b7a6f tempest-VolumesSnapshotTestJSON-1982727637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3c742b7-f3fc-4170-8fbc-1c054246ace4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:18:23 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-d99c9b42-582f-4159-b1b9-ffc15d0b7a6f tempest-VolumesSnapshotTestJSON-1982727637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3c742b7-f3fc-4170-8fbc-1c054246ace4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:18:23 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-d99c9b42-582f-4159-b1b9-ffc15d0b7a6f tempest-VolumesSnapshotTestJSON-1982727637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (408360d5-ae03-4249-aa3f-b6f45b61cf8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:18:23 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-d99c9b42-582f-4159-b1b9-ffc15d0b7a6f tempest-VolumesSnapshotTestJSON-1982727637 None] Volume b54f6649-e793-4498-b73a-3ca73ed9261d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b54f6649-e793-4498-b73a-3ca73ed9261d', 'volume_size': 1} Aug 29 01:18:23 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-d99c9b42-582f-4159-b1b9-ffc15d0b7a6f tempest-VolumesSnapshotTestJSON-1982727637 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:18:23 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-d99c9b42-582f-4159-b1b9-ffc15d0b7a6f tempest-VolumesSnapshotTestJSON-1982727637 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:18:23 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-d99c9b42-582f-4159-b1b9-ffc15d0b7a6f tempest-VolumesSnapshotTestJSON-1982727637 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:18:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-61884601',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b54f6649-e793-4498-b73a-3ca73ed9261d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7bf2d2db8a14115afd9c2ec5d80764e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:18:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:18:24Z,use_quota=True,user_id='0a960c2d40c44669aace6e57fa7accb7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:18:23 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-d99c9b42-582f-4159-b1b9-ffc15d0b7a6f tempest-VolumesSnapshotTestJSON-1982727637 None] Creating volume b54f6649-e793-4498-b73a-3ca73ed9261d {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:18:23 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-d99c9b42-582f-4159-b1b9-ffc15d0b7a6f tempest-VolumesSnapshotTestJSON-1982727637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:18:23 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-d99c9b42-582f-4159-b1b9-ffc15d0b7a6f tempest-VolumesSnapshotTestJSON-1982727637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:18:23 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-d99c9b42-582f-4159-b1b9-ffc15d0b7a6f tempest-VolumesSnapshotTestJSON-1982727637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:18:23 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-d99c9b42-582f-4159-b1b9-ffc15d0b7a6f tempest-VolumesSnapshotTestJSON-1982727637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:18:24 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-d99c9b42-582f-4159-b1b9-ffc15d0b7a6f tempest-VolumesSnapshotTestJSON-1982727637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:18:24 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-d99c9b42-582f-4159-b1b9-ffc15d0b7a6f tempest-VolumesSnapshotTestJSON-1982727637 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:18:24 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-d99c9b42-582f-4159-b1b9-ffc15d0b7a6f tempest-VolumesSnapshotTestJSON-1982727637 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:18:24 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d99c9b42-582f-4159-b1b9-ffc15d0b7a6f tempest-VolumesSnapshotTestJSON-1982727637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-b54f6649-e793-4498-b73a-3ca73ed9261d 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:18:24 devstack sudo[96124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-b54f6649-e793-4498-b73a-3ca73ed9261d 1073741824 Aug 29 01:18:24 devstack sudo[96124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:18:24 devstack sudo[96120]: pam_unix(sudo:session): session closed for user root Aug 29 01:18:24 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-3a066003-b5fb-410e-8785-5eb020f75d29 tempest-SnapshotsActionsTest-1165394092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.12699aa7-9f8e-43bf-859e-c7b1124296bf" returned: 0 in 0.376s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:18:24 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-3a066003-b5fb-410e-8785-5eb020f75d29 tempest-SnapshotsActionsTest-1165394092 None] Lock "cinder-quobyte-12699aa7-9f8e-43bf-859e-c7b1124296bf" released by "_delete_snapshot" :: held 2.216s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:18:24 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-3a066003-b5fb-410e-8785-5eb020f75d29 tempest-SnapshotsActionsTest-1165394092 None] Lock "cinder-quobyte-3e056373-2aa3-4fa0-922e-3bbf1c28628b" released by "delete_snapshot" :: held 2.248s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:18:24 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-3a066003-b5fb-410e-8785-5eb020f75d29 tempest-SnapshotsActionsTest-1165394092 None] Created reservations ['971fb3f5-f361-43f8-8cc0-329388f96b76', '4d9f066f-e703-4154-9a7d-57a4eee11ab5', '959c3265-9886-477b-b70c-8548fb095852', 'd9eaeecd-5d6f-4c21-ac97-4ddced0df2a7'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:18:24 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-3a066003-b5fb-410e-8785-5eb020f75d29 tempest-SnapshotsActionsTest-1165394092 None] Delete snapshot completed successfully. Aug 29 01:18:24 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-3a066003-b5fb-410e-8785-5eb020f75d29 tempest-SnapshotsActionsTest-1165394092 None] Lock "cinder-12699aa7-9f8e-43bf-859e-c7b1124296bf-delete_snapshot" released by "delete_snapshot" :: held 2.445s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:18:24 devstack sudo[96124]: pam_unix(sudo:session): session closed for user root Aug 29 01:18:24 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d99c9b42-582f-4159-b1b9-ffc15d0b7a6f tempest-VolumesSnapshotTestJSON-1982727637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-b54f6649-e793-4498-b73a-3ca73ed9261d 1073741824" returned: 0 in 0.608s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:18:24 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d99c9b42-582f-4159-b1b9-ffc15d0b7a6f tempest-VolumesSnapshotTestJSON-1982727637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-b54f6649-e793-4498-b73a-3ca73ed9261d {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:18:24 devstack sudo[96133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-b54f6649-e793-4498-b73a-3ca73ed9261d Aug 29 01:18:24 devstack sudo[96133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:18:24 devstack sudo[96133]: pam_unix(sudo:session): session closed for user root Aug 29 01:18:24 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d99c9b42-582f-4159-b1b9-ffc15d0b7a6f tempest-VolumesSnapshotTestJSON-1982727637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-b54f6649-e793-4498-b73a-3ca73ed9261d" returned: 0 in 0.280s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:18:24 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-d99c9b42-582f-4159-b1b9-ffc15d0b7a6f tempest-VolumesSnapshotTestJSON-1982727637 None] <== create_volume: return (942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:18:24 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-d99c9b42-582f-4159-b1b9-ffc15d0b7a6f tempest-VolumesSnapshotTestJSON-1982727637 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.946s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:18:24 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-d99c9b42-582f-4159-b1b9-ffc15d0b7a6f tempest-VolumesSnapshotTestJSON-1982727637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (408360d5-ae03-4249-aa3f-b6f45b61cf8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b54f6649-e793-4498-b73a-3ca73ed9261d', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:18:24 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-d99c9b42-582f-4159-b1b9-ffc15d0b7a6f tempest-VolumesSnapshotTestJSON-1982727637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eaa45d9e-cddc-47b4-a54d-0a17152f5062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:18:24 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-d99c9b42-582f-4159-b1b9-ffc15d0b7a6f tempest-VolumesSnapshotTestJSON-1982727637 None] Volume volume-b54f6649-e793-4498-b73a-3ca73ed9261d (b54f6649-e793-4498-b73a-3ca73ed9261d): created successfully Aug 29 01:18:24 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-d99c9b42-582f-4159-b1b9-ffc15d0b7a6f tempest-VolumesSnapshotTestJSON-1982727637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eaa45d9e-cddc-47b4-a54d-0a17152f5062) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:18:24 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-d99c9b42-582f-4159-b1b9-ffc15d0b7a6f tempest-VolumesSnapshotTestJSON-1982727637 None] Flow 'volume_create_manager' (2b021243-5326-447b-85ce-86d712cca9b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:18:25 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-d99c9b42-582f-4159-b1b9-ffc15d0b7a6f tempest-VolumesSnapshotTestJSON-1982727637 None] Created volume successfully. Aug 29 01:18:25 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-dc544623-434d-4eb7-ae6e-9017119216ba tempest-SnapshotsActionsTest-1924917168 None] Acquiring lock "cinder-b3d39712-bb6a-47b8-95a0-a2391b942cc0-delete_snapshot" by "delete_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:18:25 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-dc544623-434d-4eb7-ae6e-9017119216ba tempest-SnapshotsActionsTest-1924917168 None] Lock "cinder-b3d39712-bb6a-47b8-95a0-a2391b942cc0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:18:25 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-dc544623-434d-4eb7-ae6e-9017119216ba tempest-SnapshotsActionsTest-1924917168 None] Acquiring lock "cinder-quobyte-3e056373-2aa3-4fa0-922e-3bbf1c28628b" by "delete_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:18:26 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-dc544623-434d-4eb7-ae6e-9017119216ba tempest-SnapshotsActionsTest-1924917168 None] Lock "cinder-quobyte-3e056373-2aa3-4fa0-922e-3bbf1c28628b" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:18:26 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-dc544623-434d-4eb7-ae6e-9017119216ba tempest-SnapshotsActionsTest-1924917168 None] Acquiring lock "cinder-quobyte-b3d39712-bb6a-47b8-95a0-a2391b942cc0" by "_delete_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:18:26 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-dc544623-434d-4eb7-ae6e-9017119216ba tempest-SnapshotsActionsTest-1924917168 None] Lock "cinder-quobyte-b3d39712-bb6a-47b8-95a0-a2391b942cc0" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:18:26 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-dc544623-434d-4eb7-ae6e-9017119216ba tempest-SnapshotsActionsTest-1924917168 None] Deleting offline snapshot b3d39712-bb6a-47b8-95a0-a2391b942cc0 of volume 3e056373-2aa3-4fa0-922e-3bbf1c28628b {{(pid=86111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 29 01:18:26 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-dc544623-434d-4eb7-ae6e-9017119216ba tempest-SnapshotsActionsTest-1924917168 None] snapshot_file for this snap is: volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.b3d39712-bb6a-47b8-95a0-a2391b942cc0 {{(pid=86111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 29 01:18:26 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[9afbf6dc-2178-43f7-aea5-e877559027c3]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:18:26 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-dc544623-434d-4eb7-ae6e-9017119216ba tempest-SnapshotsActionsTest-1924917168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.b3d39712-bb6a-47b8-95a0-a2391b942cc0 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:18:26 devstack sudo[96174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.b3d39712-bb6a-47b8-95a0-a2391b942cc0 Aug 29 01:18:26 devstack sudo[96174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:18:26 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-244a3ee2-873d-454f-befa-6eef41cb503b tempest-VolumesSnapshotTestJSON-1982727637 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:18:26 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-244a3ee2-873d-454f-befa-6eef41cb503b tempest-VolumesSnapshotTestJSON-1982727637 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:18:26 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-244a3ee2-873d-454f-befa-6eef41cb503b tempest-VolumesSnapshotTestJSON-1982727637 None] Creating offline snapshot c77e68ba-6838-4b3e-ab2b-e25db639487f of volume b54f6649-e793-4498-b73a-3ca73ed9261d {{(pid=86111) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 29 01:18:26 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[967da90a-5c2b-424b-9655-f0410b5b2945]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:18:26 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-244a3ee2-873d-454f-befa-6eef41cb503b tempest-VolumesSnapshotTestJSON-1982727637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-b54f6649-e793-4498-b73a-3ca73ed9261d {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:18:26 devstack sudo[96174]: pam_unix(sudo:session): session closed for user root Aug 29 01:18:26 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-dc544623-434d-4eb7-ae6e-9017119216ba tempest-SnapshotsActionsTest-1924917168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.b3d39712-bb6a-47b8-95a0-a2391b942cc0" returned: 0 in 0.571s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:18:26 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-dc544623-434d-4eb7-ae6e-9017119216ba tempest-SnapshotsActionsTest-1924917168 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 29 01:18:26 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[05cacddf-abe9-446d-a1c3-17c8d49783ba]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:18:26 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-dc544623-434d-4eb7-ae6e-9017119216ba tempest-SnapshotsActionsTest-1924917168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:18:26 devstack sudo[96181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-b54f6649-e793-4498-b73a-3ca73ed9261d Aug 29 01:18:26 devstack sudo[96181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:18:26 devstack sudo[96182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b Aug 29 01:18:26 devstack sudo[96182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:18:27 devstack sudo[96181]: pam_unix(sudo:session): session closed for user root Aug 29 01:18:27 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [req-7f01ba18-221e-4752-9e2a-e07c421d567d req-ebcc9267-1e89-4d52-a8e7-a0c8178ebb3a tempest-TestInstancesWithCinderVolumes-192732122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:18:27 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-244a3ee2-873d-454f-befa-6eef41cb503b tempest-VolumesSnapshotTestJSON-1982727637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-b54f6649-e793-4498-b73a-3ca73ed9261d" returned: 0 in 0.630s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:18:27 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-244a3ee2-873d-454f-befa-6eef41cb503b tempest-VolumesSnapshotTestJSON-1982727637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-b54f6649-e793-4498-b73a-3ca73ed9261d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-b54f6649-e793-4498-b73a-3ca73ed9261d.c77e68ba-6838-4b3e-ab2b-e25db639487f 1G {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:18:27 devstack sudo[96199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-b54f6649-e793-4498-b73a-3ca73ed9261d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-b54f6649-e793-4498-b73a-3ca73ed9261d.c77e68ba-6838-4b3e-ab2b-e25db639487f 1G Aug 29 01:18:27 devstack sudo[96199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:18:27 devstack sudo[96182]: pam_unix(sudo:session): session closed for user root Aug 29 01:18:27 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-dc544623-434d-4eb7-ae6e-9017119216ba tempest-SnapshotsActionsTest-1924917168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b" returned: 0 in 0.577s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:18:27 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-dc544623-434d-4eb7-ae6e-9017119216ba tempest-SnapshotsActionsTest-1924917168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.b3d39712-bb6a-47b8-95a0-a2391b942cc0 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:18:27 devstack sudo[96201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.b3d39712-bb6a-47b8-95a0-a2391b942cc0 Aug 29 01:18:27 devstack sudo[96201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:18:27 devstack sudo[96201]: pam_unix(sudo:session): session closed for user root Aug 29 01:18:27 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-dc544623-434d-4eb7-ae6e-9017119216ba tempest-SnapshotsActionsTest-1924917168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.b3d39712-bb6a-47b8-95a0-a2391b942cc0" returned: 0 in 0.574s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:18:27 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-dc544623-434d-4eb7-ae6e-9017119216ba tempest-SnapshotsActionsTest-1924917168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.b3d39712-bb6a-47b8-95a0-a2391b942cc0 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:18:27 devstack sudo[96199]: pam_unix(sudo:session): session closed for user root Aug 29 01:18:27 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-244a3ee2-873d-454f-befa-6eef41cb503b tempest-VolumesSnapshotTestJSON-1982727637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-b54f6649-e793-4498-b73a-3ca73ed9261d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-b54f6649-e793-4498-b73a-3ca73ed9261d.c77e68ba-6838-4b3e-ab2b-e25db639487f 1G" returned: 0 in 0.645s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:18:27 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-244a3ee2-873d-454f-befa-6eef41cb503b tempest-VolumesSnapshotTestJSON-1982727637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b54f6649-e793-4498-b73a-3ca73ed9261d -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-b54f6649-e793-4498-b73a-3ca73ed9261d.c77e68ba-6838-4b3e-ab2b-e25db639487f {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:18:27 devstack sudo[96215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.b3d39712-bb6a-47b8-95a0-a2391b942cc0 Aug 29 01:18:27 devstack sudo[96215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:18:27 devstack sudo[96216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b54f6649-e793-4498-b73a-3ca73ed9261d -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-b54f6649-e793-4498-b73a-3ca73ed9261d.c77e68ba-6838-4b3e-ab2b-e25db639487f Aug 29 01:18:27 devstack sudo[96216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:18:28 devstack sudo[96215]: pam_unix(sudo:session): session closed for user root Aug 29 01:18:28 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-dc544623-434d-4eb7-ae6e-9017119216ba tempest-SnapshotsActionsTest-1924917168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b.b3d39712-bb6a-47b8-95a0-a2391b942cc0" returned: 0 in 0.323s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:18:28 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-dc544623-434d-4eb7-ae6e-9017119216ba tempest-SnapshotsActionsTest-1924917168 None] Lock "cinder-quobyte-b3d39712-bb6a-47b8-95a0-a2391b942cc0" released by "_delete_snapshot" :: held 2.250s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:18:28 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-dc544623-434d-4eb7-ae6e-9017119216ba tempest-SnapshotsActionsTest-1924917168 None] Lock "cinder-quobyte-3e056373-2aa3-4fa0-922e-3bbf1c28628b" released by "delete_snapshot" :: held 2.288s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:18:28 devstack sudo[96216]: pam_unix(sudo:session): session closed for user root Aug 29 01:18:28 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-244a3ee2-873d-454f-befa-6eef41cb503b tempest-VolumesSnapshotTestJSON-1982727637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b54f6649-e793-4498-b73a-3ca73ed9261d -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-b54f6649-e793-4498-b73a-3ca73ed9261d.c77e68ba-6838-4b3e-ab2b-e25db639487f" returned: 0 in 0.408s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:18:28 devstack cinder-volume[86111]: WARNING cinder.volume.drivers.remotefs [None req-244a3ee2-873d-454f-befa-6eef41cb503b tempest-VolumesSnapshotTestJSON-1982727637 None] /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-b54f6649-e793-4498-b73a-3ca73ed9261d.c77e68ba-6838-4b3e-ab2b-e25db639487f is being set with open permissions: ugo+rw Aug 29 01:18:28 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-244a3ee2-873d-454f-befa-6eef41cb503b tempest-VolumesSnapshotTestJSON-1982727637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-b54f6649-e793-4498-b73a-3ca73ed9261d.c77e68ba-6838-4b3e-ab2b-e25db639487f {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:18:28 devstack sudo[96223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-b54f6649-e793-4498-b73a-3ca73ed9261d.c77e68ba-6838-4b3e-ab2b-e25db639487f Aug 29 01:18:28 devstack sudo[96223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:18:28 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-dc544623-434d-4eb7-ae6e-9017119216ba tempest-SnapshotsActionsTest-1924917168 None] Created reservations ['4dfbd070-1022-496f-a4ac-c831b518242e', 'fdb3e62e-34bd-49e1-953d-b68485318396', 'c980607e-d82e-41f3-a6a9-191992b14eff', '105dac87-07ad-47aa-ac15-b3fd282a5ce9'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:18:28 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-dc544623-434d-4eb7-ae6e-9017119216ba tempest-SnapshotsActionsTest-1924917168 None] Delete snapshot completed successfully. Aug 29 01:18:28 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-dc544623-434d-4eb7-ae6e-9017119216ba tempest-SnapshotsActionsTest-1924917168 None] Lock "cinder-b3d39712-bb6a-47b8-95a0-a2391b942cc0-delete_snapshot" released by "delete_snapshot" :: held 2.498s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:18:28 devstack sudo[96223]: pam_unix(sudo:session): session closed for user root Aug 29 01:18:28 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-244a3ee2-873d-454f-befa-6eef41cb503b tempest-VolumesSnapshotTestJSON-1982727637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-b54f6649-e793-4498-b73a-3ca73ed9261d.c77e68ba-6838-4b3e-ab2b-e25db639487f" returned: 0 in 0.308s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:18:28 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-244a3ee2-873d-454f-befa-6eef41cb503b tempest-VolumesSnapshotTestJSON-1982727637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-b54f6649-e793-4498-b73a-3ca73ed9261d.info {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:18:28 devstack sudo[96226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-b54f6649-e793-4498-b73a-3ca73ed9261d.info Aug 29 01:18:28 devstack sudo[96226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:18:29 devstack sudo[96226]: pam_unix(sudo:session): session closed for user root Aug 29 01:18:29 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-244a3ee2-873d-454f-befa-6eef41cb503b tempest-VolumesSnapshotTestJSON-1982727637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-b54f6649-e793-4498-b73a-3ca73ed9261d.info" returned: 0 in 0.347s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:18:29 devstack cinder-volume[86111]: WARNING cinder.volume.drivers.remotefs [None req-244a3ee2-873d-454f-befa-6eef41cb503b tempest-VolumesSnapshotTestJSON-1982727637 None] /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-b54f6649-e793-4498-b73a-3ca73ed9261d.info is being set with open permissions: ugo+rw Aug 29 01:18:29 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-244a3ee2-873d-454f-befa-6eef41cb503b tempest-VolumesSnapshotTestJSON-1982727637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-b54f6649-e793-4498-b73a-3ca73ed9261d.info {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:18:29 devstack sudo[96230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-b54f6649-e793-4498-b73a-3ca73ed9261d.info Aug 29 01:18:29 devstack sudo[96230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:18:29 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-5623a93f-9925-4627-811d-7c9358730305 tempest-SnapshotsActionsTest-1924917168 None] Acquiring lock "cinder-3e056373-2aa3-4fa0-922e-3bbf1c28628b-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:18:29 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-5623a93f-9925-4627-811d-7c9358730305 tempest-SnapshotsActionsTest-1924917168 None] Lock "cinder-3e056373-2aa3-4fa0-922e-3bbf1c28628b-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:18:29 devstack sudo[96230]: pam_unix(sudo:session): session closed for user root Aug 29 01:18:29 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-244a3ee2-873d-454f-befa-6eef41cb503b tempest-VolumesSnapshotTestJSON-1982727637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-b54f6649-e793-4498-b73a-3ca73ed9261d.info" returned: 0 in 0.370s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:18:29 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-244a3ee2-873d-454f-befa-6eef41cb503b tempest-VolumesSnapshotTestJSON-1982727637 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.836s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:18:29 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [req-7f01ba18-221e-4752-9e2a-e07c421d567d req-ebcc9267-1e89-4d52-a8e7-a0c8178ebb3a tempest-TestInstancesWithCinderVolumes-192732122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.165s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:18:29 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-5623a93f-9925-4627-811d-7c9358730305 tempest-SnapshotsActionsTest-1924917168 None] Acquiring lock "cinder-quobyte-3e056373-2aa3-4fa0-922e-3bbf1c28628b" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:18:29 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [req-7f01ba18-221e-4752-9e2a-e07c421d567d req-ebcc9267-1e89-4d52-a8e7-a0c8178ebb3a tempest-TestInstancesWithCinderVolumes-192732122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.038s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:18:29 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-5623a93f-9925-4627-811d-7c9358730305 tempest-SnapshotsActionsTest-1924917168 None] Lock "cinder-quobyte-3e056373-2aa3-4fa0-922e-3bbf1c28628b" acquired by "delete_volume" :: waited 0.048s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:18:29 devstack cinder-volume[86111]: INFO cinder.volume.manager [req-4b07efd8-44a9-4e69-944d-c51b4ba54b00 req-cb5c8665-9179-4896-a43e-59c41a900e0d tempest-AttachVolumeNegativeTest-614873311 None] Terminate volume connection completed successfully. Aug 29 01:18:29 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [req-4b07efd8-44a9-4e69-944d-c51b4ba54b00 req-cb5c8665-9179-4896-a43e-59c41a900e0d tempest-AttachVolumeNegativeTest-614873311 None] Deleting attachment a3074e07-c47f-40e6-9ac4-e7a9355b58f1. {{(pid=86111) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 29 01:18:29 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[66531445-6676-4f90-849a-c33c243fb03d]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:18:29 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-5623a93f-9925-4627-811d-7c9358730305 tempest-SnapshotsActionsTest-1924917168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:18:29 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-244a3ee2-873d-454f-befa-6eef41cb503b tempest-VolumesSnapshotTestJSON-1982727637 None] Create snapshot completed successfully Aug 29 01:18:29 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [req-7f01ba18-221e-4752-9e2a-e07c421d567d req-ebcc9267-1e89-4d52-a8e7-a0c8178ebb3a tempest-TestInstancesWithCinderVolumes-192732122 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630', 'name': 'volume-e3178d0e-ea20-4d5e-9c79-9e4165e50dd5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '94731137-bd6a-4352-bfeb-b58700e9f464', 'enforce_multipath': True} {{(pid=86111) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 29 01:18:29 devstack cinder-volume[86111]: INFO cinder.volume.manager [req-7f01ba18-221e-4752-9e2a-e07c421d567d req-ebcc9267-1e89-4d52-a8e7-a0c8178ebb3a tempest-TestInstancesWithCinderVolumes-192732122 None] attachment_update completed successfully. Aug 29 01:18:29 devstack sudo[96238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b Aug 29 01:18:29 devstack sudo[96238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:18:29 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-1bfa0dbd-7845-4032-8b91-3251c7954a80 tempest-VolumesSnapshotTestJSON-1982727637 None] Acquiring lock "cinder-c77e68ba-6838-4b3e-ab2b-e25db639487f-delete_snapshot" by "delete_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:18:29 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-1bfa0dbd-7845-4032-8b91-3251c7954a80 tempest-VolumesSnapshotTestJSON-1982727637 None] Lock "cinder-c77e68ba-6838-4b3e-ab2b-e25db639487f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:18:30 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-1bfa0dbd-7845-4032-8b91-3251c7954a80 tempest-VolumesSnapshotTestJSON-1982727637 None] Acquiring lock "cinder-quobyte-b54f6649-e793-4498-b73a-3ca73ed9261d" by "delete_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:18:30 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-1bfa0dbd-7845-4032-8b91-3251c7954a80 tempest-VolumesSnapshotTestJSON-1982727637 None] Lock "cinder-quobyte-b54f6649-e793-4498-b73a-3ca73ed9261d" acquired by "delete_snapshot" :: waited 0.052s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:18:30 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-1bfa0dbd-7845-4032-8b91-3251c7954a80 tempest-VolumesSnapshotTestJSON-1982727637 None] Acquiring lock "cinder-quobyte-c77e68ba-6838-4b3e-ab2b-e25db639487f" by "_delete_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:18:30 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-1bfa0dbd-7845-4032-8b91-3251c7954a80 tempest-VolumesSnapshotTestJSON-1982727637 None] Lock "cinder-quobyte-c77e68ba-6838-4b3e-ab2b-e25db639487f" acquired by "_delete_snapshot" :: waited 0.043s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:18:30 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-1bfa0dbd-7845-4032-8b91-3251c7954a80 tempest-VolumesSnapshotTestJSON-1982727637 None] Deleting offline snapshot c77e68ba-6838-4b3e-ab2b-e25db639487f of volume b54f6649-e793-4498-b73a-3ca73ed9261d {{(pid=86111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 29 01:18:30 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-1bfa0dbd-7845-4032-8b91-3251c7954a80 tempest-VolumesSnapshotTestJSON-1982727637 None] snapshot_file for this snap is: volume-b54f6649-e793-4498-b73a-3ca73ed9261d.c77e68ba-6838-4b3e-ab2b-e25db639487f {{(pid=86111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 29 01:18:30 devstack sudo[96238]: pam_unix(sudo:session): session closed for user root Aug 29 01:18:30 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-5623a93f-9925-4627-811d-7c9358730305 tempest-SnapshotsActionsTest-1924917168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b" returned: 0 in 0.656s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:18:30 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-5623a93f-9925-4627-811d-7c9358730305 tempest-SnapshotsActionsTest-1924917168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:18:30 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b27793b-09f8-4075-82ac-9f3a5ea3eeb6]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:18:30 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-1bfa0dbd-7845-4032-8b91-3251c7954a80 tempest-VolumesSnapshotTestJSON-1982727637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-b54f6649-e793-4498-b73a-3ca73ed9261d.c77e68ba-6838-4b3e-ab2b-e25db639487f {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:18:30 devstack sudo[96243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b Aug 29 01:18:30 devstack sudo[96243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:18:30 devstack sudo[96244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-b54f6649-e793-4498-b73a-3ca73ed9261d.c77e68ba-6838-4b3e-ab2b-e25db639487f Aug 29 01:18:30 devstack sudo[96244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:18:30 devstack sudo[96243]: pam_unix(sudo:session): session closed for user root Aug 29 01:18:30 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-5623a93f-9925-4627-811d-7c9358730305 tempest-SnapshotsActionsTest-1924917168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3e056373-2aa3-4fa0-922e-3bbf1c28628b" returned: 0 in 0.364s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:18:30 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-5623a93f-9925-4627-811d-7c9358730305 tempest-SnapshotsActionsTest-1924917168 None] Lock "cinder-quobyte-3e056373-2aa3-4fa0-922e-3bbf1c28628b" released by "delete_volume" :: held 1.130s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:18:30 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-5623a93f-9925-4627-811d-7c9358730305 tempest-SnapshotsActionsTest-1924917168 None] Created reservations ['1e28c332-5267-4837-a0c3-1658dbe14cdb', '6bebaed2-d32b-46ed-997e-9751527fc5fe', 'ab96287a-229d-43c9-9c7f-be5604998e18', 'f1c5e7f2-6989-46b0-a998-383f91dc88bc'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:18:30 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-5623a93f-9925-4627-811d-7c9358730305 tempest-SnapshotsActionsTest-1924917168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:18:30 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-5623a93f-9925-4627-811d-7c9358730305 tempest-SnapshotsActionsTest-1924917168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:18:30 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-5623a93f-9925-4627-811d-7c9358730305 tempest-SnapshotsActionsTest-1924917168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:18:30 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-5623a93f-9925-4627-811d-7c9358730305 tempest-SnapshotsActionsTest-1924917168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:18:30 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-5623a93f-9925-4627-811d-7c9358730305 tempest-SnapshotsActionsTest-1924917168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:18:30 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-5623a93f-9925-4627-811d-7c9358730305 tempest-SnapshotsActionsTest-1924917168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:18:31 devstack sudo[96329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:18:31 devstack sudo[96329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:18:31 devstack sudo[96244]: pam_unix(sudo:session): session closed for user root Aug 29 01:18:31 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-1bfa0dbd-7845-4032-8b91-3251c7954a80 tempest-VolumesSnapshotTestJSON-1982727637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-b54f6649-e793-4498-b73a-3ca73ed9261d.c77e68ba-6838-4b3e-ab2b-e25db639487f" returned: 0 in 0.849s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:18:31 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-1bfa0dbd-7845-4032-8b91-3251c7954a80 tempest-VolumesSnapshotTestJSON-1982727637 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b54f6649-e793-4498-b73a-3ca73ed9261d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 29 01:18:31 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[427e7907-a7f5-4e70-8490-2f1291b34337]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:18:31 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-1bfa0dbd-7845-4032-8b91-3251c7954a80 tempest-VolumesSnapshotTestJSON-1982727637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-b54f6649-e793-4498-b73a-3ca73ed9261d {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:18:31 devstack sudo[96347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-b54f6649-e793-4498-b73a-3ca73ed9261d Aug 29 01:18:31 devstack sudo[96347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:18:31 devstack sudo[96329]: pam_unix(sudo:session): session closed for user root Aug 29 01:18:31 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-5623a93f-9925-4627-811d-7c9358730305 tempest-SnapshotsActionsTest-1924917168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.676s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:18:31 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-5623a93f-9925-4627-811d-7c9358730305 tempest-SnapshotsActionsTest-1924917168 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:18:31 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-5623a93f-9925-4627-811d-7c9358730305 tempest-SnapshotsActionsTest-1924917168 None] Deleted volume successfully. Aug 29 01:18:31 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-5623a93f-9925-4627-811d-7c9358730305 tempest-SnapshotsActionsTest-1924917168 None] Lock "cinder-3e056373-2aa3-4fa0-922e-3bbf1c28628b-delete_volume" released by "delete_volume" :: held 2.282s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:18:32 devstack sudo[96347]: pam_unix(sudo:session): session closed for user root Aug 29 01:18:32 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-1bfa0dbd-7845-4032-8b91-3251c7954a80 tempest-VolumesSnapshotTestJSON-1982727637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-b54f6649-e793-4498-b73a-3ca73ed9261d" returned: 0 in 1.006s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:18:32 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-1bfa0dbd-7845-4032-8b91-3251c7954a80 tempest-VolumesSnapshotTestJSON-1982727637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-b54f6649-e793-4498-b73a-3ca73ed9261d.c77e68ba-6838-4b3e-ab2b-e25db639487f {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:18:32 devstack sudo[96716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-b54f6649-e793-4498-b73a-3ca73ed9261d.c77e68ba-6838-4b3e-ab2b-e25db639487f Aug 29 01:18:32 devstack sudo[96716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:18:32 devstack sudo[96716]: pam_unix(sudo:session): session closed for user root Aug 29 01:18:32 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-1bfa0dbd-7845-4032-8b91-3251c7954a80 tempest-VolumesSnapshotTestJSON-1982727637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-b54f6649-e793-4498-b73a-3ca73ed9261d.c77e68ba-6838-4b3e-ab2b-e25db639487f" returned: 0 in 0.639s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:18:32 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-1bfa0dbd-7845-4032-8b91-3251c7954a80 tempest-VolumesSnapshotTestJSON-1982727637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-b54f6649-e793-4498-b73a-3ca73ed9261d.c77e68ba-6838-4b3e-ab2b-e25db639487f {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:18:32 devstack sudo[96731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-b54f6649-e793-4498-b73a-3ca73ed9261d.c77e68ba-6838-4b3e-ab2b-e25db639487f Aug 29 01:18:32 devstack sudo[96731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:18:33 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-1bfa0dbd-7845-4032-8b91-3251c7954a80 tempest-VolumesSnapshotTestJSON-1982727637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-b54f6649-e793-4498-b73a-3ca73ed9261d.c77e68ba-6838-4b3e-ab2b-e25db639487f" returned: 0 in 0.367s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:18:33 devstack sudo[96731]: pam_unix(sudo:session): session closed for user root Aug 29 01:18:33 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-1bfa0dbd-7845-4032-8b91-3251c7954a80 tempest-VolumesSnapshotTestJSON-1982727637 None] Lock "cinder-quobyte-c77e68ba-6838-4b3e-ab2b-e25db639487f" released by "_delete_snapshot" :: held 3.154s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:18:33 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-1bfa0dbd-7845-4032-8b91-3251c7954a80 tempest-VolumesSnapshotTestJSON-1982727637 None] Lock "cinder-quobyte-b54f6649-e793-4498-b73a-3ca73ed9261d" released by "delete_snapshot" :: held 3.220s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:18:33 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-1bfa0dbd-7845-4032-8b91-3251c7954a80 tempest-VolumesSnapshotTestJSON-1982727637 None] Created reservations ['4b1182bd-2e70-41ee-b4f6-6deb6aecbeb1', '3d67a0dd-995d-483e-b491-a8c4a1599e33', '9189cfe1-b86c-4bdb-8e36-b5e46890121b', 'c8869a91-5f3e-4386-ae42-0883294a6d43'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:18:33 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-1bfa0dbd-7845-4032-8b91-3251c7954a80 tempest-VolumesSnapshotTestJSON-1982727637 None] Delete snapshot completed successfully. Aug 29 01:18:33 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-1bfa0dbd-7845-4032-8b91-3251c7954a80 tempest-VolumesSnapshotTestJSON-1982727637 None] Lock "cinder-c77e68ba-6838-4b3e-ab2b-e25db639487f-delete_snapshot" released by "delete_snapshot" :: held 3.716s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:18:35 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-86806b24-030c-4867-9532-29b51937dc11 tempest-VolumesSnapshotTestJSON-1982727637 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:18:35 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-86806b24-030c-4867-9532-29b51937dc11 tempest-VolumesSnapshotTestJSON-1982727637 None] Flow 'volume_create_manager' (3e6cca29-fb52-4a0b-9c3c-9e9dc77aab5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:18:35 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-86806b24-030c-4867-9532-29b51937dc11 tempest-VolumesSnapshotTestJSON-1982727637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dab086f-59e0-4849-94ef-540c731d2ab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:18:35 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-86806b24-030c-4867-9532-29b51937dc11 tempest-VolumesSnapshotTestJSON-1982727637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dab086f-59e0-4849-94ef-540c731d2ab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:18:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1790153132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de2f4ffc-595d-4be5-a21f-1fc9d16cd708,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7bf2d2db8a14115afd9c2ec5d80764e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:18:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:18:35Z,use_quota=True,user_id='0a960c2d40c44669aace6e57fa7accb7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:18:35 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-86806b24-030c-4867-9532-29b51937dc11 tempest-VolumesSnapshotTestJSON-1982727637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9ef9df1-4898-40bc-aad4-e8929860b85b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:18:35 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-86806b24-030c-4867-9532-29b51937dc11 tempest-VolumesSnapshotTestJSON-1982727637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9ef9df1-4898-40bc-aad4-e8929860b85b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:18:35 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-86806b24-030c-4867-9532-29b51937dc11 tempest-VolumesSnapshotTestJSON-1982727637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d8361f9-6cc2-4f08-926b-d5ba877d361d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:18:35 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-86806b24-030c-4867-9532-29b51937dc11 tempest-VolumesSnapshotTestJSON-1982727637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d8361f9-6cc2-4f08-926b-d5ba877d361d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de2f4ffc-595d-4be5-a21f-1fc9d16cd708', 'volume_name': 'volume-de2f4ffc-595d-4be5-a21f-1fc9d16cd708', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:18:35 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-86806b24-030c-4867-9532-29b51937dc11 tempest-VolumesSnapshotTestJSON-1982727637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ad00f0e-f49a-4fee-bcbe-1b6c3925fe05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:18:35 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-86806b24-030c-4867-9532-29b51937dc11 tempest-VolumesSnapshotTestJSON-1982727637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ad00f0e-f49a-4fee-bcbe-1b6c3925fe05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:18:35 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-86806b24-030c-4867-9532-29b51937dc11 tempest-VolumesSnapshotTestJSON-1982727637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f7fdcdf-c9f5-4496-86c2-42eacabd1d46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:18:35 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-86806b24-030c-4867-9532-29b51937dc11 tempest-VolumesSnapshotTestJSON-1982727637 None] Volume de2f4ffc-595d-4be5-a21f-1fc9d16cd708: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de2f4ffc-595d-4be5-a21f-1fc9d16cd708', 'volume_size': 1} Aug 29 01:18:35 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-86806b24-030c-4867-9532-29b51937dc11 tempest-VolumesSnapshotTestJSON-1982727637 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:18:35 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-86806b24-030c-4867-9532-29b51937dc11 tempest-VolumesSnapshotTestJSON-1982727637 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:18:35 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-86806b24-030c-4867-9532-29b51937dc11 tempest-VolumesSnapshotTestJSON-1982727637 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:18:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1790153132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de2f4ffc-595d-4be5-a21f-1fc9d16cd708,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7bf2d2db8a14115afd9c2ec5d80764e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:18:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:18:35Z,use_quota=True,user_id='0a960c2d40c44669aace6e57fa7accb7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:18:35 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-86806b24-030c-4867-9532-29b51937dc11 tempest-VolumesSnapshotTestJSON-1982727637 None] Creating volume de2f4ffc-595d-4be5-a21f-1fc9d16cd708 {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:18:35 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-86806b24-030c-4867-9532-29b51937dc11 tempest-VolumesSnapshotTestJSON-1982727637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:18:35 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-86806b24-030c-4867-9532-29b51937dc11 tempest-VolumesSnapshotTestJSON-1982727637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:18:35 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-86806b24-030c-4867-9532-29b51937dc11 tempest-VolumesSnapshotTestJSON-1982727637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:18:35 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-86806b24-030c-4867-9532-29b51937dc11 tempest-VolumesSnapshotTestJSON-1982727637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:18:35 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-86806b24-030c-4867-9532-29b51937dc11 tempest-VolumesSnapshotTestJSON-1982727637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:18:35 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-86806b24-030c-4867-9532-29b51937dc11 tempest-VolumesSnapshotTestJSON-1982727637 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:18:35 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-86806b24-030c-4867-9532-29b51937dc11 tempest-VolumesSnapshotTestJSON-1982727637 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:18:35 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-86806b24-030c-4867-9532-29b51937dc11 tempest-VolumesSnapshotTestJSON-1982727637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-de2f4ffc-595d-4be5-a21f-1fc9d16cd708 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:18:35 devstack sudo[96740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-de2f4ffc-595d-4be5-a21f-1fc9d16cd708 1073741824 Aug 29 01:18:35 devstack sudo[96740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:18:36 devstack sudo[96740]: pam_unix(sudo:session): session closed for user root Aug 29 01:18:36 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-86806b24-030c-4867-9532-29b51937dc11 tempest-VolumesSnapshotTestJSON-1982727637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-de2f4ffc-595d-4be5-a21f-1fc9d16cd708 1073741824" returned: 0 in 0.800s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:18:36 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-86806b24-030c-4867-9532-29b51937dc11 tempest-VolumesSnapshotTestJSON-1982727637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-de2f4ffc-595d-4be5-a21f-1fc9d16cd708 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:18:36 devstack sudo[96746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-de2f4ffc-595d-4be5-a21f-1fc9d16cd708 Aug 29 01:18:36 devstack sudo[96746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:18:36 devstack sudo[96746]: pam_unix(sudo:session): session closed for user root Aug 29 01:18:36 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-86806b24-030c-4867-9532-29b51937dc11 tempest-VolumesSnapshotTestJSON-1982727637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-de2f4ffc-595d-4be5-a21f-1fc9d16cd708" returned: 0 in 0.442s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:18:36 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-86806b24-030c-4867-9532-29b51937dc11 tempest-VolumesSnapshotTestJSON-1982727637 None] <== create_volume: return (1351ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:18:36 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-86806b24-030c-4867-9532-29b51937dc11 tempest-VolumesSnapshotTestJSON-1982727637 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.354s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:18:36 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-86806b24-030c-4867-9532-29b51937dc11 tempest-VolumesSnapshotTestJSON-1982727637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f7fdcdf-c9f5-4496-86c2-42eacabd1d46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de2f4ffc-595d-4be5-a21f-1fc9d16cd708', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:18:36 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-86806b24-030c-4867-9532-29b51937dc11 tempest-VolumesSnapshotTestJSON-1982727637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (536cf2dc-41e3-42a9-bbd6-456cf121a50c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:18:36 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-86806b24-030c-4867-9532-29b51937dc11 tempest-VolumesSnapshotTestJSON-1982727637 None] Volume volume-de2f4ffc-595d-4be5-a21f-1fc9d16cd708 (de2f4ffc-595d-4be5-a21f-1fc9d16cd708): created successfully Aug 29 01:18:36 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-86806b24-030c-4867-9532-29b51937dc11 tempest-VolumesSnapshotTestJSON-1982727637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (536cf2dc-41e3-42a9-bbd6-456cf121a50c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:18:36 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-86806b24-030c-4867-9532-29b51937dc11 tempest-VolumesSnapshotTestJSON-1982727637 None] Flow 'volume_create_manager' (3e6cca29-fb52-4a0b-9c3c-9e9dc77aab5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:18:37 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-86806b24-030c-4867-9532-29b51937dc11 tempest-VolumesSnapshotTestJSON-1982727637 None] Created volume successfully. Aug 29 01:18:37 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-902c5b00-70a9-47b3-b8b1-759064040356 tempest-VolumesSnapshotTestJSON-1982727637 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:18:37 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-902c5b00-70a9-47b3-b8b1-759064040356 tempest-VolumesSnapshotTestJSON-1982727637 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:18:37 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-902c5b00-70a9-47b3-b8b1-759064040356 tempest-VolumesSnapshotTestJSON-1982727637 None] Creating offline snapshot 7bc30b31-17b5-4d77-8f4c-69bc2877c5e2 of volume de2f4ffc-595d-4be5-a21f-1fc9d16cd708 {{(pid=86111) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 29 01:18:37 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[f08f88e8-954b-41fb-85e8-504be92f2552]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:18:37 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-902c5b00-70a9-47b3-b8b1-759064040356 tempest-VolumesSnapshotTestJSON-1982727637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-de2f4ffc-595d-4be5-a21f-1fc9d16cd708 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:18:38 devstack sudo[96749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-de2f4ffc-595d-4be5-a21f-1fc9d16cd708 Aug 29 01:18:38 devstack sudo[96749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:18:38 devstack sudo[96749]: pam_unix(sudo:session): session closed for user root Aug 29 01:18:38 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-902c5b00-70a9-47b3-b8b1-759064040356 tempest-VolumesSnapshotTestJSON-1982727637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-de2f4ffc-595d-4be5-a21f-1fc9d16cd708" returned: 0 in 0.861s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:18:38 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-902c5b00-70a9-47b3-b8b1-759064040356 tempest-VolumesSnapshotTestJSON-1982727637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-de2f4ffc-595d-4be5-a21f-1fc9d16cd708,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-de2f4ffc-595d-4be5-a21f-1fc9d16cd708.7bc30b31-17b5-4d77-8f4c-69bc2877c5e2 1G {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:18:38 devstack sudo[96755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-de2f4ffc-595d-4be5-a21f-1fc9d16cd708,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-de2f4ffc-595d-4be5-a21f-1fc9d16cd708.7bc30b31-17b5-4d77-8f4c-69bc2877c5e2 1G Aug 29 01:18:38 devstack sudo[96755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:18:39 devstack sudo[96755]: pam_unix(sudo:session): session closed for user root Aug 29 01:18:39 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-902c5b00-70a9-47b3-b8b1-759064040356 tempest-VolumesSnapshotTestJSON-1982727637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-de2f4ffc-595d-4be5-a21f-1fc9d16cd708,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-de2f4ffc-595d-4be5-a21f-1fc9d16cd708.7bc30b31-17b5-4d77-8f4c-69bc2877c5e2 1G" returned: 0 in 0.772s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:18:39 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-902c5b00-70a9-47b3-b8b1-759064040356 tempest-VolumesSnapshotTestJSON-1982727637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de2f4ffc-595d-4be5-a21f-1fc9d16cd708 -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-de2f4ffc-595d-4be5-a21f-1fc9d16cd708.7bc30b31-17b5-4d77-8f4c-69bc2877c5e2 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:18:39 devstack sudo[96761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de2f4ffc-595d-4be5-a21f-1fc9d16cd708 -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-de2f4ffc-595d-4be5-a21f-1fc9d16cd708.7bc30b31-17b5-4d77-8f4c-69bc2877c5e2 Aug 29 01:18:39 devstack sudo[96761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:18:40 devstack sudo[96761]: pam_unix(sudo:session): session closed for user root Aug 29 01:18:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-902c5b00-70a9-47b3-b8b1-759064040356 tempest-VolumesSnapshotTestJSON-1982727637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de2f4ffc-595d-4be5-a21f-1fc9d16cd708 -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-de2f4ffc-595d-4be5-a21f-1fc9d16cd708.7bc30b31-17b5-4d77-8f4c-69bc2877c5e2" returned: 0 in 0.402s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:18:40 devstack cinder-volume[86111]: WARNING cinder.volume.drivers.remotefs [None req-902c5b00-70a9-47b3-b8b1-759064040356 tempest-VolumesSnapshotTestJSON-1982727637 None] /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-de2f4ffc-595d-4be5-a21f-1fc9d16cd708.7bc30b31-17b5-4d77-8f4c-69bc2877c5e2 is being set with open permissions: ugo+rw Aug 29 01:18:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-902c5b00-70a9-47b3-b8b1-759064040356 tempest-VolumesSnapshotTestJSON-1982727637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-de2f4ffc-595d-4be5-a21f-1fc9d16cd708.7bc30b31-17b5-4d77-8f4c-69bc2877c5e2 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:18:40 devstack sudo[96767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-de2f4ffc-595d-4be5-a21f-1fc9d16cd708.7bc30b31-17b5-4d77-8f4c-69bc2877c5e2 Aug 29 01:18:40 devstack sudo[96767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:18:40 devstack sudo[96767]: pam_unix(sudo:session): session closed for user root Aug 29 01:18:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-902c5b00-70a9-47b3-b8b1-759064040356 tempest-VolumesSnapshotTestJSON-1982727637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-de2f4ffc-595d-4be5-a21f-1fc9d16cd708.7bc30b31-17b5-4d77-8f4c-69bc2877c5e2" returned: 0 in 0.347s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:18:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-902c5b00-70a9-47b3-b8b1-759064040356 tempest-VolumesSnapshotTestJSON-1982727637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-de2f4ffc-595d-4be5-a21f-1fc9d16cd708.info {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:18:40 devstack sudo[96770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-de2f4ffc-595d-4be5-a21f-1fc9d16cd708.info Aug 29 01:18:40 devstack sudo[96770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:18:40 devstack cinder-volume[86111]: DEBUG oslo_service.periodic_task [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86111) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 29 01:18:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:18:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:18:40 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:18:40 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:18:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:18:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:18:40 devstack sudo[96773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:18:40 devstack sudo[96773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:18:40 devstack sudo[96770]: pam_unix(sudo:session): session closed for user root Aug 29 01:18:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-902c5b00-70a9-47b3-b8b1-759064040356 tempest-VolumesSnapshotTestJSON-1982727637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-de2f4ffc-595d-4be5-a21f-1fc9d16cd708.info" returned: 0 in 0.494s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:18:40 devstack cinder-volume[86111]: WARNING cinder.volume.drivers.remotefs [None req-902c5b00-70a9-47b3-b8b1-759064040356 tempest-VolumesSnapshotTestJSON-1982727637 None] /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-de2f4ffc-595d-4be5-a21f-1fc9d16cd708.info is being set with open permissions: ugo+rw Aug 29 01:18:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-902c5b00-70a9-47b3-b8b1-759064040356 tempest-VolumesSnapshotTestJSON-1982727637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-de2f4ffc-595d-4be5-a21f-1fc9d16cd708.info {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:18:40 devstack sudo[96776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-de2f4ffc-595d-4be5-a21f-1fc9d16cd708.info Aug 29 01:18:40 devstack sudo[96776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:18:41 devstack sudo[96773]: pam_unix(sudo:session): session closed for user root Aug 29 01:18:41 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-de752545-d617-440e-8362-d04fae0901a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.452s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:18:41 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:18:41 devstack cinder-volume[86111]: DEBUG oslo_service.periodic_task [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Running periodic task VolumeManager._thread_info {{(pid=86111) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 29 01:18:41 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-de752545-d617-440e-8362-d04fae0901a5 None None] thread count: 28 {{(pid=86111) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 29 01:18:41 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-de752545-d617-440e-8362-d04fae0901a5 None None] thread info: [<_MainThread(MainThread, started 129173440548992)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86111) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 29 01:18:41 devstack sudo[96776]: pam_unix(sudo:session): session closed for user root Aug 29 01:18:41 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-902c5b00-70a9-47b3-b8b1-759064040356 tempest-VolumesSnapshotTestJSON-1982727637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-de2f4ffc-595d-4be5-a21f-1fc9d16cd708.info" returned: 0 in 0.698s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:18:41 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-902c5b00-70a9-47b3-b8b1-759064040356 tempest-VolumesSnapshotTestJSON-1982727637 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.728s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:18:41 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-902c5b00-70a9-47b3-b8b1-759064040356 tempest-VolumesSnapshotTestJSON-1982727637 None] Create snapshot completed successfully Aug 29 01:18:43 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f814f36-59ab-48a5-b47c-c15315c24014 tempest-VolumesSnapshotTestJSON-1982727637 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:18:43 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-4f814f36-59ab-48a5-b47c-c15315c24014 tempest-VolumesSnapshotTestJSON-1982727637 None] Flow 'volume_create_manager' (b7a37f80-4a3f-4271-857c-d803916ac3e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:18:43 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-4f814f36-59ab-48a5-b47c-c15315c24014 tempest-VolumesSnapshotTestJSON-1982727637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9faaedbb-2c3e-4f83-8ef5-9882bd789313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:18:43 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-4f814f36-59ab-48a5-b47c-c15315c24014 tempest-VolumesSnapshotTestJSON-1982727637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9faaedbb-2c3e-4f83-8ef5-9882bd789313) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:18:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1957366198',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=327ef5fd-ae4b-49ed-87b2-dd21061059c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7bf2d2db8a14115afd9c2ec5d80764e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:18:43Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=7bc30b31-17b5-4d77-8f4c-69bc2877c5e2,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:18:43Z,use_quota=True,user_id='0a960c2d40c44669aace6e57fa7accb7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:18:43 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-4f814f36-59ab-48a5-b47c-c15315c24014 tempest-VolumesSnapshotTestJSON-1982727637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7763423d-a69b-4017-a185-24302ec84028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:18:43 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-4f814f36-59ab-48a5-b47c-c15315c24014 tempest-VolumesSnapshotTestJSON-1982727637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7763423d-a69b-4017-a185-24302ec84028) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:18:43 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-4f814f36-59ab-48a5-b47c-c15315c24014 tempest-VolumesSnapshotTestJSON-1982727637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d36de444-c40c-448e-ab64-5a6a4862060f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:18:43 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-4f814f36-59ab-48a5-b47c-c15315c24014 tempest-VolumesSnapshotTestJSON-1982727637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d36de444-c40c-448e-ab64-5a6a4862060f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '327ef5fd-ae4b-49ed-87b2-dd21061059c3', 'volume_name': 'volume-327ef5fd-ae4b-49ed-87b2-dd21061059c3', 'volume_size': 2, 'snapshot_id': '7bc30b31-17b5-4d77-8f4c-69bc2877c5e2'}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:18:43 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-4f814f36-59ab-48a5-b47c-c15315c24014 tempest-VolumesSnapshotTestJSON-1982727637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (187228f9-2f9f-4bf5-a52d-cabb2cbe62c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:18:43 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-4f814f36-59ab-48a5-b47c-c15315c24014 tempest-VolumesSnapshotTestJSON-1982727637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (187228f9-2f9f-4bf5-a52d-cabb2cbe62c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:18:43 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-4f814f36-59ab-48a5-b47c-c15315c24014 tempest-VolumesSnapshotTestJSON-1982727637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14343698-5613-4388-9149-d46c4ecc404a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:18:43 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-4f814f36-59ab-48a5-b47c-c15315c24014 tempest-VolumesSnapshotTestJSON-1982727637 None] Volume 327ef5fd-ae4b-49ed-87b2-dd21061059c3: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-327ef5fd-ae4b-49ed-87b2-dd21061059c3', 'volume_size': 2, 'snapshot_id': '7bc30b31-17b5-4d77-8f4c-69bc2877c5e2'} Aug 29 01:18:43 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-4f814f36-59ab-48a5-b47c-c15315c24014 tempest-VolumesSnapshotTestJSON-1982727637 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:18:43 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-4f814f36-59ab-48a5-b47c-c15315c24014 tempest-VolumesSnapshotTestJSON-1982727637 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:18:43 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-4f814f36-59ab-48a5-b47c-c15315c24014 tempest-VolumesSnapshotTestJSON-1982727637 None] Acquiring lock "cinder-quobyte-7bc30b31-17b5-4d77-8f4c-69bc2877c5e2-327ef5fd-ae4b-49ed-87b2-dd21061059c3" by "_create_volume_from_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:18:43 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-4f814f36-59ab-48a5-b47c-c15315c24014 tempest-VolumesSnapshotTestJSON-1982727637 None] Lock "cinder-quobyte-7bc30b31-17b5-4d77-8f4c-69bc2877c5e2-327ef5fd-ae4b-49ed-87b2-dd21061059c3" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:18:43 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-4f814f36-59ab-48a5-b47c-c15315c24014 tempest-VolumesSnapshotTestJSON-1982727637 None] Creating volume 327ef5fd-ae4b-49ed-87b2-dd21061059c3 from snapshot 7bc30b31-17b5-4d77-8f4c-69bc2877c5e2 {{(pid=86111) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Aug 29 01:18:43 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-4f814f36-59ab-48a5-b47c-c15315c24014 tempest-VolumesSnapshotTestJSON-1982727637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:18:43 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-4f814f36-59ab-48a5-b47c-c15315c24014 tempest-VolumesSnapshotTestJSON-1982727637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:18:43 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-4f814f36-59ab-48a5-b47c-c15315c24014 tempest-VolumesSnapshotTestJSON-1982727637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:18:43 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-4f814f36-59ab-48a5-b47c-c15315c24014 tempest-VolumesSnapshotTestJSON-1982727637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:18:43 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-4f814f36-59ab-48a5-b47c-c15315c24014 tempest-VolumesSnapshotTestJSON-1982727637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:18:43 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-4f814f36-59ab-48a5-b47c-c15315c24014 tempest-VolumesSnapshotTestJSON-1982727637 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:18:43 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-4f814f36-59ab-48a5-b47c-c15315c24014 tempest-VolumesSnapshotTestJSON-1982727637 None] Acquiring lock "cinder-quobyte-327ef5fd-ae4b-49ed-87b2-dd21061059c3" by "_copy_volume_from_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:18:43 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-4f814f36-59ab-48a5-b47c-c15315c24014 tempest-VolumesSnapshotTestJSON-1982727637 None] Lock "cinder-quobyte-327ef5fd-ae4b-49ed-87b2-dd21061059c3" acquired by "_copy_volume_from_snapshot" :: waited 0.030s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:18:43 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-4f814f36-59ab-48a5-b47c-c15315c24014 tempest-VolumesSnapshotTestJSON-1982727637 None] snapshot: 7bc30b31-17b5-4d77-8f4c-69bc2877c5e2, volume: 327ef5fd-ae4b-49ed-87b2-dd21061059c3, {{(pid=86111) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 29 01:18:43 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-4f814f36-59ab-48a5-b47c-c15315c24014 tempest-VolumesSnapshotTestJSON-1982727637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:18:43 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-4f814f36-59ab-48a5-b47c-c15315c24014 tempest-VolumesSnapshotTestJSON-1982727637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:18:43 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-4f814f36-59ab-48a5-b47c-c15315c24014 tempest-VolumesSnapshotTestJSON-1982727637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:18:43 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-4f814f36-59ab-48a5-b47c-c15315c24014 tempest-VolumesSnapshotTestJSON-1982727637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:18:43 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-4f814f36-59ab-48a5-b47c-c15315c24014 tempest-VolumesSnapshotTestJSON-1982727637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:18:43 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[f61c3a60-c063-47d6-bd4c-b2023c17a3f5]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:18:43 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-4f814f36-59ab-48a5-b47c-c15315c24014 tempest-VolumesSnapshotTestJSON-1982727637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-de2f4ffc-595d-4be5-a21f-1fc9d16cd708.7bc30b31-17b5-4d77-8f4c-69bc2877c5e2 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:18:43 devstack sudo[96781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-de2f4ffc-595d-4be5-a21f-1fc9d16cd708.7bc30b31-17b5-4d77-8f4c-69bc2877c5e2 Aug 29 01:18:43 devstack sudo[96781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:18:43 devstack sudo[96781]: pam_unix(sudo:session): session closed for user root Aug 29 01:18:43 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-4f814f36-59ab-48a5-b47c-c15315c24014 tempest-VolumesSnapshotTestJSON-1982727637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-de2f4ffc-595d-4be5-a21f-1fc9d16cd708.7bc30b31-17b5-4d77-8f4c-69bc2877c5e2" returned: 0 in 0.511s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:18:43 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-4f814f36-59ab-48a5-b47c-c15315c24014 tempest-VolumesSnapshotTestJSON-1982727637 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-de2f4ffc-595d-4be5-a21f-1fc9d16cd708(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 29 01:18:43 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2cbeec4-cf09-4bed-ba9a-1d0956195448]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:18:43 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-4f814f36-59ab-48a5-b47c-c15315c24014 tempest-VolumesSnapshotTestJSON-1982727637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-de2f4ffc-595d-4be5-a21f-1fc9d16cd708 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:18:44 devstack sudo[96787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-de2f4ffc-595d-4be5-a21f-1fc9d16cd708 Aug 29 01:18:44 devstack sudo[96787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:18:44 devstack sudo[96787]: pam_unix(sudo:session): session closed for user root Aug 29 01:18:44 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-4f814f36-59ab-48a5-b47c-c15315c24014 tempest-VolumesSnapshotTestJSON-1982727637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-de2f4ffc-595d-4be5-a21f-1fc9d16cd708" returned: 0 in 0.727s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:18:44 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-4f814f36-59ab-48a5-b47c-c15315c24014 tempest-VolumesSnapshotTestJSON-1982727637 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-de2f4ffc-595d-4be5-a21f-1fc9d16cd708 {{(pid=86111) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 29 01:18:44 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-4f814f36-59ab-48a5-b47c-c15315c24014 tempest-VolumesSnapshotTestJSON-1982727637 None] Creating direct copy from snapshot {{(pid=86111) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 29 01:18:44 devstack cinder-volume[86111]: DEBUG cinder.utils [None req-4f814f36-59ab-48a5-b47c-c15315c24014 tempest-VolumesSnapshotTestJSON-1982727637 None] Path /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-327ef5fd-ae4b-49ed-87b2-dd21061059c3 not found in is_blk_device check {{(pid=86111) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 29 01:18:44 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-4f814f36-59ab-48a5-b47c-c15315c24014 tempest-VolumesSnapshotTestJSON-1982727637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-de2f4ffc-595d-4be5-a21f-1fc9d16cd708 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-327ef5fd-ae4b-49ed-87b2-dd21061059c3 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:18:44 devstack sudo[96795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-de2f4ffc-595d-4be5-a21f-1fc9d16cd708 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-327ef5fd-ae4b-49ed-87b2-dd21061059c3 Aug 29 01:18:44 devstack sudo[96795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:18:52 devstack sudo[96795]: pam_unix(sudo:session): session closed for user root Aug 29 01:18:52 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-4f814f36-59ab-48a5-b47c-c15315c24014 tempest-VolumesSnapshotTestJSON-1982727637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-de2f4ffc-595d-4be5-a21f-1fc9d16cd708 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-327ef5fd-ae4b-49ed-87b2-dd21061059c3" returned: 0 in 8.213s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:18:52 devstack cinder-volume[86111]: DEBUG cinder.image.image_utils [None req-4f814f36-59ab-48a5-b47c-c15315c24014 tempest-VolumesSnapshotTestJSON-1982727637 None] Image conversion details: src /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-de2f4ffc-595d-4be5-a21f-1fc9d16cd708, size 1024.00 MB, duration 8.22 sec, destination /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-327ef5fd-ae4b-49ed-87b2-dd21061059c3 {{(pid=86111) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 29 01:18:52 devstack cinder-volume[86111]: INFO cinder.image.image_utils [None req-4f814f36-59ab-48a5-b47c-c15315c24014 tempest-VolumesSnapshotTestJSON-1982727637 None] Converted 1024.00 MB image at 124.59 MB/s Aug 29 01:18:52 devstack cinder-volume[86111]: WARNING cinder.volume.drivers.remotefs [None req-4f814f36-59ab-48a5-b47c-c15315c24014 tempest-VolumesSnapshotTestJSON-1982727637 None] /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-327ef5fd-ae4b-49ed-87b2-dd21061059c3 is being set with open permissions: ugo+rw Aug 29 01:18:52 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-4f814f36-59ab-48a5-b47c-c15315c24014 tempest-VolumesSnapshotTestJSON-1982727637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-327ef5fd-ae4b-49ed-87b2-dd21061059c3 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:18:52 devstack sudo[96846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-327ef5fd-ae4b-49ed-87b2-dd21061059c3 Aug 29 01:18:52 devstack sudo[96846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:18:53 devstack cinder-volume[86111]: DEBUG dbcounter [-] [86111] Writing DB stats cinder:SELECT=78,cinder:INSERT=13,cinder:UPDATE=52,cinder:DELETE=4 {{(pid=86111) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 29 01:18:53 devstack sudo[96846]: pam_unix(sudo:session): session closed for user root Aug 29 01:18:53 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-4f814f36-59ab-48a5-b47c-c15315c24014 tempest-VolumesSnapshotTestJSON-1982727637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-327ef5fd-ae4b-49ed-87b2-dd21061059c3" returned: 0 in 0.394s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:18:53 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-4f814f36-59ab-48a5-b47c-c15315c24014 tempest-VolumesSnapshotTestJSON-1982727637 None] Lock "cinder-quobyte-327ef5fd-ae4b-49ed-87b2-dd21061059c3" released by "_copy_volume_from_snapshot" :: held 9.974s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:18:53 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-4f814f36-59ab-48a5-b47c-c15315c24014 tempest-VolumesSnapshotTestJSON-1982727637 None] Lock "cinder-quobyte-7bc30b31-17b5-4d77-8f4c-69bc2877c5e2-327ef5fd-ae4b-49ed-87b2-dd21061059c3" released by "_create_volume_from_snapshot" :: held 10.086s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:18:53 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-4f814f36-59ab-48a5-b47c-c15315c24014 tempest-VolumesSnapshotTestJSON-1982727637 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.108s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:18:53 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-4f814f36-59ab-48a5-b47c-c15315c24014 tempest-VolumesSnapshotTestJSON-1982727637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14343698-5613-4388-9149-d46c4ecc404a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-327ef5fd-ae4b-49ed-87b2-dd21061059c3', 'volume_size': 2, 'snapshot_id': '7bc30b31-17b5-4d77-8f4c-69bc2877c5e2'}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:18:53 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-4f814f36-59ab-48a5-b47c-c15315c24014 tempest-VolumesSnapshotTestJSON-1982727637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a44790a-7e37-4bd8-b8a1-6ffeff20ecfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:18:53 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-4f814f36-59ab-48a5-b47c-c15315c24014 tempest-VolumesSnapshotTestJSON-1982727637 None] Volume volume-327ef5fd-ae4b-49ed-87b2-dd21061059c3 (327ef5fd-ae4b-49ed-87b2-dd21061059c3): created successfully Aug 29 01:18:53 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-4f814f36-59ab-48a5-b47c-c15315c24014 tempest-VolumesSnapshotTestJSON-1982727637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a44790a-7e37-4bd8-b8a1-6ffeff20ecfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:18:53 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-4f814f36-59ab-48a5-b47c-c15315c24014 tempest-VolumesSnapshotTestJSON-1982727637 None] Flow 'volume_create_manager' (b7a37f80-4a3f-4271-857c-d803916ac3e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:18:53 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-4f814f36-59ab-48a5-b47c-c15315c24014 tempest-VolumesSnapshotTestJSON-1982727637 None] Created volume successfully. Aug 29 01:18:53 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-2413f79c-d917-4dc7-ac8e-452dd794cf65 tempest-VolumesSnapshotTestJSON-1982727637 None] Acquiring lock "cinder-327ef5fd-ae4b-49ed-87b2-dd21061059c3-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:18:53 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-2413f79c-d917-4dc7-ac8e-452dd794cf65 tempest-VolumesSnapshotTestJSON-1982727637 None] Lock "cinder-327ef5fd-ae4b-49ed-87b2-dd21061059c3-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:18:53 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-2413f79c-d917-4dc7-ac8e-452dd794cf65 tempest-VolumesSnapshotTestJSON-1982727637 None] Acquiring lock "cinder-quobyte-327ef5fd-ae4b-49ed-87b2-dd21061059c3" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:18:54 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-2413f79c-d917-4dc7-ac8e-452dd794cf65 tempest-VolumesSnapshotTestJSON-1982727637 None] Lock "cinder-quobyte-327ef5fd-ae4b-49ed-87b2-dd21061059c3" acquired by "delete_volume" :: waited 0.023s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:18:54 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[afc149bf-9fa8-4b54-9770-f87f5f374609]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:18:54 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-2413f79c-d917-4dc7-ac8e-452dd794cf65 tempest-VolumesSnapshotTestJSON-1982727637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-327ef5fd-ae4b-49ed-87b2-dd21061059c3 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:18:54 devstack sudo[96864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-327ef5fd-ae4b-49ed-87b2-dd21061059c3 Aug 29 01:18:54 devstack sudo[96864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:18:54 devstack sudo[96864]: pam_unix(sudo:session): session closed for user root Aug 29 01:18:54 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-2413f79c-d917-4dc7-ac8e-452dd794cf65 tempest-VolumesSnapshotTestJSON-1982727637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-327ef5fd-ae4b-49ed-87b2-dd21061059c3" returned: 0 in 0.422s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:18:54 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-2413f79c-d917-4dc7-ac8e-452dd794cf65 tempest-VolumesSnapshotTestJSON-1982727637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-327ef5fd-ae4b-49ed-87b2-dd21061059c3 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:18:54 devstack sudo[96869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-327ef5fd-ae4b-49ed-87b2-dd21061059c3 Aug 29 01:18:54 devstack sudo[96869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:18:54 devstack sudo[96869]: pam_unix(sudo:session): session closed for user root Aug 29 01:18:54 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-2413f79c-d917-4dc7-ac8e-452dd794cf65 tempest-VolumesSnapshotTestJSON-1982727637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-327ef5fd-ae4b-49ed-87b2-dd21061059c3" returned: 0 in 0.284s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:18:54 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-2413f79c-d917-4dc7-ac8e-452dd794cf65 tempest-VolumesSnapshotTestJSON-1982727637 None] Lock "cinder-quobyte-327ef5fd-ae4b-49ed-87b2-dd21061059c3" released by "delete_volume" :: held 0.767s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:18:54 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-2413f79c-d917-4dc7-ac8e-452dd794cf65 tempest-VolumesSnapshotTestJSON-1982727637 None] Created reservations ['eaaaf124-d809-476c-84b4-74d58326320a', 'de50c0c7-21ab-42eb-b906-76bea76ae841', 'b5f4a6dd-47b5-42ad-9805-faa1c19e1560', '8dc43596-59c6-4b8c-8fe9-7e9a52f6c0d0'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:18:54 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-2413f79c-d917-4dc7-ac8e-452dd794cf65 tempest-VolumesSnapshotTestJSON-1982727637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:18:54 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-2413f79c-d917-4dc7-ac8e-452dd794cf65 tempest-VolumesSnapshotTestJSON-1982727637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:18:54 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-2413f79c-d917-4dc7-ac8e-452dd794cf65 tempest-VolumesSnapshotTestJSON-1982727637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:18:54 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-2413f79c-d917-4dc7-ac8e-452dd794cf65 tempest-VolumesSnapshotTestJSON-1982727637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:18:54 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-2413f79c-d917-4dc7-ac8e-452dd794cf65 tempest-VolumesSnapshotTestJSON-1982727637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:18:54 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-2413f79c-d917-4dc7-ac8e-452dd794cf65 tempest-VolumesSnapshotTestJSON-1982727637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:18:54 devstack sudo[96872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:18:54 devstack sudo[96872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:18:55 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-aed845f3-2558-498c-8678-39f73195392a tempest-VolumesSnapshotTestJSON-1982727637 None] Acquiring lock "cinder-7bc30b31-17b5-4d77-8f4c-69bc2877c5e2-delete_snapshot" by "delete_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:18:55 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-aed845f3-2558-498c-8678-39f73195392a tempest-VolumesSnapshotTestJSON-1982727637 None] Lock "cinder-7bc30b31-17b5-4d77-8f4c-69bc2877c5e2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:18:55 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-aed845f3-2558-498c-8678-39f73195392a tempest-VolumesSnapshotTestJSON-1982727637 None] Acquiring lock "cinder-quobyte-de2f4ffc-595d-4be5-a21f-1fc9d16cd708" by "delete_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:18:55 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-aed845f3-2558-498c-8678-39f73195392a tempest-VolumesSnapshotTestJSON-1982727637 None] Lock "cinder-quobyte-de2f4ffc-595d-4be5-a21f-1fc9d16cd708" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:18:55 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-aed845f3-2558-498c-8678-39f73195392a tempest-VolumesSnapshotTestJSON-1982727637 None] Acquiring lock "cinder-quobyte-7bc30b31-17b5-4d77-8f4c-69bc2877c5e2" by "_delete_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:18:55 devstack sudo[96872]: pam_unix(sudo:session): session closed for user root Aug 29 01:18:55 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-2413f79c-d917-4dc7-ac8e-452dd794cf65 tempest-VolumesSnapshotTestJSON-1982727637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.397s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:18:55 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-2413f79c-d917-4dc7-ac8e-452dd794cf65 tempest-VolumesSnapshotTestJSON-1982727637 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:18:55 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-aed845f3-2558-498c-8678-39f73195392a tempest-VolumesSnapshotTestJSON-1982727637 None] Lock "cinder-quobyte-7bc30b31-17b5-4d77-8f4c-69bc2877c5e2" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:18:55 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-aed845f3-2558-498c-8678-39f73195392a tempest-VolumesSnapshotTestJSON-1982727637 None] Deleting offline snapshot 7bc30b31-17b5-4d77-8f4c-69bc2877c5e2 of volume de2f4ffc-595d-4be5-a21f-1fc9d16cd708 {{(pid=86111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 29 01:18:55 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-aed845f3-2558-498c-8678-39f73195392a tempest-VolumesSnapshotTestJSON-1982727637 None] snapshot_file for this snap is: volume-de2f4ffc-595d-4be5-a21f-1fc9d16cd708.7bc30b31-17b5-4d77-8f4c-69bc2877c5e2 {{(pid=86111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 29 01:18:55 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-2413f79c-d917-4dc7-ac8e-452dd794cf65 tempest-VolumesSnapshotTestJSON-1982727637 None] Deleted volume successfully. Aug 29 01:18:55 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3c4de35-5e78-48a5-9800-5f19183e14c2]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:18:55 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-aed845f3-2558-498c-8678-39f73195392a tempest-VolumesSnapshotTestJSON-1982727637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-de2f4ffc-595d-4be5-a21f-1fc9d16cd708.7bc30b31-17b5-4d77-8f4c-69bc2877c5e2 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:18:55 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-2413f79c-d917-4dc7-ac8e-452dd794cf65 tempest-VolumesSnapshotTestJSON-1982727637 None] Lock "cinder-327ef5fd-ae4b-49ed-87b2-dd21061059c3-delete_volume" released by "delete_volume" :: held 1.485s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:18:55 devstack sudo[96876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-de2f4ffc-595d-4be5-a21f-1fc9d16cd708.7bc30b31-17b5-4d77-8f4c-69bc2877c5e2 Aug 29 01:18:55 devstack sudo[96876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:18:55 devstack sudo[96876]: pam_unix(sudo:session): session closed for user root Aug 29 01:18:55 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-aed845f3-2558-498c-8678-39f73195392a tempest-VolumesSnapshotTestJSON-1982727637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-de2f4ffc-595d-4be5-a21f-1fc9d16cd708.7bc30b31-17b5-4d77-8f4c-69bc2877c5e2" returned: 0 in 0.441s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:18:55 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-aed845f3-2558-498c-8678-39f73195392a tempest-VolumesSnapshotTestJSON-1982727637 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-de2f4ffc-595d-4be5-a21f-1fc9d16cd708(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 29 01:18:55 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0c3b733-5598-4f02-9c53-a856104f3873]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:18:55 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-aed845f3-2558-498c-8678-39f73195392a tempest-VolumesSnapshotTestJSON-1982727637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-de2f4ffc-595d-4be5-a21f-1fc9d16cd708 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:18:56 devstack sudo[96882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-de2f4ffc-595d-4be5-a21f-1fc9d16cd708 Aug 29 01:18:56 devstack sudo[96882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:18:56 devstack sudo[96882]: pam_unix(sudo:session): session closed for user root Aug 29 01:18:56 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-aed845f3-2558-498c-8678-39f73195392a tempest-VolumesSnapshotTestJSON-1982727637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-de2f4ffc-595d-4be5-a21f-1fc9d16cd708" returned: 0 in 1.000s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:18:56 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-aed845f3-2558-498c-8678-39f73195392a tempest-VolumesSnapshotTestJSON-1982727637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-de2f4ffc-595d-4be5-a21f-1fc9d16cd708.7bc30b31-17b5-4d77-8f4c-69bc2877c5e2 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:18:56 devstack sudo[96947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-de2f4ffc-595d-4be5-a21f-1fc9d16cd708.7bc30b31-17b5-4d77-8f4c-69bc2877c5e2 Aug 29 01:18:56 devstack sudo[96947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:18:57 devstack sudo[96947]: pam_unix(sudo:session): session closed for user root Aug 29 01:18:57 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-aed845f3-2558-498c-8678-39f73195392a tempest-VolumesSnapshotTestJSON-1982727637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-de2f4ffc-595d-4be5-a21f-1fc9d16cd708.7bc30b31-17b5-4d77-8f4c-69bc2877c5e2" returned: 0 in 0.584s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:18:57 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-aed845f3-2558-498c-8678-39f73195392a tempest-VolumesSnapshotTestJSON-1982727637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-de2f4ffc-595d-4be5-a21f-1fc9d16cd708.7bc30b31-17b5-4d77-8f4c-69bc2877c5e2 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:18:57 devstack sudo[96959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-de2f4ffc-595d-4be5-a21f-1fc9d16cd708.7bc30b31-17b5-4d77-8f4c-69bc2877c5e2 Aug 29 01:18:57 devstack sudo[96959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:18:57 devstack sudo[96959]: pam_unix(sudo:session): session closed for user root Aug 29 01:18:57 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-aed845f3-2558-498c-8678-39f73195392a tempest-VolumesSnapshotTestJSON-1982727637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-de2f4ffc-595d-4be5-a21f-1fc9d16cd708.7bc30b31-17b5-4d77-8f4c-69bc2877c5e2" returned: 0 in 0.385s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:18:57 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-aed845f3-2558-498c-8678-39f73195392a tempest-VolumesSnapshotTestJSON-1982727637 None] Lock "cinder-quobyte-7bc30b31-17b5-4d77-8f4c-69bc2877c5e2" released by "_delete_snapshot" :: held 2.612s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:18:57 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-aed845f3-2558-498c-8678-39f73195392a tempest-VolumesSnapshotTestJSON-1982727637 None] Lock "cinder-quobyte-de2f4ffc-595d-4be5-a21f-1fc9d16cd708" released by "delete_snapshot" :: held 2.646s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:18:58 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-aed845f3-2558-498c-8678-39f73195392a tempest-VolumesSnapshotTestJSON-1982727637 None] Created reservations ['9676c463-5132-42e4-a233-9374a9791edb', '91626e88-4784-4fb3-a22d-c98ffb4a4e42', '43a49193-6fd8-4e29-b667-49f4301a9414', '880497ea-f0cc-49b9-b7a2-82ce61f8ebea'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:18:58 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-aed845f3-2558-498c-8678-39f73195392a tempest-VolumesSnapshotTestJSON-1982727637 None] Delete snapshot completed successfully. Aug 29 01:18:58 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-aed845f3-2558-498c-8678-39f73195392a tempest-VolumesSnapshotTestJSON-1982727637 None] Lock "cinder-7bc30b31-17b5-4d77-8f4c-69bc2877c5e2-delete_snapshot" released by "delete_snapshot" :: held 2.851s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:18:58 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-b58245a8-b69c-4204-9810-cca063e9e562 tempest-VolumesSnapshotTestJSON-1982727637 None] Acquiring lock "cinder-de2f4ffc-595d-4be5-a21f-1fc9d16cd708-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:18:58 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-b58245a8-b69c-4204-9810-cca063e9e562 tempest-VolumesSnapshotTestJSON-1982727637 None] Lock "cinder-de2f4ffc-595d-4be5-a21f-1fc9d16cd708-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:18:58 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-b58245a8-b69c-4204-9810-cca063e9e562 tempest-VolumesSnapshotTestJSON-1982727637 None] Acquiring lock "cinder-quobyte-de2f4ffc-595d-4be5-a21f-1fc9d16cd708" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:18:58 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-b58245a8-b69c-4204-9810-cca063e9e562 tempest-VolumesSnapshotTestJSON-1982727637 None] Lock "cinder-quobyte-de2f4ffc-595d-4be5-a21f-1fc9d16cd708" acquired by "delete_volume" :: waited 0.019s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:18:58 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4233a88-a8f3-4796-8819-3bb07ceac14b]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:18:58 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-b58245a8-b69c-4204-9810-cca063e9e562 tempest-VolumesSnapshotTestJSON-1982727637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-de2f4ffc-595d-4be5-a21f-1fc9d16cd708 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:18:58 devstack sudo[96964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-de2f4ffc-595d-4be5-a21f-1fc9d16cd708 Aug 29 01:18:58 devstack sudo[96964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:18:59 devstack sudo[96964]: pam_unix(sudo:session): session closed for user root Aug 29 01:18:59 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-b58245a8-b69c-4204-9810-cca063e9e562 tempest-VolumesSnapshotTestJSON-1982727637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-de2f4ffc-595d-4be5-a21f-1fc9d16cd708" returned: 0 in 0.424s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:18:59 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-b58245a8-b69c-4204-9810-cca063e9e562 tempest-VolumesSnapshotTestJSON-1982727637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-de2f4ffc-595d-4be5-a21f-1fc9d16cd708 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:18:59 devstack sudo[96971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-de2f4ffc-595d-4be5-a21f-1fc9d16cd708 Aug 29 01:18:59 devstack sudo[96971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:18:59 devstack sudo[96971]: pam_unix(sudo:session): session closed for user root Aug 29 01:18:59 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-b58245a8-b69c-4204-9810-cca063e9e562 tempest-VolumesSnapshotTestJSON-1982727637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-de2f4ffc-595d-4be5-a21f-1fc9d16cd708" returned: 0 in 0.318s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:18:59 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-b58245a8-b69c-4204-9810-cca063e9e562 tempest-VolumesSnapshotTestJSON-1982727637 None] Lock "cinder-quobyte-de2f4ffc-595d-4be5-a21f-1fc9d16cd708" released by "delete_volume" :: held 0.839s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:18:59 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-b58245a8-b69c-4204-9810-cca063e9e562 tempest-VolumesSnapshotTestJSON-1982727637 None] Created reservations ['305119bc-85b7-4518-890a-e66297ae8d21', 'f443a25d-8b32-42bc-8eb7-9029c789810f', '29190ae0-7ed9-4d1d-9148-3596e661dd1d', 'd12879fb-157b-424a-bccf-7af81555f794'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:18:59 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-b58245a8-b69c-4204-9810-cca063e9e562 tempest-VolumesSnapshotTestJSON-1982727637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:18:59 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-b58245a8-b69c-4204-9810-cca063e9e562 tempest-VolumesSnapshotTestJSON-1982727637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:18:59 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-b58245a8-b69c-4204-9810-cca063e9e562 tempest-VolumesSnapshotTestJSON-1982727637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:18:59 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-b58245a8-b69c-4204-9810-cca063e9e562 tempest-VolumesSnapshotTestJSON-1982727637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:18:59 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-b58245a8-b69c-4204-9810-cca063e9e562 tempest-VolumesSnapshotTestJSON-1982727637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:18:59 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-b58245a8-b69c-4204-9810-cca063e9e562 tempest-VolumesSnapshotTestJSON-1982727637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:18:59 devstack sudo[96974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:18:59 devstack sudo[96974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:19:00 devstack sudo[96974]: pam_unix(sudo:session): session closed for user root Aug 29 01:19:00 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-b58245a8-b69c-4204-9810-cca063e9e562 tempest-VolumesSnapshotTestJSON-1982727637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.415s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:19:00 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-b58245a8-b69c-4204-9810-cca063e9e562 tempest-VolumesSnapshotTestJSON-1982727637 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:19:00 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-b58245a8-b69c-4204-9810-cca063e9e562 tempest-VolumesSnapshotTestJSON-1982727637 None] Deleted volume successfully. Aug 29 01:19:00 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-b58245a8-b69c-4204-9810-cca063e9e562 tempest-VolumesSnapshotTestJSON-1982727637 None] Lock "cinder-de2f4ffc-595d-4be5-a21f-1fc9d16cd708-delete_volume" released by "delete_volume" :: held 1.559s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:19:00 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-19be6052-66aa-4db3-8ecc-a523ca8992a5 tempest-VolumesSnapshotTestJSON-1982727637 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:19:00 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-19be6052-66aa-4db3-8ecc-a523ca8992a5 tempest-VolumesSnapshotTestJSON-1982727637 None] Flow 'volume_create_manager' (20dbf1cb-5a02-4e50-86fd-d7355ded094f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:19:00 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-19be6052-66aa-4db3-8ecc-a523ca8992a5 tempest-VolumesSnapshotTestJSON-1982727637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c0a74aa-5e49-4951-8871-84ce44e60476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:19:00 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-19be6052-66aa-4db3-8ecc-a523ca8992a5 tempest-VolumesSnapshotTestJSON-1982727637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c0a74aa-5e49-4951-8871-84ce44e60476) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:19:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1572142963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1262013-7469-41ff-a175-57fb479f7b2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7bf2d2db8a14115afd9c2ec5d80764e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:19:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:19:01Z,use_quota=True,user_id='0a960c2d40c44669aace6e57fa7accb7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:19:00 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-19be6052-66aa-4db3-8ecc-a523ca8992a5 tempest-VolumesSnapshotTestJSON-1982727637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e756b0c-5780-4725-8cee-a40d542ed5a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:19:00 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-19be6052-66aa-4db3-8ecc-a523ca8992a5 tempest-VolumesSnapshotTestJSON-1982727637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e756b0c-5780-4725-8cee-a40d542ed5a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:19:00 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-19be6052-66aa-4db3-8ecc-a523ca8992a5 tempest-VolumesSnapshotTestJSON-1982727637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b87ef64f-53ec-40a6-97a0-f0bf3ed4acf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:19:00 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-19be6052-66aa-4db3-8ecc-a523ca8992a5 tempest-VolumesSnapshotTestJSON-1982727637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b87ef64f-53ec-40a6-97a0-f0bf3ed4acf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1262013-7469-41ff-a175-57fb479f7b2e', 'volume_name': 'volume-e1262013-7469-41ff-a175-57fb479f7b2e', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:19:00 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-19be6052-66aa-4db3-8ecc-a523ca8992a5 tempest-VolumesSnapshotTestJSON-1982727637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20fd9e12-7e3b-42e0-bdee-14b65dbee8f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:19:00 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-19be6052-66aa-4db3-8ecc-a523ca8992a5 tempest-VolumesSnapshotTestJSON-1982727637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20fd9e12-7e3b-42e0-bdee-14b65dbee8f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:19:00 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-19be6052-66aa-4db3-8ecc-a523ca8992a5 tempest-VolumesSnapshotTestJSON-1982727637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72e19fc6-86e6-4079-812e-61fc270d3f8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:19:00 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-19be6052-66aa-4db3-8ecc-a523ca8992a5 tempest-VolumesSnapshotTestJSON-1982727637 None] Volume e1262013-7469-41ff-a175-57fb479f7b2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1262013-7469-41ff-a175-57fb479f7b2e', 'volume_size': 1} Aug 29 01:19:00 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-19be6052-66aa-4db3-8ecc-a523ca8992a5 tempest-VolumesSnapshotTestJSON-1982727637 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:19:00 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-19be6052-66aa-4db3-8ecc-a523ca8992a5 tempest-VolumesSnapshotTestJSON-1982727637 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:19:00 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-19be6052-66aa-4db3-8ecc-a523ca8992a5 tempest-VolumesSnapshotTestJSON-1982727637 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:19:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1572142963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1262013-7469-41ff-a175-57fb479f7b2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7bf2d2db8a14115afd9c2ec5d80764e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:19:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:19:01Z,use_quota=True,user_id='0a960c2d40c44669aace6e57fa7accb7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:19:00 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-19be6052-66aa-4db3-8ecc-a523ca8992a5 tempest-VolumesSnapshotTestJSON-1982727637 None] Creating volume e1262013-7469-41ff-a175-57fb479f7b2e {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:19:00 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-19be6052-66aa-4db3-8ecc-a523ca8992a5 tempest-VolumesSnapshotTestJSON-1982727637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:19:00 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-19be6052-66aa-4db3-8ecc-a523ca8992a5 tempest-VolumesSnapshotTestJSON-1982727637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:19:00 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-19be6052-66aa-4db3-8ecc-a523ca8992a5 tempest-VolumesSnapshotTestJSON-1982727637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:19:00 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-19be6052-66aa-4db3-8ecc-a523ca8992a5 tempest-VolumesSnapshotTestJSON-1982727637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:19:00 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-19be6052-66aa-4db3-8ecc-a523ca8992a5 tempest-VolumesSnapshotTestJSON-1982727637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:19:00 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-19be6052-66aa-4db3-8ecc-a523ca8992a5 tempest-VolumesSnapshotTestJSON-1982727637 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:19:00 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-19be6052-66aa-4db3-8ecc-a523ca8992a5 tempest-VolumesSnapshotTestJSON-1982727637 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:19:00 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-19be6052-66aa-4db3-8ecc-a523ca8992a5 tempest-VolumesSnapshotTestJSON-1982727637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-e1262013-7469-41ff-a175-57fb479f7b2e 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:19:00 devstack sudo[96977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-e1262013-7469-41ff-a175-57fb479f7b2e 1073741824 Aug 29 01:19:00 devstack sudo[96977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:19:01 devstack sudo[96977]: pam_unix(sudo:session): session closed for user root Aug 29 01:19:01 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-19be6052-66aa-4db3-8ecc-a523ca8992a5 tempest-VolumesSnapshotTestJSON-1982727637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-e1262013-7469-41ff-a175-57fb479f7b2e 1073741824" returned: 0 in 0.803s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:19:01 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-19be6052-66aa-4db3-8ecc-a523ca8992a5 tempest-VolumesSnapshotTestJSON-1982727637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-e1262013-7469-41ff-a175-57fb479f7b2e {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:19:01 devstack sudo[96983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-e1262013-7469-41ff-a175-57fb479f7b2e Aug 29 01:19:01 devstack sudo[96983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:19:02 devstack sudo[96983]: pam_unix(sudo:session): session closed for user root Aug 29 01:19:02 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-19be6052-66aa-4db3-8ecc-a523ca8992a5 tempest-VolumesSnapshotTestJSON-1982727637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-e1262013-7469-41ff-a175-57fb479f7b2e" returned: 0 in 0.369s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:19:02 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-19be6052-66aa-4db3-8ecc-a523ca8992a5 tempest-VolumesSnapshotTestJSON-1982727637 None] <== create_volume: return (1239ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:19:02 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-19be6052-66aa-4db3-8ecc-a523ca8992a5 tempest-VolumesSnapshotTestJSON-1982727637 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.241s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:19:02 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-19be6052-66aa-4db3-8ecc-a523ca8992a5 tempest-VolumesSnapshotTestJSON-1982727637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72e19fc6-86e6-4079-812e-61fc270d3f8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1262013-7469-41ff-a175-57fb479f7b2e', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:19:02 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-19be6052-66aa-4db3-8ecc-a523ca8992a5 tempest-VolumesSnapshotTestJSON-1982727637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af7c3263-0097-46bc-af4c-53ad7685d318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:19:02 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-19be6052-66aa-4db3-8ecc-a523ca8992a5 tempest-VolumesSnapshotTestJSON-1982727637 None] Volume volume-e1262013-7469-41ff-a175-57fb479f7b2e (e1262013-7469-41ff-a175-57fb479f7b2e): created successfully Aug 29 01:19:02 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-19be6052-66aa-4db3-8ecc-a523ca8992a5 tempest-VolumesSnapshotTestJSON-1982727637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af7c3263-0097-46bc-af4c-53ad7685d318) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:19:02 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-19be6052-66aa-4db3-8ecc-a523ca8992a5 tempest-VolumesSnapshotTestJSON-1982727637 None] Flow 'volume_create_manager' (20dbf1cb-5a02-4e50-86fd-d7355ded094f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:19:02 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-19be6052-66aa-4db3-8ecc-a523ca8992a5 tempest-VolumesSnapshotTestJSON-1982727637 None] Created volume successfully. Aug 29 01:19:03 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-978767fc-53ce-4f86-a0fc-4eda1051474d tempest-VolumesSnapshotTestJSON-1982727637 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:19:03 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-978767fc-53ce-4f86-a0fc-4eda1051474d tempest-VolumesSnapshotTestJSON-1982727637 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:19:03 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c458fbf-9ded-4e0f-b0c7-33316fbdcf47 tempest-VolumeTypesAccessTest-1549938841 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:19:03 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-8c458fbf-9ded-4e0f-b0c7-33316fbdcf47 tempest-VolumeTypesAccessTest-1549938841 None] Flow 'volume_create_manager' (dc47d147-c5a1-48a9-8848-3508ac3fe486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:19:03 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-8c458fbf-9ded-4e0f-b0c7-33316fbdcf47 tempest-VolumeTypesAccessTest-1549938841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08109ec1-cffa-43e4-a9ba-06799754ffa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:19:03 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-978767fc-53ce-4f86-a0fc-4eda1051474d tempest-VolumesSnapshotTestJSON-1982727637 None] Creating offline snapshot 7ade0d68-eeb7-4a92-86b9-2391aea45b3b of volume e1262013-7469-41ff-a175-57fb479f7b2e {{(pid=86111) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 29 01:19:03 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-8c458fbf-9ded-4e0f-b0c7-33316fbdcf47 tempest-VolumeTypesAccessTest-1549938841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08109ec1-cffa-43e4-a9ba-06799754ffa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:19:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-455914475',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7dcd390f-0b80-4d46-87ab-65470074468d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76c8c6c4b863425d8ccddfa0bde583be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:19:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:19:03Z,use_quota=True,user_id='a7074439917f40188762eb4fe166bdcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64726d74-0309-4db6-a3ec-37cd9a603f80),volume_type_id=64726d74-0309-4db6-a3ec-37cd9a603f80)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:19:03 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-8c458fbf-9ded-4e0f-b0c7-33316fbdcf47 tempest-VolumeTypesAccessTest-1549938841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8896253a-5a63-4a28-bef8-ef20d71447b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:19:03 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-8c458fbf-9ded-4e0f-b0c7-33316fbdcf47 tempest-VolumeTypesAccessTest-1549938841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8896253a-5a63-4a28-bef8-ef20d71447b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:19:03 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-8c458fbf-9ded-4e0f-b0c7-33316fbdcf47 tempest-VolumeTypesAccessTest-1549938841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57410d02-e5ef-49f4-9e39-a631c54c0548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:19:03 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-8c458fbf-9ded-4e0f-b0c7-33316fbdcf47 tempest-VolumeTypesAccessTest-1549938841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57410d02-e5ef-49f4-9e39-a631c54c0548) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7dcd390f-0b80-4d46-87ab-65470074468d', 'volume_name': 'volume-7dcd390f-0b80-4d46-87ab-65470074468d', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:19:03 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-8c458fbf-9ded-4e0f-b0c7-33316fbdcf47 tempest-VolumeTypesAccessTest-1549938841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8c994e3-dd4e-4f48-90ab-8eb57391f680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:19:03 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-8c458fbf-9ded-4e0f-b0c7-33316fbdcf47 tempest-VolumeTypesAccessTest-1549938841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8c994e3-dd4e-4f48-90ab-8eb57391f680) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:19:03 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-8c458fbf-9ded-4e0f-b0c7-33316fbdcf47 tempest-VolumeTypesAccessTest-1549938841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (267d9c87-01e2-4ee4-b47b-c8536fdfc31c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:19:03 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-8c458fbf-9ded-4e0f-b0c7-33316fbdcf47 tempest-VolumeTypesAccessTest-1549938841 None] Volume 7dcd390f-0b80-4d46-87ab-65470074468d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7dcd390f-0b80-4d46-87ab-65470074468d', 'volume_size': 1} Aug 29 01:19:03 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-8c458fbf-9ded-4e0f-b0c7-33316fbdcf47 tempest-VolumeTypesAccessTest-1549938841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:19:03 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[b76618da-e0a1-46c6-aa01-2b9cc4753e56]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:19:03 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-978767fc-53ce-4f86-a0fc-4eda1051474d tempest-VolumesSnapshotTestJSON-1982727637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-e1262013-7469-41ff-a175-57fb479f7b2e {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:19:03 devstack sudo[96998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-e1262013-7469-41ff-a175-57fb479f7b2e Aug 29 01:19:03 devstack sudo[96998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:19:03 devstack sudo[96998]: pam_unix(sudo:session): session closed for user root Aug 29 01:19:03 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-978767fc-53ce-4f86-a0fc-4eda1051474d tempest-VolumesSnapshotTestJSON-1982727637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-e1262013-7469-41ff-a175-57fb479f7b2e" returned: 0 in 0.390s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:19:03 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-978767fc-53ce-4f86-a0fc-4eda1051474d tempest-VolumesSnapshotTestJSON-1982727637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-e1262013-7469-41ff-a175-57fb479f7b2e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-e1262013-7469-41ff-a175-57fb479f7b2e.7ade0d68-eeb7-4a92-86b9-2391aea45b3b 1G {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:19:03 devstack sudo[97003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-e1262013-7469-41ff-a175-57fb479f7b2e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-e1262013-7469-41ff-a175-57fb479f7b2e.7ade0d68-eeb7-4a92-86b9-2391aea45b3b 1G Aug 29 01:19:03 devstack sudo[97003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:19:04 devstack sudo[97003]: pam_unix(sudo:session): session closed for user root Aug 29 01:19:04 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-978767fc-53ce-4f86-a0fc-4eda1051474d tempest-VolumesSnapshotTestJSON-1982727637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-e1262013-7469-41ff-a175-57fb479f7b2e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-e1262013-7469-41ff-a175-57fb479f7b2e.7ade0d68-eeb7-4a92-86b9-2391aea45b3b 1G" returned: 0 in 0.395s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:19:04 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-978767fc-53ce-4f86-a0fc-4eda1051474d tempest-VolumesSnapshotTestJSON-1982727637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1262013-7469-41ff-a175-57fb479f7b2e -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-e1262013-7469-41ff-a175-57fb479f7b2e.7ade0d68-eeb7-4a92-86b9-2391aea45b3b {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:19:04 devstack sudo[97009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1262013-7469-41ff-a175-57fb479f7b2e -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-e1262013-7469-41ff-a175-57fb479f7b2e.7ade0d68-eeb7-4a92-86b9-2391aea45b3b Aug 29 01:19:04 devstack sudo[97009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:19:04 devstack sudo[97009]: pam_unix(sudo:session): session closed for user root Aug 29 01:19:04 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-978767fc-53ce-4f86-a0fc-4eda1051474d tempest-VolumesSnapshotTestJSON-1982727637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1262013-7469-41ff-a175-57fb479f7b2e -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-e1262013-7469-41ff-a175-57fb479f7b2e.7ade0d68-eeb7-4a92-86b9-2391aea45b3b" returned: 0 in 0.301s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:19:04 devstack cinder-volume[86111]: WARNING cinder.volume.drivers.remotefs [None req-978767fc-53ce-4f86-a0fc-4eda1051474d tempest-VolumesSnapshotTestJSON-1982727637 None] /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-e1262013-7469-41ff-a175-57fb479f7b2e.7ade0d68-eeb7-4a92-86b9-2391aea45b3b is being set with open permissions: ugo+rw Aug 29 01:19:04 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-978767fc-53ce-4f86-a0fc-4eda1051474d tempest-VolumesSnapshotTestJSON-1982727637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-e1262013-7469-41ff-a175-57fb479f7b2e.7ade0d68-eeb7-4a92-86b9-2391aea45b3b {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:19:04 devstack sudo[97014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-e1262013-7469-41ff-a175-57fb479f7b2e.7ade0d68-eeb7-4a92-86b9-2391aea45b3b Aug 29 01:19:04 devstack sudo[97014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:19:04 devstack sudo[97014]: pam_unix(sudo:session): session closed for user root Aug 29 01:19:04 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-978767fc-53ce-4f86-a0fc-4eda1051474d tempest-VolumesSnapshotTestJSON-1982727637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-e1262013-7469-41ff-a175-57fb479f7b2e.7ade0d68-eeb7-4a92-86b9-2391aea45b3b" returned: 0 in 0.236s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:19:04 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-978767fc-53ce-4f86-a0fc-4eda1051474d tempest-VolumesSnapshotTestJSON-1982727637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-e1262013-7469-41ff-a175-57fb479f7b2e.info {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:19:04 devstack sudo[97017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-e1262013-7469-41ff-a175-57fb479f7b2e.info Aug 29 01:19:04 devstack sudo[97017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:19:04 devstack sudo[97017]: pam_unix(sudo:session): session closed for user root Aug 29 01:19:04 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-978767fc-53ce-4f86-a0fc-4eda1051474d tempest-VolumesSnapshotTestJSON-1982727637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-e1262013-7469-41ff-a175-57fb479f7b2e.info" returned: 0 in 0.252s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:19:04 devstack cinder-volume[86111]: WARNING cinder.volume.drivers.remotefs [None req-978767fc-53ce-4f86-a0fc-4eda1051474d tempest-VolumesSnapshotTestJSON-1982727637 None] /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-e1262013-7469-41ff-a175-57fb479f7b2e.info is being set with open permissions: ugo+rw Aug 29 01:19:04 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-978767fc-53ce-4f86-a0fc-4eda1051474d tempest-VolumesSnapshotTestJSON-1982727637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-e1262013-7469-41ff-a175-57fb479f7b2e.info {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:19:04 devstack sudo[97022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-e1262013-7469-41ff-a175-57fb479f7b2e.info Aug 29 01:19:04 devstack sudo[97022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:19:05 devstack sudo[97022]: pam_unix(sudo:session): session closed for user root Aug 29 01:19:05 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-978767fc-53ce-4f86-a0fc-4eda1051474d tempest-VolumesSnapshotTestJSON-1982727637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-e1262013-7469-41ff-a175-57fb479f7b2e.info" returned: 0 in 0.261s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:19:05 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-978767fc-53ce-4f86-a0fc-4eda1051474d tempest-VolumesSnapshotTestJSON-1982727637 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.002s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:19:05 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-8c458fbf-9ded-4e0f-b0c7-33316fbdcf47 tempest-VolumeTypesAccessTest-1549938841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.902s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:19:05 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-8c458fbf-9ded-4e0f-b0c7-33316fbdcf47 tempest-VolumeTypesAccessTest-1549938841 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:19:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-455914475',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7dcd390f-0b80-4d46-87ab-65470074468d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76c8c6c4b863425d8ccddfa0bde583be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:19:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:19:03Z,use_quota=True,user_id='a7074439917f40188762eb4fe166bdcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64726d74-0309-4db6-a3ec-37cd9a603f80),volume_type_id=64726d74-0309-4db6-a3ec-37cd9a603f80)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:19:05 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-8c458fbf-9ded-4e0f-b0c7-33316fbdcf47 tempest-VolumeTypesAccessTest-1549938841 None] Creating volume 7dcd390f-0b80-4d46-87ab-65470074468d {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:19:05 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-8c458fbf-9ded-4e0f-b0c7-33316fbdcf47 tempest-VolumeTypesAccessTest-1549938841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:19:05 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-8c458fbf-9ded-4e0f-b0c7-33316fbdcf47 tempest-VolumeTypesAccessTest-1549938841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:19:05 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-8c458fbf-9ded-4e0f-b0c7-33316fbdcf47 tempest-VolumeTypesAccessTest-1549938841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:19:05 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-8c458fbf-9ded-4e0f-b0c7-33316fbdcf47 tempest-VolumeTypesAccessTest-1549938841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:19:05 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-8c458fbf-9ded-4e0f-b0c7-33316fbdcf47 tempest-VolumeTypesAccessTest-1549938841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:19:05 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-8c458fbf-9ded-4e0f-b0c7-33316fbdcf47 tempest-VolumeTypesAccessTest-1549938841 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:19:05 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-8c458fbf-9ded-4e0f-b0c7-33316fbdcf47 tempest-VolumeTypesAccessTest-1549938841 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:19:05 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8c458fbf-9ded-4e0f-b0c7-33316fbdcf47 tempest-VolumeTypesAccessTest-1549938841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-7dcd390f-0b80-4d46-87ab-65470074468d 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:19:05 devstack sudo[97027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-7dcd390f-0b80-4d46-87ab-65470074468d 1073741824 Aug 29 01:19:05 devstack sudo[97027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:19:05 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-978767fc-53ce-4f86-a0fc-4eda1051474d tempest-VolumesSnapshotTestJSON-1982727637 None] Create snapshot completed successfully Aug 29 01:19:05 devstack sudo[97027]: pam_unix(sudo:session): session closed for user root Aug 29 01:19:05 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8c458fbf-9ded-4e0f-b0c7-33316fbdcf47 tempest-VolumeTypesAccessTest-1549938841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-7dcd390f-0b80-4d46-87ab-65470074468d 1073741824" returned: 0 in 0.560s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:19:05 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8c458fbf-9ded-4e0f-b0c7-33316fbdcf47 tempest-VolumeTypesAccessTest-1549938841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-7dcd390f-0b80-4d46-87ab-65470074468d {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:19:05 devstack sudo[97043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-7dcd390f-0b80-4d46-87ab-65470074468d Aug 29 01:19:05 devstack sudo[97043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:19:05 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [req-6e476e73-166f-4232-be62-61da88a26c89 req-86691e7c-1f88-4827-8efa-5ee1319be4ed tempest-TestInstancesWithCinderVolumes-192732122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:19:06 devstack sudo[97043]: pam_unix(sudo:session): session closed for user root Aug 29 01:19:06 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8c458fbf-9ded-4e0f-b0c7-33316fbdcf47 tempest-VolumeTypesAccessTest-1549938841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-7dcd390f-0b80-4d46-87ab-65470074468d" returned: 0 in 0.268s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:19:06 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-8c458fbf-9ded-4e0f-b0c7-33316fbdcf47 tempest-VolumeTypesAccessTest-1549938841 None] <== create_volume: return (878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:19:06 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-8c458fbf-9ded-4e0f-b0c7-33316fbdcf47 tempest-VolumeTypesAccessTest-1549938841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.882s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:19:06 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [req-6e476e73-166f-4232-be62-61da88a26c89 req-86691e7c-1f88-4827-8efa-5ee1319be4ed tempest-TestInstancesWithCinderVolumes-192732122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.131s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:19:06 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-8c458fbf-9ded-4e0f-b0c7-33316fbdcf47 tempest-VolumeTypesAccessTest-1549938841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (267d9c87-01e2-4ee4-b47b-c8536fdfc31c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7dcd390f-0b80-4d46-87ab-65470074468d', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:19:06 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-8c458fbf-9ded-4e0f-b0c7-33316fbdcf47 tempest-VolumeTypesAccessTest-1549938841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (108439ac-fdcd-453c-92ca-87306c8b0e14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:19:06 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [req-6e476e73-166f-4232-be62-61da88a26c89 req-86691e7c-1f88-4827-8efa-5ee1319be4ed tempest-TestInstancesWithCinderVolumes-192732122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.029s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:19:06 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-8c458fbf-9ded-4e0f-b0c7-33316fbdcf47 tempest-VolumeTypesAccessTest-1549938841 None] Volume volume-7dcd390f-0b80-4d46-87ab-65470074468d (7dcd390f-0b80-4d46-87ab-65470074468d): created successfully Aug 29 01:19:06 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-8c458fbf-9ded-4e0f-b0c7-33316fbdcf47 tempest-VolumeTypesAccessTest-1549938841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (108439ac-fdcd-453c-92ca-87306c8b0e14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:19:06 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-8c458fbf-9ded-4e0f-b0c7-33316fbdcf47 tempest-VolumeTypesAccessTest-1549938841 None] Flow 'volume_create_manager' (dc47d147-c5a1-48a9-8848-3508ac3fe486) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:19:06 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-8c458fbf-9ded-4e0f-b0c7-33316fbdcf47 tempest-VolumeTypesAccessTest-1549938841 None] Created volume successfully. Aug 29 01:19:06 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [req-6e476e73-166f-4232-be62-61da88a26c89 req-86691e7c-1f88-4827-8efa-5ee1319be4ed tempest-TestInstancesWithCinderVolumes-192732122 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630', 'name': 'volume-f2bb1fb0-957d-44ab-9fbb-d8fd0e74f3e3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8bd530cc-e512-47ef-9f90-48c165b45a03', 'enforce_multipath': True} {{(pid=86111) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 29 01:19:06 devstack cinder-volume[86111]: INFO cinder.volume.manager [req-6e476e73-166f-4232-be62-61da88a26c89 req-86691e7c-1f88-4827-8efa-5ee1319be4ed tempest-TestInstancesWithCinderVolumes-192732122 None] attachment_update completed successfully. Aug 29 01:19:06 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-505d008e-2ca8-40f9-9b37-c90c0c0e4cdd tempest-VolumeTypesAccessTest-1549938841 None] Acquiring lock "cinder-7dcd390f-0b80-4d46-87ab-65470074468d-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:19:06 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-505d008e-2ca8-40f9-9b37-c90c0c0e4cdd tempest-VolumeTypesAccessTest-1549938841 None] Lock "cinder-7dcd390f-0b80-4d46-87ab-65470074468d-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:19:06 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-505d008e-2ca8-40f9-9b37-c90c0c0e4cdd tempest-VolumeTypesAccessTest-1549938841 None] Acquiring lock "cinder-quobyte-7dcd390f-0b80-4d46-87ab-65470074468d" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:19:06 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-505d008e-2ca8-40f9-9b37-c90c0c0e4cdd tempest-VolumeTypesAccessTest-1549938841 None] Lock "cinder-quobyte-7dcd390f-0b80-4d46-87ab-65470074468d" acquired by "delete_volume" :: waited 0.037s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:19:06 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[f19ce350-4542-4f1f-9d8c-03838e7121c1]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:19:06 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-505d008e-2ca8-40f9-9b37-c90c0c0e4cdd tempest-VolumeTypesAccessTest-1549938841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-7dcd390f-0b80-4d46-87ab-65470074468d {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:19:06 devstack sudo[97050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-7dcd390f-0b80-4d46-87ab-65470074468d Aug 29 01:19:06 devstack sudo[97050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:19:07 devstack sudo[97050]: pam_unix(sudo:session): session closed for user root Aug 29 01:19:07 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-505d008e-2ca8-40f9-9b37-c90c0c0e4cdd tempest-VolumeTypesAccessTest-1549938841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-7dcd390f-0b80-4d46-87ab-65470074468d" returned: 0 in 0.519s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:19:07 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-505d008e-2ca8-40f9-9b37-c90c0c0e4cdd tempest-VolumeTypesAccessTest-1549938841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-7dcd390f-0b80-4d46-87ab-65470074468d {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:19:07 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f6ba982-3efb-44e0-897e-ed6fb0acac58 tempest-VolumesSnapshotTestJSON-1982727637 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:19:07 devstack sudo[97055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-7dcd390f-0b80-4d46-87ab-65470074468d Aug 29 01:19:07 devstack sudo[97055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:19:07 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-8f6ba982-3efb-44e0-897e-ed6fb0acac58 tempest-VolumesSnapshotTestJSON-1982727637 None] Flow 'volume_create_manager' (60162f48-68c4-46d7-8093-617b410ae028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:19:07 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-8f6ba982-3efb-44e0-897e-ed6fb0acac58 tempest-VolumesSnapshotTestJSON-1982727637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8370d1fd-863f-4232-8e85-b83ac29c8627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:19:07 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-8f6ba982-3efb-44e0-897e-ed6fb0acac58 tempest-VolumesSnapshotTestJSON-1982727637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8370d1fd-863f-4232-8e85-b83ac29c8627) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:19:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1787856675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70fb49f2-9de1-4856-ac8b-4dfae1727d28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7bf2d2db8a14115afd9c2ec5d80764e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:19:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=7ade0d68-eeb7-4a92-86b9-2391aea45b3b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:19:07Z,use_quota=True,user_id='0a960c2d40c44669aace6e57fa7accb7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:19:07 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-8f6ba982-3efb-44e0-897e-ed6fb0acac58 tempest-VolumesSnapshotTestJSON-1982727637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae3205a2-c23b-4e08-bc81-4b33106ba7ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:19:07 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-8f6ba982-3efb-44e0-897e-ed6fb0acac58 tempest-VolumesSnapshotTestJSON-1982727637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae3205a2-c23b-4e08-bc81-4b33106ba7ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:19:07 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-8f6ba982-3efb-44e0-897e-ed6fb0acac58 tempest-VolumesSnapshotTestJSON-1982727637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec657c73-a0c2-4741-a678-a12662a1b863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:19:07 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-8f6ba982-3efb-44e0-897e-ed6fb0acac58 tempest-VolumesSnapshotTestJSON-1982727637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec657c73-a0c2-4741-a678-a12662a1b863) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '70fb49f2-9de1-4856-ac8b-4dfae1727d28', 'volume_name': 'volume-70fb49f2-9de1-4856-ac8b-4dfae1727d28', 'volume_size': 1, 'snapshot_id': '7ade0d68-eeb7-4a92-86b9-2391aea45b3b'}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:19:07 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-8f6ba982-3efb-44e0-897e-ed6fb0acac58 tempest-VolumesSnapshotTestJSON-1982727637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2da1d0a8-6c99-4381-acf7-426eaaf0fbfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:19:07 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-8f6ba982-3efb-44e0-897e-ed6fb0acac58 tempest-VolumesSnapshotTestJSON-1982727637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2da1d0a8-6c99-4381-acf7-426eaaf0fbfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:19:07 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-8f6ba982-3efb-44e0-897e-ed6fb0acac58 tempest-VolumesSnapshotTestJSON-1982727637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18a79f34-70bd-4738-8f34-13ea915e6679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:19:07 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-8f6ba982-3efb-44e0-897e-ed6fb0acac58 tempest-VolumesSnapshotTestJSON-1982727637 None] Volume 70fb49f2-9de1-4856-ac8b-4dfae1727d28: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-70fb49f2-9de1-4856-ac8b-4dfae1727d28', 'volume_size': 1, 'snapshot_id': '7ade0d68-eeb7-4a92-86b9-2391aea45b3b'} Aug 29 01:19:07 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-8f6ba982-3efb-44e0-897e-ed6fb0acac58 tempest-VolumesSnapshotTestJSON-1982727637 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:19:07 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-8f6ba982-3efb-44e0-897e-ed6fb0acac58 tempest-VolumesSnapshotTestJSON-1982727637 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:19:07 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-8f6ba982-3efb-44e0-897e-ed6fb0acac58 tempest-VolumesSnapshotTestJSON-1982727637 None] Acquiring lock "cinder-quobyte-7ade0d68-eeb7-4a92-86b9-2391aea45b3b-70fb49f2-9de1-4856-ac8b-4dfae1727d28" by "_create_volume_from_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:19:07 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-8f6ba982-3efb-44e0-897e-ed6fb0acac58 tempest-VolumesSnapshotTestJSON-1982727637 None] Lock "cinder-quobyte-7ade0d68-eeb7-4a92-86b9-2391aea45b3b-70fb49f2-9de1-4856-ac8b-4dfae1727d28" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:19:07 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-8f6ba982-3efb-44e0-897e-ed6fb0acac58 tempest-VolumesSnapshotTestJSON-1982727637 None] Creating volume 70fb49f2-9de1-4856-ac8b-4dfae1727d28 from snapshot 7ade0d68-eeb7-4a92-86b9-2391aea45b3b {{(pid=86111) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Aug 29 01:19:07 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-8f6ba982-3efb-44e0-897e-ed6fb0acac58 tempest-VolumesSnapshotTestJSON-1982727637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:19:07 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-8f6ba982-3efb-44e0-897e-ed6fb0acac58 tempest-VolumesSnapshotTestJSON-1982727637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:19:07 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-8f6ba982-3efb-44e0-897e-ed6fb0acac58 tempest-VolumesSnapshotTestJSON-1982727637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:19:07 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-8f6ba982-3efb-44e0-897e-ed6fb0acac58 tempest-VolumesSnapshotTestJSON-1982727637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:19:07 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-8f6ba982-3efb-44e0-897e-ed6fb0acac58 tempest-VolumesSnapshotTestJSON-1982727637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:19:07 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-8f6ba982-3efb-44e0-897e-ed6fb0acac58 tempest-VolumesSnapshotTestJSON-1982727637 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:19:07 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-8f6ba982-3efb-44e0-897e-ed6fb0acac58 tempest-VolumesSnapshotTestJSON-1982727637 None] Acquiring lock "cinder-quobyte-70fb49f2-9de1-4856-ac8b-4dfae1727d28" by "_copy_volume_from_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:19:07 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-8f6ba982-3efb-44e0-897e-ed6fb0acac58 tempest-VolumesSnapshotTestJSON-1982727637 None] Lock "cinder-quobyte-70fb49f2-9de1-4856-ac8b-4dfae1727d28" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:19:07 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-8f6ba982-3efb-44e0-897e-ed6fb0acac58 tempest-VolumesSnapshotTestJSON-1982727637 None] snapshot: 7ade0d68-eeb7-4a92-86b9-2391aea45b3b, volume: 70fb49f2-9de1-4856-ac8b-4dfae1727d28, {{(pid=86111) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 29 01:19:07 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-8f6ba982-3efb-44e0-897e-ed6fb0acac58 tempest-VolumesSnapshotTestJSON-1982727637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:19:07 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-8f6ba982-3efb-44e0-897e-ed6fb0acac58 tempest-VolumesSnapshotTestJSON-1982727637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:19:07 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-8f6ba982-3efb-44e0-897e-ed6fb0acac58 tempest-VolumesSnapshotTestJSON-1982727637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:19:07 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-8f6ba982-3efb-44e0-897e-ed6fb0acac58 tempest-VolumesSnapshotTestJSON-1982727637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:19:07 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-8f6ba982-3efb-44e0-897e-ed6fb0acac58 tempest-VolumesSnapshotTestJSON-1982727637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:19:07 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[f61175a6-c04a-4f5e-9de5-386a75400f8e]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:19:07 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8f6ba982-3efb-44e0-897e-ed6fb0acac58 tempest-VolumesSnapshotTestJSON-1982727637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-e1262013-7469-41ff-a175-57fb479f7b2e.7ade0d68-eeb7-4a92-86b9-2391aea45b3b {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:19:07 devstack sudo[97055]: pam_unix(sudo:session): session closed for user root Aug 29 01:19:07 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-505d008e-2ca8-40f9-9b37-c90c0c0e4cdd tempest-VolumeTypesAccessTest-1549938841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-7dcd390f-0b80-4d46-87ab-65470074468d" returned: 0 in 0.320s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:19:07 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-505d008e-2ca8-40f9-9b37-c90c0c0e4cdd tempest-VolumeTypesAccessTest-1549938841 None] Lock "cinder-quobyte-7dcd390f-0b80-4d46-87ab-65470074468d" released by "delete_volume" :: held 0.932s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:19:07 devstack cinder-volume[86111]: WARNING cinder.quota [None req-505d008e-2ca8-40f9-9b37-c90c0c0e4cdd tempest-VolumeTypesAccessTest-1549938841 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-241927622 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-241927622, it is now deprecated. Please use the default quota class for default quota. Aug 29 01:19:07 devstack cinder-volume[86111]: WARNING cinder.quota [None req-505d008e-2ca8-40f9-9b37-c90c0c0e4cdd tempest-VolumeTypesAccessTest-1549938841 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-241927622 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-241927622, it is now deprecated. Please use the default quota class for default quota. Aug 29 01:19:07 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-505d008e-2ca8-40f9-9b37-c90c0c0e4cdd tempest-VolumeTypesAccessTest-1549938841 None] Created reservations ['c7c472df-7961-43a3-b613-4d4bfe0fa2e9', '083382e8-a06b-4e67-b427-8e44d37ca637', '511d79dd-eae8-408b-9f61-29ea1a920378', '036ad342-eb9c-4f12-8d30-dee00b6e0fae'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:19:07 devstack sudo[97058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-e1262013-7469-41ff-a175-57fb479f7b2e.7ade0d68-eeb7-4a92-86b9-2391aea45b3b Aug 29 01:19:07 devstack sudo[97058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:19:07 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-505d008e-2ca8-40f9-9b37-c90c0c0e4cdd tempest-VolumeTypesAccessTest-1549938841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:19:07 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-505d008e-2ca8-40f9-9b37-c90c0c0e4cdd tempest-VolumeTypesAccessTest-1549938841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:19:07 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-505d008e-2ca8-40f9-9b37-c90c0c0e4cdd tempest-VolumeTypesAccessTest-1549938841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:19:07 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-505d008e-2ca8-40f9-9b37-c90c0c0e4cdd tempest-VolumeTypesAccessTest-1549938841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:19:07 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-505d008e-2ca8-40f9-9b37-c90c0c0e4cdd tempest-VolumeTypesAccessTest-1549938841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:19:07 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-505d008e-2ca8-40f9-9b37-c90c0c0e4cdd tempest-VolumeTypesAccessTest-1549938841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:19:07 devstack sudo[97060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:19:07 devstack sudo[97060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:19:08 devstack sudo[97058]: pam_unix(sudo:session): session closed for user root Aug 29 01:19:08 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8f6ba982-3efb-44e0-897e-ed6fb0acac58 tempest-VolumesSnapshotTestJSON-1982727637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-e1262013-7469-41ff-a175-57fb479f7b2e.7ade0d68-eeb7-4a92-86b9-2391aea45b3b" returned: 0 in 0.622s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:19:08 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-8f6ba982-3efb-44e0-897e-ed6fb0acac58 tempest-VolumesSnapshotTestJSON-1982727637 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e1262013-7469-41ff-a175-57fb479f7b2e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 29 01:19:08 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac55ebcc-61a6-4673-9f81-ec2748894ff2]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:19:08 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8f6ba982-3efb-44e0-897e-ed6fb0acac58 tempest-VolumesSnapshotTestJSON-1982727637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-e1262013-7469-41ff-a175-57fb479f7b2e {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:19:08 devstack sudo[97060]: pam_unix(sudo:session): session closed for user root Aug 29 01:19:08 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-505d008e-2ca8-40f9-9b37-c90c0c0e4cdd tempest-VolumeTypesAccessTest-1549938841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.479s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:19:08 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-505d008e-2ca8-40f9-9b37-c90c0c0e4cdd tempest-VolumeTypesAccessTest-1549938841 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:19:08 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-505d008e-2ca8-40f9-9b37-c90c0c0e4cdd tempest-VolumeTypesAccessTest-1549938841 None] Deleted volume successfully. Aug 29 01:19:08 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-505d008e-2ca8-40f9-9b37-c90c0c0e4cdd tempest-VolumeTypesAccessTest-1549938841 None] Lock "cinder-7dcd390f-0b80-4d46-87ab-65470074468d-delete_volume" released by "delete_volume" :: held 1.705s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:19:08 devstack sudo[97070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-e1262013-7469-41ff-a175-57fb479f7b2e Aug 29 01:19:08 devstack sudo[97070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:19:08 devstack sudo[97070]: pam_unix(sudo:session): session closed for user root Aug 29 01:19:08 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8f6ba982-3efb-44e0-897e-ed6fb0acac58 tempest-VolumesSnapshotTestJSON-1982727637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-e1262013-7469-41ff-a175-57fb479f7b2e" returned: 0 in 0.504s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:19:08 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-8f6ba982-3efb-44e0-897e-ed6fb0acac58 tempest-VolumesSnapshotTestJSON-1982727637 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-e1262013-7469-41ff-a175-57fb479f7b2e {{(pid=86111) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 29 01:19:08 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-8f6ba982-3efb-44e0-897e-ed6fb0acac58 tempest-VolumesSnapshotTestJSON-1982727637 None] Creating direct copy from snapshot {{(pid=86111) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 29 01:19:08 devstack cinder-volume[86111]: DEBUG cinder.utils [None req-8f6ba982-3efb-44e0-897e-ed6fb0acac58 tempest-VolumesSnapshotTestJSON-1982727637 None] Path /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-70fb49f2-9de1-4856-ac8b-4dfae1727d28 not found in is_blk_device check {{(pid=86111) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 29 01:19:08 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8f6ba982-3efb-44e0-897e-ed6fb0acac58 tempest-VolumesSnapshotTestJSON-1982727637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-e1262013-7469-41ff-a175-57fb479f7b2e /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-70fb49f2-9de1-4856-ac8b-4dfae1727d28 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:19:08 devstack sudo[97080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-e1262013-7469-41ff-a175-57fb479f7b2e /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-70fb49f2-9de1-4856-ac8b-4dfae1727d28 Aug 29 01:19:08 devstack sudo[97080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:19:10 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [req-6251d538-a51b-4d0e-974a-c8e2ba777e3a req-2b00c132-80cf-4260-a5c4-79881a86b437 tempest-TestInstancesWithCinderVolumes-192732122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:19:14 devstack sudo[97080]: pam_unix(sudo:session): session closed for user root Aug 29 01:19:14 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8f6ba982-3efb-44e0-897e-ed6fb0acac58 tempest-VolumesSnapshotTestJSON-1982727637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-e1262013-7469-41ff-a175-57fb479f7b2e /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-70fb49f2-9de1-4856-ac8b-4dfae1727d28" returned: 0 in 5.833s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:19:14 devstack cinder-volume[86111]: DEBUG cinder.image.image_utils [None req-8f6ba982-3efb-44e0-897e-ed6fb0acac58 tempest-VolumesSnapshotTestJSON-1982727637 None] Image conversion details: src /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-e1262013-7469-41ff-a175-57fb479f7b2e, size 1024.00 MB, duration 5.83 sec, destination /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-70fb49f2-9de1-4856-ac8b-4dfae1727d28 {{(pid=86111) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 29 01:19:14 devstack cinder-volume[86111]: INFO cinder.image.image_utils [None req-8f6ba982-3efb-44e0-897e-ed6fb0acac58 tempest-VolumesSnapshotTestJSON-1982727637 None] Converted 1024.00 MB image at 175.51 MB/s Aug 29 01:19:14 devstack cinder-volume[86111]: WARNING cinder.volume.drivers.remotefs [None req-8f6ba982-3efb-44e0-897e-ed6fb0acac58 tempest-VolumesSnapshotTestJSON-1982727637 None] /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-70fb49f2-9de1-4856-ac8b-4dfae1727d28 is being set with open permissions: ugo+rw Aug 29 01:19:14 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8f6ba982-3efb-44e0-897e-ed6fb0acac58 tempest-VolumesSnapshotTestJSON-1982727637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-70fb49f2-9de1-4856-ac8b-4dfae1727d28 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:19:14 devstack sudo[97123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-70fb49f2-9de1-4856-ac8b-4dfae1727d28 Aug 29 01:19:14 devstack sudo[97123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:19:14 devstack sudo[97123]: pam_unix(sudo:session): session closed for user root Aug 29 01:19:14 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8f6ba982-3efb-44e0-897e-ed6fb0acac58 tempest-VolumesSnapshotTestJSON-1982727637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-70fb49f2-9de1-4856-ac8b-4dfae1727d28" returned: 0 in 0.271s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:19:14 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-8f6ba982-3efb-44e0-897e-ed6fb0acac58 tempest-VolumesSnapshotTestJSON-1982727637 None] Lock "cinder-quobyte-70fb49f2-9de1-4856-ac8b-4dfae1727d28" released by "_copy_volume_from_snapshot" :: held 7.319s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:19:14 devstack cinder-volume[86111]: DEBUG dbcounter [-] [86111] Writing DB stats cinder:SELECT=97,cinder:UPDATE=96,cinder:DELETE=11,cinder:INSERT=34 {{(pid=86111) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 29 01:19:14 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-8f6ba982-3efb-44e0-897e-ed6fb0acac58 tempest-VolumesSnapshotTestJSON-1982727637 None] Lock "cinder-quobyte-7ade0d68-eeb7-4a92-86b9-2391aea45b3b-70fb49f2-9de1-4856-ac8b-4dfae1727d28" released by "_create_volume_from_snapshot" :: held 7.393s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:19:14 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-8f6ba982-3efb-44e0-897e-ed6fb0acac58 tempest-VolumesSnapshotTestJSON-1982727637 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.412s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:19:14 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [req-6251d538-a51b-4d0e-974a-c8e2ba777e3a req-2b00c132-80cf-4260-a5c4-79881a86b437 tempest-TestInstancesWithCinderVolumes-192732122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.921s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:19:14 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [req-6251d538-a51b-4d0e-974a-c8e2ba777e3a req-2b00c132-80cf-4260-a5c4-79881a86b437 tempest-TestInstancesWithCinderVolumes-192732122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:19:14 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-8f6ba982-3efb-44e0-897e-ed6fb0acac58 tempest-VolumesSnapshotTestJSON-1982727637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18a79f34-70bd-4738-8f34-13ea915e6679) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70fb49f2-9de1-4856-ac8b-4dfae1727d28', 'volume_size': 1, 'snapshot_id': '7ade0d68-eeb7-4a92-86b9-2391aea45b3b'}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:19:14 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-8f6ba982-3efb-44e0-897e-ed6fb0acac58 tempest-VolumesSnapshotTestJSON-1982727637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cae1d1d-4e82-4b3e-9df3-f8b0bc04ef91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:19:14 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-8f6ba982-3efb-44e0-897e-ed6fb0acac58 tempest-VolumesSnapshotTestJSON-1982727637 None] Volume volume-70fb49f2-9de1-4856-ac8b-4dfae1727d28 (70fb49f2-9de1-4856-ac8b-4dfae1727d28): created successfully Aug 29 01:19:14 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-8f6ba982-3efb-44e0-897e-ed6fb0acac58 tempest-VolumesSnapshotTestJSON-1982727637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cae1d1d-4e82-4b3e-9df3-f8b0bc04ef91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:19:14 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-8f6ba982-3efb-44e0-897e-ed6fb0acac58 tempest-VolumesSnapshotTestJSON-1982727637 None] Flow 'volume_create_manager' (60162f48-68c4-46d7-8093-617b410ae028) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:19:14 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [req-6251d538-a51b-4d0e-974a-c8e2ba777e3a req-2b00c132-80cf-4260-a5c4-79881a86b437 tempest-TestInstancesWithCinderVolumes-192732122 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630', 'name': 'volume-343b0092-42e6-406d-bc65-7b0d0b6d0f05', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '871bb31e-259d-45fa-b06a-7eb874b27d65', 'enforce_multipath': True} {{(pid=86111) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 29 01:19:14 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-8f6ba982-3efb-44e0-897e-ed6fb0acac58 tempest-VolumesSnapshotTestJSON-1982727637 None] Created volume successfully. Aug 29 01:19:14 devstack cinder-volume[86111]: INFO cinder.volume.manager [req-6251d538-a51b-4d0e-974a-c8e2ba777e3a req-2b00c132-80cf-4260-a5c4-79881a86b437 tempest-TestInstancesWithCinderVolumes-192732122 None] attachment_update completed successfully. Aug 29 01:19:15 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-254dcaf5-6607-4158-945e-190150d86546 tempest-VolumesSnapshotTestJSON-1982727637 None] Acquiring lock "cinder-70fb49f2-9de1-4856-ac8b-4dfae1727d28-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:19:15 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-254dcaf5-6607-4158-945e-190150d86546 tempest-VolumesSnapshotTestJSON-1982727637 None] Lock "cinder-70fb49f2-9de1-4856-ac8b-4dfae1727d28-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:19:15 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-254dcaf5-6607-4158-945e-190150d86546 tempest-VolumesSnapshotTestJSON-1982727637 None] Acquiring lock "cinder-quobyte-70fb49f2-9de1-4856-ac8b-4dfae1727d28" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:19:15 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-254dcaf5-6607-4158-945e-190150d86546 tempest-VolumesSnapshotTestJSON-1982727637 None] Lock "cinder-quobyte-70fb49f2-9de1-4856-ac8b-4dfae1727d28" acquired by "delete_volume" :: waited 0.017s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:19:15 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[288aa8e7-1900-4c88-b191-8b9041f5e009]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:19:15 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-254dcaf5-6607-4158-945e-190150d86546 tempest-VolumesSnapshotTestJSON-1982727637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-70fb49f2-9de1-4856-ac8b-4dfae1727d28 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:19:15 devstack sudo[97128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-70fb49f2-9de1-4856-ac8b-4dfae1727d28 Aug 29 01:19:15 devstack sudo[97128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:19:15 devstack sudo[97128]: pam_unix(sudo:session): session closed for user root Aug 29 01:19:15 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-254dcaf5-6607-4158-945e-190150d86546 tempest-VolumesSnapshotTestJSON-1982727637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-70fb49f2-9de1-4856-ac8b-4dfae1727d28" returned: 0 in 0.391s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:19:15 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-254dcaf5-6607-4158-945e-190150d86546 tempest-VolumesSnapshotTestJSON-1982727637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-70fb49f2-9de1-4856-ac8b-4dfae1727d28 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:19:15 devstack sudo[97134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-70fb49f2-9de1-4856-ac8b-4dfae1727d28 Aug 29 01:19:15 devstack sudo[97134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:19:16 devstack sudo[97134]: pam_unix(sudo:session): session closed for user root Aug 29 01:19:16 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-254dcaf5-6607-4158-945e-190150d86546 tempest-VolumesSnapshotTestJSON-1982727637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-70fb49f2-9de1-4856-ac8b-4dfae1727d28" returned: 0 in 0.288s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:19:16 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-254dcaf5-6607-4158-945e-190150d86546 tempest-VolumesSnapshotTestJSON-1982727637 None] Lock "cinder-quobyte-70fb49f2-9de1-4856-ac8b-4dfae1727d28" released by "delete_volume" :: held 0.742s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:19:16 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-254dcaf5-6607-4158-945e-190150d86546 tempest-VolumesSnapshotTestJSON-1982727637 None] Created reservations ['f81072b9-d215-475a-a3a5-abf241c37efe', 'e8759bfb-279c-4eb6-9949-d85e9c8ee790', 'adc2d08a-474d-4145-8cb0-a421804f567d', '44fdc265-18c9-4cfd-a233-27740e533c0b'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:19:16 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-254dcaf5-6607-4158-945e-190150d86546 tempest-VolumesSnapshotTestJSON-1982727637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:19:16 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-254dcaf5-6607-4158-945e-190150d86546 tempest-VolumesSnapshotTestJSON-1982727637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:19:16 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-254dcaf5-6607-4158-945e-190150d86546 tempest-VolumesSnapshotTestJSON-1982727637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:19:16 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-254dcaf5-6607-4158-945e-190150d86546 tempest-VolumesSnapshotTestJSON-1982727637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:19:16 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-254dcaf5-6607-4158-945e-190150d86546 tempest-VolumesSnapshotTestJSON-1982727637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:19:16 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-254dcaf5-6607-4158-945e-190150d86546 tempest-VolumesSnapshotTestJSON-1982727637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:19:16 devstack sudo[97145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:19:16 devstack sudo[97145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:19:16 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-fa0bd43d-301c-4dc6-ba8c-48b8d7277e92 tempest-VolumesSnapshotTestJSON-1982727637 None] Acquiring lock "cinder-7ade0d68-eeb7-4a92-86b9-2391aea45b3b-delete_snapshot" by "delete_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:19:16 devstack sudo[97145]: pam_unix(sudo:session): session closed for user root Aug 29 01:19:16 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-254dcaf5-6607-4158-945e-190150d86546 tempest-VolumesSnapshotTestJSON-1982727637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.288s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:19:16 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-254dcaf5-6607-4158-945e-190150d86546 tempest-VolumesSnapshotTestJSON-1982727637 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:19:16 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-254dcaf5-6607-4158-945e-190150d86546 tempest-VolumesSnapshotTestJSON-1982727637 None] Deleted volume successfully. Aug 29 01:19:16 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-fa0bd43d-301c-4dc6-ba8c-48b8d7277e92 tempest-VolumesSnapshotTestJSON-1982727637 None] Lock "cinder-7ade0d68-eeb7-4a92-86b9-2391aea45b3b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:19:16 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-fa0bd43d-301c-4dc6-ba8c-48b8d7277e92 tempest-VolumesSnapshotTestJSON-1982727637 None] Acquiring lock "cinder-quobyte-e1262013-7469-41ff-a175-57fb479f7b2e" by "delete_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:19:16 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-fa0bd43d-301c-4dc6-ba8c-48b8d7277e92 tempest-VolumesSnapshotTestJSON-1982727637 None] Lock "cinder-quobyte-e1262013-7469-41ff-a175-57fb479f7b2e" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:19:16 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-fa0bd43d-301c-4dc6-ba8c-48b8d7277e92 tempest-VolumesSnapshotTestJSON-1982727637 None] Acquiring lock "cinder-quobyte-7ade0d68-eeb7-4a92-86b9-2391aea45b3b" by "_delete_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:19:16 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-254dcaf5-6607-4158-945e-190150d86546 tempest-VolumesSnapshotTestJSON-1982727637 None] Lock "cinder-70fb49f2-9de1-4856-ac8b-4dfae1727d28-delete_volume" released by "delete_volume" :: held 1.308s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:19:16 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-fa0bd43d-301c-4dc6-ba8c-48b8d7277e92 tempest-VolumesSnapshotTestJSON-1982727637 None] Lock "cinder-quobyte-7ade0d68-eeb7-4a92-86b9-2391aea45b3b" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:19:16 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-fa0bd43d-301c-4dc6-ba8c-48b8d7277e92 tempest-VolumesSnapshotTestJSON-1982727637 None] Deleting offline snapshot 7ade0d68-eeb7-4a92-86b9-2391aea45b3b of volume e1262013-7469-41ff-a175-57fb479f7b2e {{(pid=86111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 29 01:19:16 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-fa0bd43d-301c-4dc6-ba8c-48b8d7277e92 tempest-VolumesSnapshotTestJSON-1982727637 None] snapshot_file for this snap is: volume-e1262013-7469-41ff-a175-57fb479f7b2e.7ade0d68-eeb7-4a92-86b9-2391aea45b3b {{(pid=86111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 29 01:19:16 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[19805959-034c-402f-a43a-4538f6be4622]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:19:16 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-fa0bd43d-301c-4dc6-ba8c-48b8d7277e92 tempest-VolumesSnapshotTestJSON-1982727637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-e1262013-7469-41ff-a175-57fb479f7b2e.7ade0d68-eeb7-4a92-86b9-2391aea45b3b {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:19:16 devstack sudo[97148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-e1262013-7469-41ff-a175-57fb479f7b2e.7ade0d68-eeb7-4a92-86b9-2391aea45b3b Aug 29 01:19:16 devstack sudo[97148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:19:17 devstack sudo[97148]: pam_unix(sudo:session): session closed for user root Aug 29 01:19:17 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-fa0bd43d-301c-4dc6-ba8c-48b8d7277e92 tempest-VolumesSnapshotTestJSON-1982727637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-e1262013-7469-41ff-a175-57fb479f7b2e.7ade0d68-eeb7-4a92-86b9-2391aea45b3b" returned: 0 in 0.411s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:19:17 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-fa0bd43d-301c-4dc6-ba8c-48b8d7277e92 tempest-VolumesSnapshotTestJSON-1982727637 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e1262013-7469-41ff-a175-57fb479f7b2e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 29 01:19:17 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[a150c3ef-dc96-4042-afe2-19241b6ca7df]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:19:17 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-fa0bd43d-301c-4dc6-ba8c-48b8d7277e92 tempest-VolumesSnapshotTestJSON-1982727637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-e1262013-7469-41ff-a175-57fb479f7b2e {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:19:17 devstack sudo[97153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-e1262013-7469-41ff-a175-57fb479f7b2e Aug 29 01:19:17 devstack sudo[97153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:19:17 devstack sudo[97153]: pam_unix(sudo:session): session closed for user root Aug 29 01:19:17 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-fa0bd43d-301c-4dc6-ba8c-48b8d7277e92 tempest-VolumesSnapshotTestJSON-1982727637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-e1262013-7469-41ff-a175-57fb479f7b2e" returned: 0 in 0.681s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:19:17 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-fa0bd43d-301c-4dc6-ba8c-48b8d7277e92 tempest-VolumesSnapshotTestJSON-1982727637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-e1262013-7469-41ff-a175-57fb479f7b2e.7ade0d68-eeb7-4a92-86b9-2391aea45b3b {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:19:17 devstack sudo[97158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-e1262013-7469-41ff-a175-57fb479f7b2e.7ade0d68-eeb7-4a92-86b9-2391aea45b3b Aug 29 01:19:17 devstack sudo[97158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:19:18 devstack sudo[97158]: pam_unix(sudo:session): session closed for user root Aug 29 01:19:18 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-fa0bd43d-301c-4dc6-ba8c-48b8d7277e92 tempest-VolumesSnapshotTestJSON-1982727637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-e1262013-7469-41ff-a175-57fb479f7b2e.7ade0d68-eeb7-4a92-86b9-2391aea45b3b" returned: 0 in 0.497s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:19:18 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-fa0bd43d-301c-4dc6-ba8c-48b8d7277e92 tempest-VolumesSnapshotTestJSON-1982727637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-e1262013-7469-41ff-a175-57fb479f7b2e.7ade0d68-eeb7-4a92-86b9-2391aea45b3b {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:19:18 devstack sudo[97166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-e1262013-7469-41ff-a175-57fb479f7b2e.7ade0d68-eeb7-4a92-86b9-2391aea45b3b Aug 29 01:19:18 devstack sudo[97166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:19:18 devstack sudo[97166]: pam_unix(sudo:session): session closed for user root Aug 29 01:19:18 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-fa0bd43d-301c-4dc6-ba8c-48b8d7277e92 tempest-VolumesSnapshotTestJSON-1982727637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-e1262013-7469-41ff-a175-57fb479f7b2e.7ade0d68-eeb7-4a92-86b9-2391aea45b3b" returned: 0 in 0.351s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:19:18 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-fa0bd43d-301c-4dc6-ba8c-48b8d7277e92 tempest-VolumesSnapshotTestJSON-1982727637 None] Lock "cinder-quobyte-7ade0d68-eeb7-4a92-86b9-2391aea45b3b" released by "_delete_snapshot" :: held 2.106s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:19:18 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-fa0bd43d-301c-4dc6-ba8c-48b8d7277e92 tempest-VolumesSnapshotTestJSON-1982727637 None] Lock "cinder-quobyte-e1262013-7469-41ff-a175-57fb479f7b2e" released by "delete_snapshot" :: held 2.140s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:19:18 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-fa0bd43d-301c-4dc6-ba8c-48b8d7277e92 tempest-VolumesSnapshotTestJSON-1982727637 None] Created reservations ['2c64337a-b1f9-4f33-b884-f2f152ff4319', 'c6910299-3e12-45f5-bcd6-3314603df8df', '07ff488a-e2cb-4dd3-9c14-01def7c382c4', '775a1f0d-5c8c-4ef7-b33f-5a93656f0d15'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:19:18 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-fa0bd43d-301c-4dc6-ba8c-48b8d7277e92 tempest-VolumesSnapshotTestJSON-1982727637 None] Delete snapshot completed successfully. Aug 29 01:19:18 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-fa0bd43d-301c-4dc6-ba8c-48b8d7277e92 tempest-VolumesSnapshotTestJSON-1982727637 None] Lock "cinder-7ade0d68-eeb7-4a92-86b9-2391aea45b3b-delete_snapshot" released by "delete_snapshot" :: held 2.364s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:19:19 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-807f3307-4c6d-4b7e-937e-f4587008070a tempest-VolumesSnapshotTestJSON-1982727637 None] Acquiring lock "cinder-e1262013-7469-41ff-a175-57fb479f7b2e-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:19:19 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-807f3307-4c6d-4b7e-937e-f4587008070a tempest-VolumesSnapshotTestJSON-1982727637 None] Lock "cinder-e1262013-7469-41ff-a175-57fb479f7b2e-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:19:19 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-807f3307-4c6d-4b7e-937e-f4587008070a tempest-VolumesSnapshotTestJSON-1982727637 None] Acquiring lock "cinder-quobyte-e1262013-7469-41ff-a175-57fb479f7b2e" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:19:20 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-807f3307-4c6d-4b7e-937e-f4587008070a tempest-VolumesSnapshotTestJSON-1982727637 None] Lock "cinder-quobyte-e1262013-7469-41ff-a175-57fb479f7b2e" acquired by "delete_volume" :: waited 0.023s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:19:20 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1c35151-145f-4b43-a2a8-7ea791047cad]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:19:20 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-807f3307-4c6d-4b7e-937e-f4587008070a tempest-VolumesSnapshotTestJSON-1982727637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-e1262013-7469-41ff-a175-57fb479f7b2e {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:19:20 devstack sudo[97192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-e1262013-7469-41ff-a175-57fb479f7b2e Aug 29 01:19:20 devstack sudo[97192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:19:20 devstack cinder-volume[86111]: INFO cinder.volume.manager [req-cf5df305-c935-40be-9454-0c35fd1770aa req-0f91d3b3-11f0-4cbd-bc52-5ce1f6082843 tempest-TestInstancesWithCinderVolumes-192732122 None] Terminate volume connection completed successfully. Aug 29 01:19:20 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [req-cf5df305-c935-40be-9454-0c35fd1770aa req-0f91d3b3-11f0-4cbd-bc52-5ce1f6082843 tempest-TestInstancesWithCinderVolumes-192732122 None] Deleting attachment 8bd530cc-e512-47ef-9f90-48c165b45a03. {{(pid=86111) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 29 01:19:20 devstack sudo[97192]: pam_unix(sudo:session): session closed for user root Aug 29 01:19:20 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-807f3307-4c6d-4b7e-937e-f4587008070a tempest-VolumesSnapshotTestJSON-1982727637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-e1262013-7469-41ff-a175-57fb479f7b2e" returned: 0 in 0.474s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:19:20 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-807f3307-4c6d-4b7e-937e-f4587008070a tempest-VolumesSnapshotTestJSON-1982727637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-e1262013-7469-41ff-a175-57fb479f7b2e {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:19:20 devstack sudo[97199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-e1262013-7469-41ff-a175-57fb479f7b2e Aug 29 01:19:20 devstack sudo[97199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:19:20 devstack sudo[97199]: pam_unix(sudo:session): session closed for user root Aug 29 01:19:20 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-807f3307-4c6d-4b7e-937e-f4587008070a tempest-VolumesSnapshotTestJSON-1982727637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-e1262013-7469-41ff-a175-57fb479f7b2e" returned: 0 in 0.263s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:19:20 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-807f3307-4c6d-4b7e-937e-f4587008070a tempest-VolumesSnapshotTestJSON-1982727637 None] Lock "cinder-quobyte-e1262013-7469-41ff-a175-57fb479f7b2e" released by "delete_volume" :: held 0.840s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:19:20 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-807f3307-4c6d-4b7e-937e-f4587008070a tempest-VolumesSnapshotTestJSON-1982727637 None] Created reservations ['8a9c0480-93d0-4a3a-b429-4e70fa719202', 'd4e49fba-0d02-4a22-82df-d263c1eff0d9', '2069a4e9-353b-4462-aae7-c25579b5f872', 'b585f411-d32a-482d-9ebb-1208d7d77e64'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:19:20 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-807f3307-4c6d-4b7e-937e-f4587008070a tempest-VolumesSnapshotTestJSON-1982727637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:19:20 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-807f3307-4c6d-4b7e-937e-f4587008070a tempest-VolumesSnapshotTestJSON-1982727637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:19:20 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-807f3307-4c6d-4b7e-937e-f4587008070a tempest-VolumesSnapshotTestJSON-1982727637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:19:21 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-807f3307-4c6d-4b7e-937e-f4587008070a tempest-VolumesSnapshotTestJSON-1982727637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:19:21 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-807f3307-4c6d-4b7e-937e-f4587008070a tempest-VolumesSnapshotTestJSON-1982727637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:19:21 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-807f3307-4c6d-4b7e-937e-f4587008070a tempest-VolumesSnapshotTestJSON-1982727637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:19:21 devstack sudo[97202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:19:21 devstack sudo[97202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:19:21 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-6ddbcf77-8361-4063-a796-f2f1f8055e31 tempest-TestInstancesWithCinderVolumes-192732122 None] Acquiring lock "cinder-f2bb1fb0-957d-44ab-9fbb-d8fd0e74f3e3-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:19:21 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-6ddbcf77-8361-4063-a796-f2f1f8055e31 tempest-TestInstancesWithCinderVolumes-192732122 None] Lock "cinder-f2bb1fb0-957d-44ab-9fbb-d8fd0e74f3e3-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:19:21 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-6ddbcf77-8361-4063-a796-f2f1f8055e31 tempest-TestInstancesWithCinderVolumes-192732122 None] Acquiring lock "cinder-quobyte-f2bb1fb0-957d-44ab-9fbb-d8fd0e74f3e3" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:19:21 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-6ddbcf77-8361-4063-a796-f2f1f8055e31 tempest-TestInstancesWithCinderVolumes-192732122 None] Lock "cinder-quobyte-f2bb1fb0-957d-44ab-9fbb-d8fd0e74f3e3" acquired by "delete_volume" :: waited 0.039s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:19:21 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7a1b49c-f000-4045-9cd1-7b656a4d72f0]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:19:21 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-6ddbcf77-8361-4063-a796-f2f1f8055e31 tempest-TestInstancesWithCinderVolumes-192732122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-f2bb1fb0-957d-44ab-9fbb-d8fd0e74f3e3 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:19:21 devstack sudo[97210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-f2bb1fb0-957d-44ab-9fbb-d8fd0e74f3e3 Aug 29 01:19:21 devstack sudo[97210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:19:21 devstack sudo[97202]: pam_unix(sudo:session): session closed for user root Aug 29 01:19:21 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-807f3307-4c6d-4b7e-937e-f4587008070a tempest-VolumesSnapshotTestJSON-1982727637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.490s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:19:21 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-807f3307-4c6d-4b7e-937e-f4587008070a tempest-VolumesSnapshotTestJSON-1982727637 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:19:21 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-807f3307-4c6d-4b7e-937e-f4587008070a tempest-VolumesSnapshotTestJSON-1982727637 None] Deleted volume successfully. Aug 29 01:19:21 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-807f3307-4c6d-4b7e-937e-f4587008070a tempest-VolumesSnapshotTestJSON-1982727637 None] Lock "cinder-e1262013-7469-41ff-a175-57fb479f7b2e-delete_volume" released by "delete_volume" :: held 1.664s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:19:21 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-0a125d3c-3e45-4678-91c1-aeb1b2c7542f tempest-VolumesSnapshotTestJSON-1982727637 None] Acquiring lock "cinder-b54f6649-e793-4498-b73a-3ca73ed9261d-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:19:21 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-0a125d3c-3e45-4678-91c1-aeb1b2c7542f tempest-VolumesSnapshotTestJSON-1982727637 None] Lock "cinder-b54f6649-e793-4498-b73a-3ca73ed9261d-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:19:21 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-0a125d3c-3e45-4678-91c1-aeb1b2c7542f tempest-VolumesSnapshotTestJSON-1982727637 None] Acquiring lock "cinder-quobyte-b54f6649-e793-4498-b73a-3ca73ed9261d" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:19:21 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-0a125d3c-3e45-4678-91c1-aeb1b2c7542f tempest-VolumesSnapshotTestJSON-1982727637 None] Lock "cinder-quobyte-b54f6649-e793-4498-b73a-3ca73ed9261d" acquired by "delete_volume" :: waited 0.032s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:19:21 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ead8609-b467-45fa-93fc-839095ddf6b9]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:19:21 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-0a125d3c-3e45-4678-91c1-aeb1b2c7542f tempest-VolumesSnapshotTestJSON-1982727637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-b54f6649-e793-4498-b73a-3ca73ed9261d {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:19:21 devstack sudo[97210]: pam_unix(sudo:session): session closed for user root Aug 29 01:19:21 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-6ddbcf77-8361-4063-a796-f2f1f8055e31 tempest-TestInstancesWithCinderVolumes-192732122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-f2bb1fb0-957d-44ab-9fbb-d8fd0e74f3e3" returned: 0 in 0.601s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:19:21 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-6ddbcf77-8361-4063-a796-f2f1f8055e31 tempest-TestInstancesWithCinderVolumes-192732122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-f2bb1fb0-957d-44ab-9fbb-d8fd0e74f3e3 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:19:21 devstack sudo[97225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-f2bb1fb0-957d-44ab-9fbb-d8fd0e74f3e3 Aug 29 01:19:21 devstack sudo[97225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:19:22 devstack sudo[97224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-b54f6649-e793-4498-b73a-3ca73ed9261d Aug 29 01:19:22 devstack sudo[97224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:19:22 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d3cb9d2-48a4-4861-bb02-4d9870b7561c tempest-AttachVolumeNegativeTest-614873311 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:19:22 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6d3cb9d2-48a4-4861-bb02-4d9870b7561c tempest-AttachVolumeNegativeTest-614873311 None] Flow 'volume_create_manager' (fd479e24-81ec-4dd2-8954-89eed0eb1b72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:19:22 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6d3cb9d2-48a4-4861-bb02-4d9870b7561c tempest-AttachVolumeNegativeTest-614873311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf0c97b3-55d5-46ed-93af-de7c2c5a0c45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:19:22 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6d3cb9d2-48a4-4861-bb02-4d9870b7561c tempest-AttachVolumeNegativeTest-614873311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf0c97b3-55d5-46ed-93af-de7c2c5a0c45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:19:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1273000621',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f385845e-757d-4d26-966c-a21a15ab3cce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='159178f1d77e473eabc4e957f357dddb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:19:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:19:22Z,use_quota=True,user_id='c0630dbe1c18496e8ec320517ae79496',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:19:22 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6d3cb9d2-48a4-4861-bb02-4d9870b7561c tempest-AttachVolumeNegativeTest-614873311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c5b960c-fcb9-4b72-9da1-6d3c070bf9a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:19:22 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6d3cb9d2-48a4-4861-bb02-4d9870b7561c tempest-AttachVolumeNegativeTest-614873311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c5b960c-fcb9-4b72-9da1-6d3c070bf9a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:19:22 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6d3cb9d2-48a4-4861-bb02-4d9870b7561c tempest-AttachVolumeNegativeTest-614873311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (caa9c648-66a8-42fc-9b27-1695b9b1039a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:19:22 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6d3cb9d2-48a4-4861-bb02-4d9870b7561c tempest-AttachVolumeNegativeTest-614873311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (caa9c648-66a8-42fc-9b27-1695b9b1039a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f385845e-757d-4d26-966c-a21a15ab3cce', 'volume_name': 'volume-f385845e-757d-4d26-966c-a21a15ab3cce', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:19:22 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6d3cb9d2-48a4-4861-bb02-4d9870b7561c tempest-AttachVolumeNegativeTest-614873311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a6ee00e-1515-4af6-bcef-1ddf47a75a88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:19:22 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6d3cb9d2-48a4-4861-bb02-4d9870b7561c tempest-AttachVolumeNegativeTest-614873311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a6ee00e-1515-4af6-bcef-1ddf47a75a88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:19:22 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6d3cb9d2-48a4-4861-bb02-4d9870b7561c tempest-AttachVolumeNegativeTest-614873311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77985ee8-2a09-481b-9b75-c4a69a670a1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:19:22 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-6d3cb9d2-48a4-4861-bb02-4d9870b7561c tempest-AttachVolumeNegativeTest-614873311 None] Volume f385845e-757d-4d26-966c-a21a15ab3cce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f385845e-757d-4d26-966c-a21a15ab3cce', 'volume_size': 1} Aug 29 01:19:22 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-6d3cb9d2-48a4-4861-bb02-4d9870b7561c tempest-AttachVolumeNegativeTest-614873311 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:19:22 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-6d3cb9d2-48a4-4861-bb02-4d9870b7561c tempest-AttachVolumeNegativeTest-614873311 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:19:22 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-6d3cb9d2-48a4-4861-bb02-4d9870b7561c tempest-AttachVolumeNegativeTest-614873311 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:19:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1273000621',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f385845e-757d-4d26-966c-a21a15ab3cce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='159178f1d77e473eabc4e957f357dddb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:19:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:19:22Z,use_quota=True,user_id='c0630dbe1c18496e8ec320517ae79496',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:19:22 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-6d3cb9d2-48a4-4861-bb02-4d9870b7561c tempest-AttachVolumeNegativeTest-614873311 None] Creating volume f385845e-757d-4d26-966c-a21a15ab3cce {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:19:22 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-6d3cb9d2-48a4-4861-bb02-4d9870b7561c tempest-AttachVolumeNegativeTest-614873311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:19:22 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-6d3cb9d2-48a4-4861-bb02-4d9870b7561c tempest-AttachVolumeNegativeTest-614873311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:19:22 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-6d3cb9d2-48a4-4861-bb02-4d9870b7561c tempest-AttachVolumeNegativeTest-614873311 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:19:22 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-6d3cb9d2-48a4-4861-bb02-4d9870b7561c tempest-AttachVolumeNegativeTest-614873311 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:19:22 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-6d3cb9d2-48a4-4861-bb02-4d9870b7561c tempest-AttachVolumeNegativeTest-614873311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:19:22 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-6d3cb9d2-48a4-4861-bb02-4d9870b7561c tempest-AttachVolumeNegativeTest-614873311 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:19:22 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-6d3cb9d2-48a4-4861-bb02-4d9870b7561c tempest-AttachVolumeNegativeTest-614873311 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:19:22 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-6d3cb9d2-48a4-4861-bb02-4d9870b7561c tempest-AttachVolumeNegativeTest-614873311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-f385845e-757d-4d26-966c-a21a15ab3cce 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:19:22 devstack sudo[97228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-f385845e-757d-4d26-966c-a21a15ab3cce 1073741824 Aug 29 01:19:22 devstack sudo[97228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:19:22 devstack sudo[97225]: pam_unix(sudo:session): session closed for user root Aug 29 01:19:22 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-6ddbcf77-8361-4063-a796-f2f1f8055e31 tempest-TestInstancesWithCinderVolumes-192732122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-f2bb1fb0-957d-44ab-9fbb-d8fd0e74f3e3" returned: 0 in 0.542s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:19:22 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-6ddbcf77-8361-4063-a796-f2f1f8055e31 tempest-TestInstancesWithCinderVolumes-192732122 None] Lock "cinder-quobyte-f2bb1fb0-957d-44ab-9fbb-d8fd0e74f3e3" released by "delete_volume" :: held 1.218s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:19:22 devstack sudo[97224]: pam_unix(sudo:session): session closed for user root Aug 29 01:19:22 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-0a125d3c-3e45-4678-91c1-aeb1b2c7542f tempest-VolumesSnapshotTestJSON-1982727637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-b54f6649-e793-4498-b73a-3ca73ed9261d" returned: 0 in 0.627s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:19:22 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-0a125d3c-3e45-4678-91c1-aeb1b2c7542f tempest-VolumesSnapshotTestJSON-1982727637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-b54f6649-e793-4498-b73a-3ca73ed9261d {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:19:22 devstack cinder-volume[86111]: WARNING cinder.quota [None req-6ddbcf77-8361-4063-a796-f2f1f8055e31 tempest-TestInstancesWithCinderVolumes-192732122 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-759481477-1255228926 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-759481477-1255228926, it is now deprecated. Please use the default quota class for default quota. Aug 29 01:19:22 devstack cinder-volume[86111]: WARNING cinder.quota [None req-6ddbcf77-8361-4063-a796-f2f1f8055e31 tempest-TestInstancesWithCinderVolumes-192732122 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-759481477-1255228926 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-759481477-1255228926, it is now deprecated. Please use the default quota class for default quota. Aug 29 01:19:22 devstack sudo[97234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-b54f6649-e793-4498-b73a-3ca73ed9261d Aug 29 01:19:22 devstack sudo[97234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:19:22 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-6ddbcf77-8361-4063-a796-f2f1f8055e31 tempest-TestInstancesWithCinderVolumes-192732122 None] Created reservations ['4c284076-22ae-44f3-96b4-2c031cd30004', 'c60735a6-3355-42e8-acb3-e5a7786fc3ed', '149f6ce2-ebf2-41c9-ae75-b2b3d021d5e9', 'e2ac1f30-5ec0-4bd5-a7ac-6b70099ea9d8'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:19:22 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-6ddbcf77-8361-4063-a796-f2f1f8055e31 tempest-TestInstancesWithCinderVolumes-192732122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:19:22 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-6ddbcf77-8361-4063-a796-f2f1f8055e31 tempest-TestInstancesWithCinderVolumes-192732122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:19:22 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-6ddbcf77-8361-4063-a796-f2f1f8055e31 tempest-TestInstancesWithCinderVolumes-192732122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:19:22 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-6ddbcf77-8361-4063-a796-f2f1f8055e31 tempest-TestInstancesWithCinderVolumes-192732122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:19:22 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-6ddbcf77-8361-4063-a796-f2f1f8055e31 tempest-TestInstancesWithCinderVolumes-192732122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:19:22 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-6ddbcf77-8361-4063-a796-f2f1f8055e31 tempest-TestInstancesWithCinderVolumes-192732122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:19:22 devstack sudo[97236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:19:22 devstack sudo[97236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:19:22 devstack sudo[97234]: pam_unix(sudo:session): session closed for user root Aug 29 01:19:22 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-0a125d3c-3e45-4678-91c1-aeb1b2c7542f tempest-VolumesSnapshotTestJSON-1982727637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-b54f6649-e793-4498-b73a-3ca73ed9261d" returned: 0 in 0.432s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:19:22 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-0a125d3c-3e45-4678-91c1-aeb1b2c7542f tempest-VolumesSnapshotTestJSON-1982727637 None] Lock "cinder-quobyte-b54f6649-e793-4498-b73a-3ca73ed9261d" released by "delete_volume" :: held 1.147s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:19:23 devstack sudo[97236]: pam_unix(sudo:session): session closed for user root Aug 29 01:19:23 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-6ddbcf77-8361-4063-a796-f2f1f8055e31 tempest-TestInstancesWithCinderVolumes-192732122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.368s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:19:23 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-6ddbcf77-8361-4063-a796-f2f1f8055e31 tempest-TestInstancesWithCinderVolumes-192732122 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:19:23 devstack sudo[97228]: pam_unix(sudo:session): session closed for user root Aug 29 01:19:23 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-6d3cb9d2-48a4-4861-bb02-4d9870b7561c tempest-AttachVolumeNegativeTest-614873311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-f385845e-757d-4d26-966c-a21a15ab3cce 1073741824" returned: 0 in 0.707s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:19:23 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-6ddbcf77-8361-4063-a796-f2f1f8055e31 tempest-TestInstancesWithCinderVolumes-192732122 None] Deleted volume successfully. Aug 29 01:19:23 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-6ddbcf77-8361-4063-a796-f2f1f8055e31 tempest-TestInstancesWithCinderVolumes-192732122 None] Lock "cinder-f2bb1fb0-957d-44ab-9fbb-d8fd0e74f3e3-delete_volume" released by "delete_volume" :: held 1.978s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:19:23 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-0a125d3c-3e45-4678-91c1-aeb1b2c7542f tempest-VolumesSnapshotTestJSON-1982727637 None] Created reservations ['faba4a85-1d3f-4207-9cce-bd183de21421', 'b6de54cf-0893-4771-8854-fe1f83075586', 'b7b10988-c397-47f1-9deb-c8c6ab3707d4', '873e6531-5b6e-4ab5-9b26-da1363ba5ffb'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:19:23 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-6d3cb9d2-48a4-4861-bb02-4d9870b7561c tempest-AttachVolumeNegativeTest-614873311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-f385845e-757d-4d26-966c-a21a15ab3cce {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:19:23 devstack sudo[97244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-f385845e-757d-4d26-966c-a21a15ab3cce Aug 29 01:19:23 devstack sudo[97244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:19:23 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-0a125d3c-3e45-4678-91c1-aeb1b2c7542f tempest-VolumesSnapshotTestJSON-1982727637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:19:23 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-0a125d3c-3e45-4678-91c1-aeb1b2c7542f tempest-VolumesSnapshotTestJSON-1982727637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:19:23 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-0a125d3c-3e45-4678-91c1-aeb1b2c7542f tempest-VolumesSnapshotTestJSON-1982727637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:19:23 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-0a125d3c-3e45-4678-91c1-aeb1b2c7542f tempest-VolumesSnapshotTestJSON-1982727637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:19:23 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-0a125d3c-3e45-4678-91c1-aeb1b2c7542f tempest-VolumesSnapshotTestJSON-1982727637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:19:23 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-0a125d3c-3e45-4678-91c1-aeb1b2c7542f tempest-VolumesSnapshotTestJSON-1982727637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:19:23 devstack sudo[97246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:19:23 devstack sudo[97246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:19:23 devstack sudo[97244]: pam_unix(sudo:session): session closed for user root Aug 29 01:19:23 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-6d3cb9d2-48a4-4861-bb02-4d9870b7561c tempest-AttachVolumeNegativeTest-614873311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-f385845e-757d-4d26-966c-a21a15ab3cce" returned: 0 in 0.336s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:19:23 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-6d3cb9d2-48a4-4861-bb02-4d9870b7561c tempest-AttachVolumeNegativeTest-614873311 None] <== create_volume: return (1143ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:19:23 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-6d3cb9d2-48a4-4861-bb02-4d9870b7561c tempest-AttachVolumeNegativeTest-614873311 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.146s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:19:23 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6d3cb9d2-48a4-4861-bb02-4d9870b7561c tempest-AttachVolumeNegativeTest-614873311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77985ee8-2a09-481b-9b75-c4a69a670a1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f385845e-757d-4d26-966c-a21a15ab3cce', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:19:23 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6d3cb9d2-48a4-4861-bb02-4d9870b7561c tempest-AttachVolumeNegativeTest-614873311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57b1134d-5f36-4aba-aa80-898d9382218a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:19:23 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-6d3cb9d2-48a4-4861-bb02-4d9870b7561c tempest-AttachVolumeNegativeTest-614873311 None] Volume volume-f385845e-757d-4d26-966c-a21a15ab3cce (f385845e-757d-4d26-966c-a21a15ab3cce): created successfully Aug 29 01:19:23 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6d3cb9d2-48a4-4861-bb02-4d9870b7561c tempest-AttachVolumeNegativeTest-614873311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57b1134d-5f36-4aba-aa80-898d9382218a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:19:23 devstack sudo[97246]: pam_unix(sudo:session): session closed for user root Aug 29 01:19:23 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6d3cb9d2-48a4-4861-bb02-4d9870b7561c tempest-AttachVolumeNegativeTest-614873311 None] Flow 'volume_create_manager' (fd479e24-81ec-4dd2-8954-89eed0eb1b72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:19:23 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-0a125d3c-3e45-4678-91c1-aeb1b2c7542f tempest-VolumesSnapshotTestJSON-1982727637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.325s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:19:23 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-0a125d3c-3e45-4678-91c1-aeb1b2c7542f tempest-VolumesSnapshotTestJSON-1982727637 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:19:23 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-0a125d3c-3e45-4678-91c1-aeb1b2c7542f tempest-VolumesSnapshotTestJSON-1982727637 None] Deleted volume successfully. Aug 29 01:19:23 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-6d3cb9d2-48a4-4861-bb02-4d9870b7561c tempest-AttachVolumeNegativeTest-614873311 None] Created volume successfully. Aug 29 01:19:23 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-0a125d3c-3e45-4678-91c1-aeb1b2c7542f tempest-VolumesSnapshotTestJSON-1982727637 None] Lock "cinder-b54f6649-e793-4498-b73a-3ca73ed9261d-delete_volume" released by "delete_volume" :: held 1.845s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:19:25 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-31714349-d82a-494d-854d-536c0f5a2b8b tempest-SnapshotMetadataTestJSON-1484525885 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:19:25 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-31714349-d82a-494d-854d-536c0f5a2b8b tempest-SnapshotMetadataTestJSON-1484525885 None] Flow 'volume_create_manager' (166df610-e53d-49ca-974e-103a9e4cfbe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:19:25 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-31714349-d82a-494d-854d-536c0f5a2b8b tempest-SnapshotMetadataTestJSON-1484525885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (302eae78-02da-4ced-be28-176f664c7b9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:19:25 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-31714349-d82a-494d-854d-536c0f5a2b8b tempest-SnapshotMetadataTestJSON-1484525885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (302eae78-02da-4ced-be28-176f664c7b9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:19:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1887925883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f729a54-293f-4fa3-b08f-7b287ede2d06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91a1a884a7e340499a037688c0365a8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:19:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:19:25Z,use_quota=True,user_id='de018a251f2442dfbaaef6b913488ec9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:19:25 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-31714349-d82a-494d-854d-536c0f5a2b8b tempest-SnapshotMetadataTestJSON-1484525885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bdff179-2d43-4258-9395-941e908669fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:19:25 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-31714349-d82a-494d-854d-536c0f5a2b8b tempest-SnapshotMetadataTestJSON-1484525885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bdff179-2d43-4258-9395-941e908669fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:19:25 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-31714349-d82a-494d-854d-536c0f5a2b8b tempest-SnapshotMetadataTestJSON-1484525885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d10e3be1-10e8-4f9b-8de2-a1350e43492b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:19:25 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-31714349-d82a-494d-854d-536c0f5a2b8b tempest-SnapshotMetadataTestJSON-1484525885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d10e3be1-10e8-4f9b-8de2-a1350e43492b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f729a54-293f-4fa3-b08f-7b287ede2d06', 'volume_name': 'volume-9f729a54-293f-4fa3-b08f-7b287ede2d06', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:19:25 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-31714349-d82a-494d-854d-536c0f5a2b8b tempest-SnapshotMetadataTestJSON-1484525885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82867eea-8609-41d1-a5a7-1754d82bab91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:19:25 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-31714349-d82a-494d-854d-536c0f5a2b8b tempest-SnapshotMetadataTestJSON-1484525885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82867eea-8609-41d1-a5a7-1754d82bab91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:19:25 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-31714349-d82a-494d-854d-536c0f5a2b8b tempest-SnapshotMetadataTestJSON-1484525885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2dce8f8-b584-46da-9cb4-5e8db94c25cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:19:25 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-31714349-d82a-494d-854d-536c0f5a2b8b tempest-SnapshotMetadataTestJSON-1484525885 None] Volume 9f729a54-293f-4fa3-b08f-7b287ede2d06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f729a54-293f-4fa3-b08f-7b287ede2d06', 'volume_size': 1} Aug 29 01:19:25 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-31714349-d82a-494d-854d-536c0f5a2b8b tempest-SnapshotMetadataTestJSON-1484525885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:19:25 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-31714349-d82a-494d-854d-536c0f5a2b8b tempest-SnapshotMetadataTestJSON-1484525885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:19:25 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-31714349-d82a-494d-854d-536c0f5a2b8b tempest-SnapshotMetadataTestJSON-1484525885 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:19:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1887925883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f729a54-293f-4fa3-b08f-7b287ede2d06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91a1a884a7e340499a037688c0365a8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:19:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:19:25Z,use_quota=True,user_id='de018a251f2442dfbaaef6b913488ec9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:19:25 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-31714349-d82a-494d-854d-536c0f5a2b8b tempest-SnapshotMetadataTestJSON-1484525885 None] Creating volume 9f729a54-293f-4fa3-b08f-7b287ede2d06 {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:19:25 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-31714349-d82a-494d-854d-536c0f5a2b8b tempest-SnapshotMetadataTestJSON-1484525885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:19:25 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-31714349-d82a-494d-854d-536c0f5a2b8b tempest-SnapshotMetadataTestJSON-1484525885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:19:25 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-31714349-d82a-494d-854d-536c0f5a2b8b tempest-SnapshotMetadataTestJSON-1484525885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:19:25 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-31714349-d82a-494d-854d-536c0f5a2b8b tempest-SnapshotMetadataTestJSON-1484525885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:19:25 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-31714349-d82a-494d-854d-536c0f5a2b8b tempest-SnapshotMetadataTestJSON-1484525885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:19:25 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-31714349-d82a-494d-854d-536c0f5a2b8b tempest-SnapshotMetadataTestJSON-1484525885 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:19:25 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-31714349-d82a-494d-854d-536c0f5a2b8b tempest-SnapshotMetadataTestJSON-1484525885 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:19:25 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-31714349-d82a-494d-854d-536c0f5a2b8b tempest-SnapshotMetadataTestJSON-1484525885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-9f729a54-293f-4fa3-b08f-7b287ede2d06 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:19:25 devstack sudo[97275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-9f729a54-293f-4fa3-b08f-7b287ede2d06 1073741824 Aug 29 01:19:25 devstack sudo[97275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:19:25 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [req-33f7bf14-a572-4fb1-8061-2a65b0497e7b req-6f9a2370-1b11-406d-8859-ae3e8e49eeaa tempest-AttachVolumeNegativeTest-614873311 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:19:25 devstack sudo[97275]: pam_unix(sudo:session): session closed for user root Aug 29 01:19:25 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-31714349-d82a-494d-854d-536c0f5a2b8b tempest-SnapshotMetadataTestJSON-1484525885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-9f729a54-293f-4fa3-b08f-7b287ede2d06 1073741824" returned: 0 in 0.531s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:19:25 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-31714349-d82a-494d-854d-536c0f5a2b8b tempest-SnapshotMetadataTestJSON-1484525885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-9f729a54-293f-4fa3-b08f-7b287ede2d06 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:19:25 devstack sudo[97292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-9f729a54-293f-4fa3-b08f-7b287ede2d06 Aug 29 01:19:25 devstack sudo[97292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:19:25 devstack cinder-volume[86111]: INFO cinder.volume.manager [req-f1282f20-af71-49fb-9a42-1104220e0be7 req-036fcb2e-7dab-48ee-b786-11aa2bf0147f tempest-TestInstancesWithCinderVolumes-192732122 None] Terminate volume connection completed successfully. Aug 29 01:19:25 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [req-f1282f20-af71-49fb-9a42-1104220e0be7 req-036fcb2e-7dab-48ee-b786-11aa2bf0147f tempest-TestInstancesWithCinderVolumes-192732122 None] Deleting attachment 871bb31e-259d-45fa-b06a-7eb874b27d65. {{(pid=86111) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 29 01:19:26 devstack sudo[97292]: pam_unix(sudo:session): session closed for user root Aug 29 01:19:26 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-31714349-d82a-494d-854d-536c0f5a2b8b tempest-SnapshotMetadataTestJSON-1484525885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-9f729a54-293f-4fa3-b08f-7b287ede2d06" returned: 0 in 0.305s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:19:26 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-31714349-d82a-494d-854d-536c0f5a2b8b tempest-SnapshotMetadataTestJSON-1484525885 None] <== create_volume: return (878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:19:26 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-31714349-d82a-494d-854d-536c0f5a2b8b tempest-SnapshotMetadataTestJSON-1484525885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.881s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:19:26 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [req-33f7bf14-a572-4fb1-8061-2a65b0497e7b req-6f9a2370-1b11-406d-8859-ae3e8e49eeaa tempest-AttachVolumeNegativeTest-614873311 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.421s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:19:26 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-31714349-d82a-494d-854d-536c0f5a2b8b tempest-SnapshotMetadataTestJSON-1484525885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2dce8f8-b584-46da-9cb4-5e8db94c25cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f729a54-293f-4fa3-b08f-7b287ede2d06', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:19:26 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-31714349-d82a-494d-854d-536c0f5a2b8b tempest-SnapshotMetadataTestJSON-1484525885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92dbcf3a-c40b-4c93-84a5-9cde04741262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:19:26 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [req-33f7bf14-a572-4fb1-8061-2a65b0497e7b req-6f9a2370-1b11-406d-8859-ae3e8e49eeaa tempest-AttachVolumeNegativeTest-614873311 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.031s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:19:26 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-31714349-d82a-494d-854d-536c0f5a2b8b tempest-SnapshotMetadataTestJSON-1484525885 None] Volume volume-9f729a54-293f-4fa3-b08f-7b287ede2d06 (9f729a54-293f-4fa3-b08f-7b287ede2d06): created successfully Aug 29 01:19:26 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-31714349-d82a-494d-854d-536c0f5a2b8b tempest-SnapshotMetadataTestJSON-1484525885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92dbcf3a-c40b-4c93-84a5-9cde04741262) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:19:26 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-31714349-d82a-494d-854d-536c0f5a2b8b tempest-SnapshotMetadataTestJSON-1484525885 None] Flow 'volume_create_manager' (166df610-e53d-49ca-974e-103a9e4cfbe4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:19:26 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-31714349-d82a-494d-854d-536c0f5a2b8b tempest-SnapshotMetadataTestJSON-1484525885 None] Created volume successfully. Aug 29 01:19:26 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [req-33f7bf14-a572-4fb1-8061-2a65b0497e7b req-6f9a2370-1b11-406d-8859-ae3e8e49eeaa tempest-AttachVolumeNegativeTest-614873311 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630', 'name': 'volume-f385845e-757d-4d26-966c-a21a15ab3cce', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e2c74af7-b700-4850-891c-c594c9eedd0a', 'enforce_multipath': True} {{(pid=86111) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 29 01:19:26 devstack cinder-volume[86111]: INFO cinder.volume.manager [req-33f7bf14-a572-4fb1-8061-2a65b0497e7b req-6f9a2370-1b11-406d-8859-ae3e8e49eeaa tempest-AttachVolumeNegativeTest-614873311 None] attachment_update completed successfully. Aug 29 01:19:26 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-32c9f1c9-8112-4b91-9b88-afda547febae tempest-TestInstancesWithCinderVolumes-192732122 None] Acquiring lock "cinder-343b0092-42e6-406d-bc65-7b0d0b6d0f05-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:19:26 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-32c9f1c9-8112-4b91-9b88-afda547febae tempest-TestInstancesWithCinderVolumes-192732122 None] Lock "cinder-343b0092-42e6-406d-bc65-7b0d0b6d0f05-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:19:26 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-32c9f1c9-8112-4b91-9b88-afda547febae tempest-TestInstancesWithCinderVolumes-192732122 None] Acquiring lock "cinder-quobyte-343b0092-42e6-406d-bc65-7b0d0b6d0f05" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:19:26 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-32c9f1c9-8112-4b91-9b88-afda547febae tempest-TestInstancesWithCinderVolumes-192732122 None] Lock "cinder-quobyte-343b0092-42e6-406d-bc65-7b0d0b6d0f05" acquired by "delete_volume" :: waited 0.027s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:19:26 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ea17c53-9e57-4241-a0f5-faef44a019ca]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:19:26 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-32c9f1c9-8112-4b91-9b88-afda547febae tempest-TestInstancesWithCinderVolumes-192732122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-343b0092-42e6-406d-bc65-7b0d0b6d0f05 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:19:26 devstack sudo[97298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-343b0092-42e6-406d-bc65-7b0d0b6d0f05 Aug 29 01:19:26 devstack sudo[97298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:19:27 devstack sudo[97298]: pam_unix(sudo:session): session closed for user root Aug 29 01:19:27 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-32c9f1c9-8112-4b91-9b88-afda547febae tempest-TestInstancesWithCinderVolumes-192732122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-343b0092-42e6-406d-bc65-7b0d0b6d0f05" returned: 0 in 0.487s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:19:27 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-32c9f1c9-8112-4b91-9b88-afda547febae tempest-TestInstancesWithCinderVolumes-192732122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-343b0092-42e6-406d-bc65-7b0d0b6d0f05 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:19:27 devstack sudo[97337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-343b0092-42e6-406d-bc65-7b0d0b6d0f05 Aug 29 01:19:27 devstack sudo[97337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:19:27 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-f28db1e0-1127-484e-b531-a3c0d7490aba tempest-SnapshotMetadataTestJSON-1484525885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:19:27 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-f28db1e0-1127-484e-b531-a3c0d7490aba tempest-SnapshotMetadataTestJSON-1484525885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:19:27 devstack sudo[97337]: pam_unix(sudo:session): session closed for user root Aug 29 01:19:27 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-32c9f1c9-8112-4b91-9b88-afda547febae tempest-TestInstancesWithCinderVolumes-192732122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-343b0092-42e6-406d-bc65-7b0d0b6d0f05" returned: 0 in 0.571s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:19:27 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-f28db1e0-1127-484e-b531-a3c0d7490aba tempest-SnapshotMetadataTestJSON-1484525885 None] Creating offline snapshot aeefaab0-6d5c-4696-8280-d14aefc9081d of volume 9f729a54-293f-4fa3-b08f-7b287ede2d06 {{(pid=86111) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 29 01:19:27 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-32c9f1c9-8112-4b91-9b88-afda547febae tempest-TestInstancesWithCinderVolumes-192732122 None] Lock "cinder-quobyte-343b0092-42e6-406d-bc65-7b0d0b6d0f05" released by "delete_volume" :: held 1.138s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:19:27 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[357cc93b-ca92-4744-a08f-c2eef7ad0f10]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:19:27 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-f28db1e0-1127-484e-b531-a3c0d7490aba tempest-SnapshotMetadataTestJSON-1484525885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-9f729a54-293f-4fa3-b08f-7b287ede2d06 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:19:27 devstack cinder-volume[86111]: WARNING cinder.quota [None req-32c9f1c9-8112-4b91-9b88-afda547febae tempest-TestInstancesWithCinderVolumes-192732122 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1710745134-440957104 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1710745134-440957104, it is now deprecated. Please use the default quota class for default quota. Aug 29 01:19:27 devstack cinder-volume[86111]: WARNING cinder.quota [None req-32c9f1c9-8112-4b91-9b88-afda547febae tempest-TestInstancesWithCinderVolumes-192732122 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1710745134-440957104 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1710745134-440957104, it is now deprecated. Please use the default quota class for default quota. Aug 29 01:19:27 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-32c9f1c9-8112-4b91-9b88-afda547febae tempest-TestInstancesWithCinderVolumes-192732122 None] Created reservations ['31af8de4-c8a5-49fa-a589-ba3e0626c7ba', '3c1f6882-9b25-4258-856e-ec3e4040c9a9', 'a8e911a1-9af6-4fc1-bc86-f16e41f63a86', 'a080d6c4-5fd0-4f40-98dd-470008372af5'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:19:27 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-32c9f1c9-8112-4b91-9b88-afda547febae tempest-TestInstancesWithCinderVolumes-192732122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:19:27 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-32c9f1c9-8112-4b91-9b88-afda547febae tempest-TestInstancesWithCinderVolumes-192732122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:19:27 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-32c9f1c9-8112-4b91-9b88-afda547febae tempest-TestInstancesWithCinderVolumes-192732122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:19:27 devstack sudo[97342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-9f729a54-293f-4fa3-b08f-7b287ede2d06 Aug 29 01:19:27 devstack sudo[97342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:19:27 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-32c9f1c9-8112-4b91-9b88-afda547febae tempest-TestInstancesWithCinderVolumes-192732122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:19:27 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-32c9f1c9-8112-4b91-9b88-afda547febae tempest-TestInstancesWithCinderVolumes-192732122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:19:27 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-32c9f1c9-8112-4b91-9b88-afda547febae tempest-TestInstancesWithCinderVolumes-192732122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:19:28 devstack sudo[97344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:19:28 devstack sudo[97344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:19:28 devstack sudo[97344]: pam_unix(sudo:session): session closed for user root Aug 29 01:19:28 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-32c9f1c9-8112-4b91-9b88-afda547febae tempest-TestInstancesWithCinderVolumes-192732122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.453s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:19:28 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-32c9f1c9-8112-4b91-9b88-afda547febae tempest-TestInstancesWithCinderVolumes-192732122 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:19:28 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-32c9f1c9-8112-4b91-9b88-afda547febae tempest-TestInstancesWithCinderVolumes-192732122 None] Deleted volume successfully. Aug 29 01:19:28 devstack sudo[97342]: pam_unix(sudo:session): session closed for user root Aug 29 01:19:28 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-f28db1e0-1127-484e-b531-a3c0d7490aba tempest-SnapshotMetadataTestJSON-1484525885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-9f729a54-293f-4fa3-b08f-7b287ede2d06" returned: 0 in 0.660s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:19:28 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-f28db1e0-1127-484e-b531-a3c0d7490aba tempest-SnapshotMetadataTestJSON-1484525885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-9f729a54-293f-4fa3-b08f-7b287ede2d06,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-9f729a54-293f-4fa3-b08f-7b287ede2d06.aeefaab0-6d5c-4696-8280-d14aefc9081d 1G {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:19:28 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-32c9f1c9-8112-4b91-9b88-afda547febae tempest-TestInstancesWithCinderVolumes-192732122 None] Lock "cinder-343b0092-42e6-406d-bc65-7b0d0b6d0f05-delete_volume" released by "delete_volume" :: held 1.945s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:19:28 devstack sudo[97351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-9f729a54-293f-4fa3-b08f-7b287ede2d06,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-9f729a54-293f-4fa3-b08f-7b287ede2d06.aeefaab0-6d5c-4696-8280-d14aefc9081d 1G Aug 29 01:19:28 devstack sudo[97351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:19:28 devstack cinder-volume[86111]: INFO cinder.volume.manager [req-42dad673-0fce-49f0-9835-ea691f92da1b req-2256934d-da74-4ab8-8718-9704e76128c7 tempest-AttachVolumeNegativeTest-614873311 None] Terminate volume connection completed successfully. Aug 29 01:19:28 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [req-42dad673-0fce-49f0-9835-ea691f92da1b req-2256934d-da74-4ab8-8718-9704e76128c7 tempest-AttachVolumeNegativeTest-614873311 None] Deleting attachment e2c74af7-b700-4850-891c-c594c9eedd0a. {{(pid=86111) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 29 01:19:29 devstack sudo[97351]: pam_unix(sudo:session): session closed for user root Aug 29 01:19:29 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-f28db1e0-1127-484e-b531-a3c0d7490aba tempest-SnapshotMetadataTestJSON-1484525885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-9f729a54-293f-4fa3-b08f-7b287ede2d06,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-9f729a54-293f-4fa3-b08f-7b287ede2d06.aeefaab0-6d5c-4696-8280-d14aefc9081d 1G" returned: 0 in 0.704s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:19:29 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-f28db1e0-1127-484e-b531-a3c0d7490aba tempest-SnapshotMetadataTestJSON-1484525885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f729a54-293f-4fa3-b08f-7b287ede2d06 -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-9f729a54-293f-4fa3-b08f-7b287ede2d06.aeefaab0-6d5c-4696-8280-d14aefc9081d {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:19:29 devstack sudo[97360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f729a54-293f-4fa3-b08f-7b287ede2d06 -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-9f729a54-293f-4fa3-b08f-7b287ede2d06.aeefaab0-6d5c-4696-8280-d14aefc9081d Aug 29 01:19:29 devstack sudo[97360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:19:29 devstack sudo[97360]: pam_unix(sudo:session): session closed for user root Aug 29 01:19:29 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-f28db1e0-1127-484e-b531-a3c0d7490aba tempest-SnapshotMetadataTestJSON-1484525885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f729a54-293f-4fa3-b08f-7b287ede2d06 -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-9f729a54-293f-4fa3-b08f-7b287ede2d06.aeefaab0-6d5c-4696-8280-d14aefc9081d" returned: 0 in 0.333s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:19:29 devstack cinder-volume[86111]: WARNING cinder.volume.drivers.remotefs [None req-f28db1e0-1127-484e-b531-a3c0d7490aba tempest-SnapshotMetadataTestJSON-1484525885 None] /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-9f729a54-293f-4fa3-b08f-7b287ede2d06.aeefaab0-6d5c-4696-8280-d14aefc9081d is being set with open permissions: ugo+rw Aug 29 01:19:29 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-f28db1e0-1127-484e-b531-a3c0d7490aba tempest-SnapshotMetadataTestJSON-1484525885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-9f729a54-293f-4fa3-b08f-7b287ede2d06.aeefaab0-6d5c-4696-8280-d14aefc9081d {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:19:29 devstack sudo[97366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-9f729a54-293f-4fa3-b08f-7b287ede2d06.aeefaab0-6d5c-4696-8280-d14aefc9081d Aug 29 01:19:29 devstack sudo[97366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:19:29 devstack sudo[97366]: pam_unix(sudo:session): session closed for user root Aug 29 01:19:29 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-f28db1e0-1127-484e-b531-a3c0d7490aba tempest-SnapshotMetadataTestJSON-1484525885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-9f729a54-293f-4fa3-b08f-7b287ede2d06.aeefaab0-6d5c-4696-8280-d14aefc9081d" returned: 0 in 0.470s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:19:30 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-f28db1e0-1127-484e-b531-a3c0d7490aba tempest-SnapshotMetadataTestJSON-1484525885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-9f729a54-293f-4fa3-b08f-7b287ede2d06.info {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:19:30 devstack sudo[97372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-9f729a54-293f-4fa3-b08f-7b287ede2d06.info Aug 29 01:19:30 devstack sudo[97372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:19:30 devstack sudo[97372]: pam_unix(sudo:session): session closed for user root Aug 29 01:19:30 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-f28db1e0-1127-484e-b531-a3c0d7490aba tempest-SnapshotMetadataTestJSON-1484525885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-9f729a54-293f-4fa3-b08f-7b287ede2d06.info" returned: 0 in 0.681s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:19:30 devstack cinder-volume[86111]: WARNING cinder.volume.drivers.remotefs [None req-f28db1e0-1127-484e-b531-a3c0d7490aba tempest-SnapshotMetadataTestJSON-1484525885 None] /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-9f729a54-293f-4fa3-b08f-7b287ede2d06.info is being set with open permissions: ugo+rw Aug 29 01:19:30 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-f28db1e0-1127-484e-b531-a3c0d7490aba tempest-SnapshotMetadataTestJSON-1484525885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-9f729a54-293f-4fa3-b08f-7b287ede2d06.info {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:19:30 devstack sudo[97402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-9f729a54-293f-4fa3-b08f-7b287ede2d06.info Aug 29 01:19:30 devstack sudo[97402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:19:31 devstack sudo[97402]: pam_unix(sudo:session): session closed for user root Aug 29 01:19:31 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-f28db1e0-1127-484e-b531-a3c0d7490aba tempest-SnapshotMetadataTestJSON-1484525885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-9f729a54-293f-4fa3-b08f-7b287ede2d06.info" returned: 0 in 0.441s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:19:31 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-f28db1e0-1127-484e-b531-a3c0d7490aba tempest-SnapshotMetadataTestJSON-1484525885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.440s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:19:31 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-f28db1e0-1127-484e-b531-a3c0d7490aba tempest-SnapshotMetadataTestJSON-1484525885 None] Create snapshot completed successfully Aug 29 01:19:32 devstack cinder-volume[86111]: INFO cinder.volume.manager [req-1d1a77a7-b86e-4b24-bb89-0929156bd48c req-a829ce76-aab1-433d-bae8-8820f2f8e819 tempest-TestInstancesWithCinderVolumes-192732122 None] Terminate volume connection completed successfully. Aug 29 01:19:32 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [req-1d1a77a7-b86e-4b24-bb89-0929156bd48c req-a829ce76-aab1-433d-bae8-8820f2f8e819 tempest-TestInstancesWithCinderVolumes-192732122 None] Deleting attachment 94731137-bd6a-4352-bfeb-b58700e9f464. {{(pid=86111) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 29 01:19:33 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-79930dcd-b369-4b83-9726-5260c2c0a2c1 tempest-SnapshotMetadataTestJSON-1484525885 None] Acquiring lock "cinder-aeefaab0-6d5c-4696-8280-d14aefc9081d-delete_snapshot" by "delete_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:19:33 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-79930dcd-b369-4b83-9726-5260c2c0a2c1 tempest-SnapshotMetadataTestJSON-1484525885 None] Lock "cinder-aeefaab0-6d5c-4696-8280-d14aefc9081d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:19:33 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-79930dcd-b369-4b83-9726-5260c2c0a2c1 tempest-SnapshotMetadataTestJSON-1484525885 None] Acquiring lock "cinder-quobyte-9f729a54-293f-4fa3-b08f-7b287ede2d06" by "delete_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:19:33 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-79930dcd-b369-4b83-9726-5260c2c0a2c1 tempest-SnapshotMetadataTestJSON-1484525885 None] Lock "cinder-quobyte-9f729a54-293f-4fa3-b08f-7b287ede2d06" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:19:33 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-79930dcd-b369-4b83-9726-5260c2c0a2c1 tempest-SnapshotMetadataTestJSON-1484525885 None] Acquiring lock "cinder-quobyte-aeefaab0-6d5c-4696-8280-d14aefc9081d" by "_delete_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:19:33 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-79930dcd-b369-4b83-9726-5260c2c0a2c1 tempest-SnapshotMetadataTestJSON-1484525885 None] Lock "cinder-quobyte-aeefaab0-6d5c-4696-8280-d14aefc9081d" acquired by "_delete_snapshot" :: waited 0.042s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:19:33 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-79930dcd-b369-4b83-9726-5260c2c0a2c1 tempest-SnapshotMetadataTestJSON-1484525885 None] Deleting offline snapshot aeefaab0-6d5c-4696-8280-d14aefc9081d of volume 9f729a54-293f-4fa3-b08f-7b287ede2d06 {{(pid=86111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 29 01:19:33 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-79930dcd-b369-4b83-9726-5260c2c0a2c1 tempest-SnapshotMetadataTestJSON-1484525885 None] snapshot_file for this snap is: volume-9f729a54-293f-4fa3-b08f-7b287ede2d06.aeefaab0-6d5c-4696-8280-d14aefc9081d {{(pid=86111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 29 01:19:33 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a5f0840-81dc-44ea-866a-90913e61ed56]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:19:33 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-79930dcd-b369-4b83-9726-5260c2c0a2c1 tempest-SnapshotMetadataTestJSON-1484525885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-9f729a54-293f-4fa3-b08f-7b287ede2d06.aeefaab0-6d5c-4696-8280-d14aefc9081d {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:19:33 devstack sudo[97421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-9f729a54-293f-4fa3-b08f-7b287ede2d06.aeefaab0-6d5c-4696-8280-d14aefc9081d Aug 29 01:19:33 devstack sudo[97421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:19:33 devstack sudo[97421]: pam_unix(sudo:session): session closed for user root Aug 29 01:19:33 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-79930dcd-b369-4b83-9726-5260c2c0a2c1 tempest-SnapshotMetadataTestJSON-1484525885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-9f729a54-293f-4fa3-b08f-7b287ede2d06.aeefaab0-6d5c-4696-8280-d14aefc9081d" returned: 0 in 0.549s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:19:33 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-79930dcd-b369-4b83-9726-5260c2c0a2c1 tempest-SnapshotMetadataTestJSON-1484525885 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9f729a54-293f-4fa3-b08f-7b287ede2d06(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 29 01:19:33 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[77227d5a-2590-46fa-b3ba-c0a3408af9ca]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:19:33 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-79930dcd-b369-4b83-9726-5260c2c0a2c1 tempest-SnapshotMetadataTestJSON-1484525885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-9f729a54-293f-4fa3-b08f-7b287ede2d06 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:19:33 devstack sudo[97429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-9f729a54-293f-4fa3-b08f-7b287ede2d06 Aug 29 01:19:33 devstack sudo[97429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:19:34 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-79905960-44a9-4ed0-a816-d579c5e34a73 tempest-TestInstancesWithCinderVolumes-192732122 None] Acquiring lock "cinder-e3178d0e-ea20-4d5e-9c79-9e4165e50dd5-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:19:34 devstack sudo[97429]: pam_unix(sudo:session): session closed for user root Aug 29 01:19:34 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-79930dcd-b369-4b83-9726-5260c2c0a2c1 tempest-SnapshotMetadataTestJSON-1484525885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-9f729a54-293f-4fa3-b08f-7b287ede2d06" returned: 0 in 0.438s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:19:34 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-79930dcd-b369-4b83-9726-5260c2c0a2c1 tempest-SnapshotMetadataTestJSON-1484525885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-9f729a54-293f-4fa3-b08f-7b287ede2d06.aeefaab0-6d5c-4696-8280-d14aefc9081d {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:19:34 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-79905960-44a9-4ed0-a816-d579c5e34a73 tempest-TestInstancesWithCinderVolumes-192732122 None] Lock "cinder-e3178d0e-ea20-4d5e-9c79-9e4165e50dd5-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:19:34 devstack sudo[97434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-9f729a54-293f-4fa3-b08f-7b287ede2d06.aeefaab0-6d5c-4696-8280-d14aefc9081d Aug 29 01:19:34 devstack sudo[97434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:19:34 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-79905960-44a9-4ed0-a816-d579c5e34a73 tempest-TestInstancesWithCinderVolumes-192732122 None] Acquiring lock "cinder-quobyte-e3178d0e-ea20-4d5e-9c79-9e4165e50dd5" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:19:34 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-79905960-44a9-4ed0-a816-d579c5e34a73 tempest-TestInstancesWithCinderVolumes-192732122 None] Lock "cinder-quobyte-e3178d0e-ea20-4d5e-9c79-9e4165e50dd5" acquired by "delete_volume" :: waited 0.030s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:19:34 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[027695cf-839a-4db3-8dd3-77fa50eec07c]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:19:34 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-79905960-44a9-4ed0-a816-d579c5e34a73 tempest-TestInstancesWithCinderVolumes-192732122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-e3178d0e-ea20-4d5e-9c79-9e4165e50dd5 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:19:34 devstack sudo[97436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-e3178d0e-ea20-4d5e-9c79-9e4165e50dd5 Aug 29 01:19:34 devstack sudo[97436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:19:34 devstack sudo[97434]: pam_unix(sudo:session): session closed for user root Aug 29 01:19:34 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-79930dcd-b369-4b83-9726-5260c2c0a2c1 tempest-SnapshotMetadataTestJSON-1484525885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-9f729a54-293f-4fa3-b08f-7b287ede2d06.aeefaab0-6d5c-4696-8280-d14aefc9081d" returned: 0 in 0.450s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:19:34 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-79930dcd-b369-4b83-9726-5260c2c0a2c1 tempest-SnapshotMetadataTestJSON-1484525885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-9f729a54-293f-4fa3-b08f-7b287ede2d06.aeefaab0-6d5c-4696-8280-d14aefc9081d {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:19:34 devstack sudo[97442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-9f729a54-293f-4fa3-b08f-7b287ede2d06.aeefaab0-6d5c-4696-8280-d14aefc9081d Aug 29 01:19:34 devstack sudo[97442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:19:34 devstack sudo[97436]: pam_unix(sudo:session): session closed for user root Aug 29 01:19:34 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-79905960-44a9-4ed0-a816-d579c5e34a73 tempest-TestInstancesWithCinderVolumes-192732122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-e3178d0e-ea20-4d5e-9c79-9e4165e50dd5" returned: 0 in 0.462s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:19:34 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-79905960-44a9-4ed0-a816-d579c5e34a73 tempest-TestInstancesWithCinderVolumes-192732122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-e3178d0e-ea20-4d5e-9c79-9e4165e50dd5 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:19:34 devstack sudo[97448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-e3178d0e-ea20-4d5e-9c79-9e4165e50dd5 Aug 29 01:19:34 devstack sudo[97448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:19:34 devstack sudo[97442]: pam_unix(sudo:session): session closed for user root Aug 29 01:19:34 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-79930dcd-b369-4b83-9726-5260c2c0a2c1 tempest-SnapshotMetadataTestJSON-1484525885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-9f729a54-293f-4fa3-b08f-7b287ede2d06.aeefaab0-6d5c-4696-8280-d14aefc9081d" returned: 0 in 0.330s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:19:35 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-79930dcd-b369-4b83-9726-5260c2c0a2c1 tempest-SnapshotMetadataTestJSON-1484525885 None] Lock "cinder-quobyte-aeefaab0-6d5c-4696-8280-d14aefc9081d" released by "_delete_snapshot" :: held 1.923s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:19:35 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-79930dcd-b369-4b83-9726-5260c2c0a2c1 tempest-SnapshotMetadataTestJSON-1484525885 None] Lock "cinder-quobyte-9f729a54-293f-4fa3-b08f-7b287ede2d06" released by "delete_snapshot" :: held 1.978s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:19:35 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-79930dcd-b369-4b83-9726-5260c2c0a2c1 tempest-SnapshotMetadataTestJSON-1484525885 None] Created reservations ['4abdaf35-ccfe-49d6-aba0-a43840942723', '3502f229-49b8-4229-9c2c-e5da10123cf3', '18fe47f4-3d2b-46f5-9bec-ee4d20d0536c', '9cacbce2-4376-48b4-a627-999cc2b41930'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:19:35 devstack sudo[97448]: pam_unix(sudo:session): session closed for user root Aug 29 01:19:35 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-79905960-44a9-4ed0-a816-d579c5e34a73 tempest-TestInstancesWithCinderVolumes-192732122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-e3178d0e-ea20-4d5e-9c79-9e4165e50dd5" returned: 0 in 0.381s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:19:35 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-2311b65f-5e4c-4492-a7ef-73db5a53b8fb tempest-VolumesSnapshotListTestJSON-1993382796 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:19:35 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-2311b65f-5e4c-4492-a7ef-73db5a53b8fb tempest-VolumesSnapshotListTestJSON-1993382796 None] Flow 'volume_create_manager' (1742036e-26c4-46ea-baa4-775df9b42c15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:19:35 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-2311b65f-5e4c-4492-a7ef-73db5a53b8fb tempest-VolumesSnapshotListTestJSON-1993382796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3b4581c-6859-4de9-ac08-ba47be922038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:19:35 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-79905960-44a9-4ed0-a816-d579c5e34a73 tempest-TestInstancesWithCinderVolumes-192732122 None] Lock "cinder-quobyte-e3178d0e-ea20-4d5e-9c79-9e4165e50dd5" released by "delete_volume" :: held 0.945s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:19:35 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-2311b65f-5e4c-4492-a7ef-73db5a53b8fb tempest-VolumesSnapshotListTestJSON-1993382796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3b4581c-6859-4de9-ac08-ba47be922038) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:19:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1501196727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=963e0cdd-7deb-44c0-a65c-77f9f354867e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e44b855048484c9c955ea9df85a952f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:19:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:19:35Z,use_quota=True,user_id='d73a4ce2de494519b4afc6b0c4e41963',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:19:35 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-2311b65f-5e4c-4492-a7ef-73db5a53b8fb tempest-VolumesSnapshotListTestJSON-1993382796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dca8e366-0ab3-4522-81ee-be88d1c704aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:19:35 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-2311b65f-5e4c-4492-a7ef-73db5a53b8fb tempest-VolumesSnapshotListTestJSON-1993382796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dca8e366-0ab3-4522-81ee-be88d1c704aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:19:35 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-2311b65f-5e4c-4492-a7ef-73db5a53b8fb tempest-VolumesSnapshotListTestJSON-1993382796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0222616-249c-4d01-bbc9-23724b4f4b5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:19:35 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-2311b65f-5e4c-4492-a7ef-73db5a53b8fb tempest-VolumesSnapshotListTestJSON-1993382796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0222616-249c-4d01-bbc9-23724b4f4b5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '963e0cdd-7deb-44c0-a65c-77f9f354867e', 'volume_name': 'volume-963e0cdd-7deb-44c0-a65c-77f9f354867e', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:19:35 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-2311b65f-5e4c-4492-a7ef-73db5a53b8fb tempest-VolumesSnapshotListTestJSON-1993382796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f85bf8e9-9170-4475-b472-669e813a7e97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:19:35 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-2311b65f-5e4c-4492-a7ef-73db5a53b8fb tempest-VolumesSnapshotListTestJSON-1993382796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f85bf8e9-9170-4475-b472-669e813a7e97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:19:35 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-2311b65f-5e4c-4492-a7ef-73db5a53b8fb tempest-VolumesSnapshotListTestJSON-1993382796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c53519b-9826-4b5a-80ca-e361b61d7b67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:19:35 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-2311b65f-5e4c-4492-a7ef-73db5a53b8fb tempest-VolumesSnapshotListTestJSON-1993382796 None] Volume 963e0cdd-7deb-44c0-a65c-77f9f354867e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-963e0cdd-7deb-44c0-a65c-77f9f354867e', 'volume_size': 1} Aug 29 01:19:35 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-2311b65f-5e4c-4492-a7ef-73db5a53b8fb tempest-VolumesSnapshotListTestJSON-1993382796 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:19:35 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-2311b65f-5e4c-4492-a7ef-73db5a53b8fb tempest-VolumesSnapshotListTestJSON-1993382796 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:19:35 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-2311b65f-5e4c-4492-a7ef-73db5a53b8fb tempest-VolumesSnapshotListTestJSON-1993382796 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:19:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1501196727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=963e0cdd-7deb-44c0-a65c-77f9f354867e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e44b855048484c9c955ea9df85a952f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:19:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:19:35Z,use_quota=True,user_id='d73a4ce2de494519b4afc6b0c4e41963',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:19:35 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-2311b65f-5e4c-4492-a7ef-73db5a53b8fb tempest-VolumesSnapshotListTestJSON-1993382796 None] Creating volume 963e0cdd-7deb-44c0-a65c-77f9f354867e {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:19:35 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-2311b65f-5e4c-4492-a7ef-73db5a53b8fb tempest-VolumesSnapshotListTestJSON-1993382796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:19:35 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-2311b65f-5e4c-4492-a7ef-73db5a53b8fb tempest-VolumesSnapshotListTestJSON-1993382796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:19:35 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-2311b65f-5e4c-4492-a7ef-73db5a53b8fb tempest-VolumesSnapshotListTestJSON-1993382796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:19:35 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-2311b65f-5e4c-4492-a7ef-73db5a53b8fb tempest-VolumesSnapshotListTestJSON-1993382796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:19:35 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-2311b65f-5e4c-4492-a7ef-73db5a53b8fb tempest-VolumesSnapshotListTestJSON-1993382796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:19:35 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-2311b65f-5e4c-4492-a7ef-73db5a53b8fb tempest-VolumesSnapshotListTestJSON-1993382796 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:19:35 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-2311b65f-5e4c-4492-a7ef-73db5a53b8fb tempest-VolumesSnapshotListTestJSON-1993382796 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:19:35 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-2311b65f-5e4c-4492-a7ef-73db5a53b8fb tempest-VolumesSnapshotListTestJSON-1993382796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-963e0cdd-7deb-44c0-a65c-77f9f354867e 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:19:35 devstack sudo[97452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-963e0cdd-7deb-44c0-a65c-77f9f354867e 1073741824 Aug 29 01:19:35 devstack sudo[97452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:19:35 devstack cinder-volume[86111]: WARNING cinder.quota [None req-79905960-44a9-4ed0-a816-d579c5e34a73 tempest-TestInstancesWithCinderVolumes-192732122 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-777297099-1320514889 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-777297099-1320514889, it is now deprecated. Please use the default quota class for default quota. Aug 29 01:19:35 devstack cinder-volume[86111]: WARNING cinder.quota [None req-79905960-44a9-4ed0-a816-d579c5e34a73 tempest-TestInstancesWithCinderVolumes-192732122 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-777297099-1320514889 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-777297099-1320514889, it is now deprecated. Please use the default quota class for default quota. Aug 29 01:19:35 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-79930dcd-b369-4b83-9726-5260c2c0a2c1 tempest-SnapshotMetadataTestJSON-1484525885 None] Delete snapshot completed successfully. Aug 29 01:19:35 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-79930dcd-b369-4b83-9726-5260c2c0a2c1 tempest-SnapshotMetadataTestJSON-1484525885 None] Lock "cinder-aeefaab0-6d5c-4696-8280-d14aefc9081d-delete_snapshot" released by "delete_snapshot" :: held 2.378s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:19:35 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-79905960-44a9-4ed0-a816-d579c5e34a73 tempest-TestInstancesWithCinderVolumes-192732122 None] Created reservations ['ec88bd42-8616-4ff2-900e-59680032de4a', 'd50cafc4-a709-416f-a76b-85ef1bdf75ea', '7499aa7a-17ea-4332-a7bc-fcfa39859b9f', '6aa6ec8d-68af-4a36-b7c4-05a55ae9fb26'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:19:35 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-79905960-44a9-4ed0-a816-d579c5e34a73 tempest-TestInstancesWithCinderVolumes-192732122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:19:35 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-79905960-44a9-4ed0-a816-d579c5e34a73 tempest-TestInstancesWithCinderVolumes-192732122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:19:35 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-79905960-44a9-4ed0-a816-d579c5e34a73 tempest-TestInstancesWithCinderVolumes-192732122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:19:35 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-79905960-44a9-4ed0-a816-d579c5e34a73 tempest-TestInstancesWithCinderVolumes-192732122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:19:35 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-79905960-44a9-4ed0-a816-d579c5e34a73 tempest-TestInstancesWithCinderVolumes-192732122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:19:35 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-79905960-44a9-4ed0-a816-d579c5e34a73 tempest-TestInstancesWithCinderVolumes-192732122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:19:35 devstack sudo[97454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:19:35 devstack sudo[97454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:19:35 devstack sudo[97454]: pam_unix(sudo:session): session closed for user root Aug 29 01:19:35 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-79905960-44a9-4ed0-a816-d579c5e34a73 tempest-TestInstancesWithCinderVolumes-192732122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.286s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:19:35 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-79905960-44a9-4ed0-a816-d579c5e34a73 tempest-TestInstancesWithCinderVolumes-192732122 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:19:35 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-79905960-44a9-4ed0-a816-d579c5e34a73 tempest-TestInstancesWithCinderVolumes-192732122 None] Deleted volume successfully. Aug 29 01:19:35 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-79905960-44a9-4ed0-a816-d579c5e34a73 tempest-TestInstancesWithCinderVolumes-192732122 None] Lock "cinder-e3178d0e-ea20-4d5e-9c79-9e4165e50dd5-delete_volume" released by "delete_volume" :: held 1.603s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:19:35 devstack sudo[97452]: pam_unix(sudo:session): session closed for user root Aug 29 01:19:35 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-2311b65f-5e4c-4492-a7ef-73db5a53b8fb tempest-VolumesSnapshotListTestJSON-1993382796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-963e0cdd-7deb-44c0-a65c-77f9f354867e 1073741824" returned: 0 in 0.510s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:19:35 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-2311b65f-5e4c-4492-a7ef-73db5a53b8fb tempest-VolumesSnapshotListTestJSON-1993382796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-963e0cdd-7deb-44c0-a65c-77f9f354867e {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:19:35 devstack sudo[97461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-963e0cdd-7deb-44c0-a65c-77f9f354867e Aug 29 01:19:35 devstack sudo[97461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:19:36 devstack sudo[97461]: pam_unix(sudo:session): session closed for user root Aug 29 01:19:36 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-2311b65f-5e4c-4492-a7ef-73db5a53b8fb tempest-VolumesSnapshotListTestJSON-1993382796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-963e0cdd-7deb-44c0-a65c-77f9f354867e" returned: 0 in 0.274s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:19:36 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-2311b65f-5e4c-4492-a7ef-73db5a53b8fb tempest-VolumesSnapshotListTestJSON-1993382796 None] <== create_volume: return (829ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:19:36 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-2311b65f-5e4c-4492-a7ef-73db5a53b8fb tempest-VolumesSnapshotListTestJSON-1993382796 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.832s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:19:36 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-2311b65f-5e4c-4492-a7ef-73db5a53b8fb tempest-VolumesSnapshotListTestJSON-1993382796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c53519b-9826-4b5a-80ca-e361b61d7b67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-963e0cdd-7deb-44c0-a65c-77f9f354867e', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:19:36 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-2311b65f-5e4c-4492-a7ef-73db5a53b8fb tempest-VolumesSnapshotListTestJSON-1993382796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c110976-988d-41b8-bb00-361dd4cedfaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:19:36 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-2311b65f-5e4c-4492-a7ef-73db5a53b8fb tempest-VolumesSnapshotListTestJSON-1993382796 None] Volume volume-963e0cdd-7deb-44c0-a65c-77f9f354867e (963e0cdd-7deb-44c0-a65c-77f9f354867e): created successfully Aug 29 01:19:36 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-2311b65f-5e4c-4492-a7ef-73db5a53b8fb tempest-VolumesSnapshotListTestJSON-1993382796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c110976-988d-41b8-bb00-361dd4cedfaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:19:36 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-2311b65f-5e4c-4492-a7ef-73db5a53b8fb tempest-VolumesSnapshotListTestJSON-1993382796 None] Flow 'volume_create_manager' (1742036e-26c4-46ea-baa4-775df9b42c15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:19:36 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-2311b65f-5e4c-4492-a7ef-73db5a53b8fb tempest-VolumesSnapshotListTestJSON-1993382796 None] Created volume successfully. Aug 29 01:19:36 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-d3ddfb02-be1b-4b9c-bac6-dd4964310b65 tempest-SnapshotMetadataTestJSON-1484525885 None] Acquiring lock "cinder-9f729a54-293f-4fa3-b08f-7b287ede2d06-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:19:36 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-d3ddfb02-be1b-4b9c-bac6-dd4964310b65 tempest-SnapshotMetadataTestJSON-1484525885 None] Lock "cinder-9f729a54-293f-4fa3-b08f-7b287ede2d06-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:19:36 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-d3ddfb02-be1b-4b9c-bac6-dd4964310b65 tempest-SnapshotMetadataTestJSON-1484525885 None] Acquiring lock "cinder-quobyte-9f729a54-293f-4fa3-b08f-7b287ede2d06" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:19:36 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-d3ddfb02-be1b-4b9c-bac6-dd4964310b65 tempest-SnapshotMetadataTestJSON-1484525885 None] Lock "cinder-quobyte-9f729a54-293f-4fa3-b08f-7b287ede2d06" acquired by "delete_volume" :: waited 0.021s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:19:36 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f83aff1-8967-48f4-9d91-fdd022ae76f6]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:19:36 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d3ddfb02-be1b-4b9c-bac6-dd4964310b65 tempest-SnapshotMetadataTestJSON-1484525885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-9f729a54-293f-4fa3-b08f-7b287ede2d06 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:19:36 devstack sudo[97464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-9f729a54-293f-4fa3-b08f-7b287ede2d06 Aug 29 01:19:36 devstack sudo[97464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:19:36 devstack sudo[97464]: pam_unix(sudo:session): session closed for user root Aug 29 01:19:36 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d3ddfb02-be1b-4b9c-bac6-dd4964310b65 tempest-SnapshotMetadataTestJSON-1484525885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-9f729a54-293f-4fa3-b08f-7b287ede2d06" returned: 0 in 0.400s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:19:36 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d3ddfb02-be1b-4b9c-bac6-dd4964310b65 tempest-SnapshotMetadataTestJSON-1484525885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-9f729a54-293f-4fa3-b08f-7b287ede2d06 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:19:36 devstack sudo[97469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-9f729a54-293f-4fa3-b08f-7b287ede2d06 Aug 29 01:19:36 devstack sudo[97469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:19:37 devstack sudo[97469]: pam_unix(sudo:session): session closed for user root Aug 29 01:19:37 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d3ddfb02-be1b-4b9c-bac6-dd4964310b65 tempest-SnapshotMetadataTestJSON-1484525885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-9f729a54-293f-4fa3-b08f-7b287ede2d06" returned: 0 in 0.283s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:19:37 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-d3ddfb02-be1b-4b9c-bac6-dd4964310b65 tempest-SnapshotMetadataTestJSON-1484525885 None] Lock "cinder-quobyte-9f729a54-293f-4fa3-b08f-7b287ede2d06" released by "delete_volume" :: held 0.768s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:19:37 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-d3ddfb02-be1b-4b9c-bac6-dd4964310b65 tempest-SnapshotMetadataTestJSON-1484525885 None] Created reservations ['918cacb7-9b1f-4951-839b-59339834b8a6', '32dc103e-5af6-4364-bad2-d5629153dd63', '49d1b1c7-9662-496e-8694-988634d1bb38', 'f3b23838-484b-4582-9603-538ac039f65f'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:19:37 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-d3ddfb02-be1b-4b9c-bac6-dd4964310b65 tempest-SnapshotMetadataTestJSON-1484525885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:19:37 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-d3ddfb02-be1b-4b9c-bac6-dd4964310b65 tempest-SnapshotMetadataTestJSON-1484525885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:19:37 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-d3ddfb02-be1b-4b9c-bac6-dd4964310b65 tempest-SnapshotMetadataTestJSON-1484525885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:19:37 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-d3ddfb02-be1b-4b9c-bac6-dd4964310b65 tempest-SnapshotMetadataTestJSON-1484525885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:19:37 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-d3ddfb02-be1b-4b9c-bac6-dd4964310b65 tempest-SnapshotMetadataTestJSON-1484525885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:19:37 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d3ddfb02-be1b-4b9c-bac6-dd4964310b65 tempest-SnapshotMetadataTestJSON-1484525885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:19:37 devstack sudo[97472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:19:37 devstack sudo[97472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:19:37 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-5cf2a4fc-da5c-4279-85f6-2e9395528936 tempest-VolumesSnapshotListTestJSON-1993382796 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:19:37 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-5cf2a4fc-da5c-4279-85f6-2e9395528936 tempest-VolumesSnapshotListTestJSON-1993382796 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:19:37 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-5cf2a4fc-da5c-4279-85f6-2e9395528936 tempest-VolumesSnapshotListTestJSON-1993382796 None] Creating offline snapshot 26553ede-1493-4e4c-9937-742f27592aa7 of volume 963e0cdd-7deb-44c0-a65c-77f9f354867e {{(pid=86111) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 29 01:19:37 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[8736446e-4de9-48f0-8ccf-7427eb08931c]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:19:37 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-5cf2a4fc-da5c-4279-85f6-2e9395528936 tempest-VolumesSnapshotListTestJSON-1993382796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-963e0cdd-7deb-44c0-a65c-77f9f354867e {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:19:37 devstack sudo[97472]: pam_unix(sudo:session): session closed for user root Aug 29 01:19:37 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d3ddfb02-be1b-4b9c-bac6-dd4964310b65 tempest-SnapshotMetadataTestJSON-1484525885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.396s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:19:37 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-d3ddfb02-be1b-4b9c-bac6-dd4964310b65 tempest-SnapshotMetadataTestJSON-1484525885 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:19:37 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-d3ddfb02-be1b-4b9c-bac6-dd4964310b65 tempest-SnapshotMetadataTestJSON-1484525885 None] Deleted volume successfully. Aug 29 01:19:37 devstack sudo[97474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-963e0cdd-7deb-44c0-a65c-77f9f354867e Aug 29 01:19:37 devstack sudo[97474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:19:37 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-d3ddfb02-be1b-4b9c-bac6-dd4964310b65 tempest-SnapshotMetadataTestJSON-1484525885 None] Lock "cinder-9f729a54-293f-4fa3-b08f-7b287ede2d06-delete_volume" released by "delete_volume" :: held 1.445s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:19:38 devstack sudo[97474]: pam_unix(sudo:session): session closed for user root Aug 29 01:19:38 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-5cf2a4fc-da5c-4279-85f6-2e9395528936 tempest-VolumesSnapshotListTestJSON-1993382796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-963e0cdd-7deb-44c0-a65c-77f9f354867e" returned: 0 in 0.483s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:19:38 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-5cf2a4fc-da5c-4279-85f6-2e9395528936 tempest-VolumesSnapshotListTestJSON-1993382796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-963e0cdd-7deb-44c0-a65c-77f9f354867e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-963e0cdd-7deb-44c0-a65c-77f9f354867e.26553ede-1493-4e4c-9937-742f27592aa7 1G {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:19:38 devstack sudo[97480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-963e0cdd-7deb-44c0-a65c-77f9f354867e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-963e0cdd-7deb-44c0-a65c-77f9f354867e.26553ede-1493-4e4c-9937-742f27592aa7 1G Aug 29 01:19:38 devstack sudo[97480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:19:38 devstack sudo[97480]: pam_unix(sudo:session): session closed for user root Aug 29 01:19:38 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-5cf2a4fc-da5c-4279-85f6-2e9395528936 tempest-VolumesSnapshotListTestJSON-1993382796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-963e0cdd-7deb-44c0-a65c-77f9f354867e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-963e0cdd-7deb-44c0-a65c-77f9f354867e.26553ede-1493-4e4c-9937-742f27592aa7 1G" returned: 0 in 0.557s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:19:38 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-5cf2a4fc-da5c-4279-85f6-2e9395528936 tempest-VolumesSnapshotListTestJSON-1993382796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-963e0cdd-7deb-44c0-a65c-77f9f354867e -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-963e0cdd-7deb-44c0-a65c-77f9f354867e.26553ede-1493-4e4c-9937-742f27592aa7 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:19:38 devstack sudo[97486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-963e0cdd-7deb-44c0-a65c-77f9f354867e -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-963e0cdd-7deb-44c0-a65c-77f9f354867e.26553ede-1493-4e4c-9937-742f27592aa7 Aug 29 01:19:38 devstack sudo[97486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:19:39 devstack sudo[97486]: pam_unix(sudo:session): session closed for user root Aug 29 01:19:39 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-5cf2a4fc-da5c-4279-85f6-2e9395528936 tempest-VolumesSnapshotListTestJSON-1993382796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-963e0cdd-7deb-44c0-a65c-77f9f354867e -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-963e0cdd-7deb-44c0-a65c-77f9f354867e.26553ede-1493-4e4c-9937-742f27592aa7" returned: 0 in 0.338s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:19:39 devstack cinder-volume[86111]: WARNING cinder.volume.drivers.remotefs [None req-5cf2a4fc-da5c-4279-85f6-2e9395528936 tempest-VolumesSnapshotListTestJSON-1993382796 None] /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-963e0cdd-7deb-44c0-a65c-77f9f354867e.26553ede-1493-4e4c-9937-742f27592aa7 is being set with open permissions: ugo+rw Aug 29 01:19:39 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-5cf2a4fc-da5c-4279-85f6-2e9395528936 tempest-VolumesSnapshotListTestJSON-1993382796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-963e0cdd-7deb-44c0-a65c-77f9f354867e.26553ede-1493-4e4c-9937-742f27592aa7 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:19:39 devstack sudo[97492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-963e0cdd-7deb-44c0-a65c-77f9f354867e.26553ede-1493-4e4c-9937-742f27592aa7 Aug 29 01:19:39 devstack sudo[97492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:19:39 devstack sudo[97492]: pam_unix(sudo:session): session closed for user root Aug 29 01:19:39 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-5cf2a4fc-da5c-4279-85f6-2e9395528936 tempest-VolumesSnapshotListTestJSON-1993382796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-963e0cdd-7deb-44c0-a65c-77f9f354867e.26553ede-1493-4e4c-9937-742f27592aa7" returned: 0 in 0.350s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:19:39 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-5cf2a4fc-da5c-4279-85f6-2e9395528936 tempest-VolumesSnapshotListTestJSON-1993382796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-963e0cdd-7deb-44c0-a65c-77f9f354867e.info {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:19:39 devstack sudo[97496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-963e0cdd-7deb-44c0-a65c-77f9f354867e.info Aug 29 01:19:39 devstack sudo[97496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:19:39 devstack sudo[97496]: pam_unix(sudo:session): session closed for user root Aug 29 01:19:39 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-5cf2a4fc-da5c-4279-85f6-2e9395528936 tempest-VolumesSnapshotListTestJSON-1993382796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-963e0cdd-7deb-44c0-a65c-77f9f354867e.info" returned: 0 in 0.305s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:19:39 devstack cinder-volume[86111]: WARNING cinder.volume.drivers.remotefs [None req-5cf2a4fc-da5c-4279-85f6-2e9395528936 tempest-VolumesSnapshotListTestJSON-1993382796 None] /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-963e0cdd-7deb-44c0-a65c-77f9f354867e.info is being set with open permissions: ugo+rw Aug 29 01:19:39 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-5cf2a4fc-da5c-4279-85f6-2e9395528936 tempest-VolumesSnapshotListTestJSON-1993382796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-963e0cdd-7deb-44c0-a65c-77f9f354867e.info {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:19:39 devstack sudo[97499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-963e0cdd-7deb-44c0-a65c-77f9f354867e.info Aug 29 01:19:39 devstack sudo[97499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:19:40 devstack sudo[97499]: pam_unix(sudo:session): session closed for user root Aug 29 01:19:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-5cf2a4fc-da5c-4279-85f6-2e9395528936 tempest-VolumesSnapshotListTestJSON-1993382796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-963e0cdd-7deb-44c0-a65c-77f9f354867e.info" returned: 0 in 0.377s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:19:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-5cf2a4fc-da5c-4279-85f6-2e9395528936 tempest-VolumesSnapshotListTestJSON-1993382796 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.552s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:19:40 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-5cf2a4fc-da5c-4279-85f6-2e9395528936 tempest-VolumesSnapshotListTestJSON-1993382796 None] Create snapshot completed successfully Aug 29 01:19:40 devstack cinder-volume[86111]: DEBUG oslo_service.periodic_task [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86111) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 29 01:19:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:19:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:19:40 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:19:40 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:19:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:19:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:19:40 devstack sudo[97505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:19:40 devstack sudo[97505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:19:41 devstack sudo[97505]: pam_unix(sudo:session): session closed for user root Aug 29 01:19:41 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-de752545-d617-440e-8362-d04fae0901a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.317s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:19:41 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:19:41 devstack cinder-volume[86111]: DEBUG oslo_service.periodic_task [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Running periodic task VolumeManager._thread_info {{(pid=86111) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 29 01:19:41 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-de752545-d617-440e-8362-d04fae0901a5 None None] thread count: 28 {{(pid=86111) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 29 01:19:41 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-de752545-d617-440e-8362-d04fae0901a5 None None] thread info: [<_MainThread(MainThread, started 129173440548992)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86111) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 29 01:19:41 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-aac8b2fa-4c20-451b-adb3-f435081f82d1 tempest-VolumesSnapshotListTestJSON-1993382796 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:19:41 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-aac8b2fa-4c20-451b-adb3-f435081f82d1 tempest-VolumesSnapshotListTestJSON-1993382796 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:19:41 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-aac8b2fa-4c20-451b-adb3-f435081f82d1 tempest-VolumesSnapshotListTestJSON-1993382796 None] Creating offline snapshot 01f890c0-2205-417c-b458-7eb79d417d16 of volume 963e0cdd-7deb-44c0-a65c-77f9f354867e {{(pid=86111) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 29 01:19:41 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[0341f050-a7f7-4ba7-833a-0fe0f1636fa7]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:19:41 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-aac8b2fa-4c20-451b-adb3-f435081f82d1 tempest-VolumesSnapshotListTestJSON-1993382796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-963e0cdd-7deb-44c0-a65c-77f9f354867e.26553ede-1493-4e4c-9937-742f27592aa7 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:19:41 devstack sudo[97508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-963e0cdd-7deb-44c0-a65c-77f9f354867e.26553ede-1493-4e4c-9937-742f27592aa7 Aug 29 01:19:41 devstack sudo[97508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:19:41 devstack sudo[97508]: pam_unix(sudo:session): session closed for user root Aug 29 01:19:41 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-aac8b2fa-4c20-451b-adb3-f435081f82d1 tempest-VolumesSnapshotListTestJSON-1993382796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-963e0cdd-7deb-44c0-a65c-77f9f354867e.26553ede-1493-4e4c-9937-742f27592aa7" returned: 0 in 0.533s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:19:41 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-aac8b2fa-4c20-451b-adb3-f435081f82d1 tempest-VolumesSnapshotListTestJSON-1993382796 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-963e0cdd-7deb-44c0-a65c-77f9f354867e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 29 01:19:41 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-aac8b2fa-4c20-451b-adb3-f435081f82d1 tempest-VolumesSnapshotListTestJSON-1993382796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-963e0cdd-7deb-44c0-a65c-77f9f354867e.26553ede-1493-4e4c-9937-742f27592aa7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-963e0cdd-7deb-44c0-a65c-77f9f354867e.01f890c0-2205-417c-b458-7eb79d417d16 1G {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:19:41 devstack sudo[97514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-963e0cdd-7deb-44c0-a65c-77f9f354867e.26553ede-1493-4e4c-9937-742f27592aa7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-963e0cdd-7deb-44c0-a65c-77f9f354867e.01f890c0-2205-417c-b458-7eb79d417d16 1G Aug 29 01:19:41 devstack sudo[97514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:19:42 devstack sudo[97514]: pam_unix(sudo:session): session closed for user root Aug 29 01:19:42 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-aac8b2fa-4c20-451b-adb3-f435081f82d1 tempest-VolumesSnapshotListTestJSON-1993382796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-963e0cdd-7deb-44c0-a65c-77f9f354867e.26553ede-1493-4e4c-9937-742f27592aa7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-963e0cdd-7deb-44c0-a65c-77f9f354867e.01f890c0-2205-417c-b458-7eb79d417d16 1G" returned: 0 in 0.526s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:19:42 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-aac8b2fa-4c20-451b-adb3-f435081f82d1 tempest-VolumesSnapshotListTestJSON-1993382796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-963e0cdd-7deb-44c0-a65c-77f9f354867e.26553ede-1493-4e4c-9937-742f27592aa7 -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-963e0cdd-7deb-44c0-a65c-77f9f354867e.01f890c0-2205-417c-b458-7eb79d417d16 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:19:42 devstack sudo[97533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-963e0cdd-7deb-44c0-a65c-77f9f354867e.26553ede-1493-4e4c-9937-742f27592aa7 -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-963e0cdd-7deb-44c0-a65c-77f9f354867e.01f890c0-2205-417c-b458-7eb79d417d16 Aug 29 01:19:42 devstack sudo[97533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:19:42 devstack sudo[97533]: pam_unix(sudo:session): session closed for user root Aug 29 01:19:42 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-aac8b2fa-4c20-451b-adb3-f435081f82d1 tempest-VolumesSnapshotListTestJSON-1993382796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-963e0cdd-7deb-44c0-a65c-77f9f354867e.26553ede-1493-4e4c-9937-742f27592aa7 -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-963e0cdd-7deb-44c0-a65c-77f9f354867e.01f890c0-2205-417c-b458-7eb79d417d16" returned: 0 in 0.414s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:19:42 devstack cinder-volume[86111]: WARNING cinder.volume.drivers.remotefs [None req-aac8b2fa-4c20-451b-adb3-f435081f82d1 tempest-VolumesSnapshotListTestJSON-1993382796 None] /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-963e0cdd-7deb-44c0-a65c-77f9f354867e.01f890c0-2205-417c-b458-7eb79d417d16 is being set with open permissions: ugo+rw Aug 29 01:19:42 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-aac8b2fa-4c20-451b-adb3-f435081f82d1 tempest-VolumesSnapshotListTestJSON-1993382796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-963e0cdd-7deb-44c0-a65c-77f9f354867e.01f890c0-2205-417c-b458-7eb79d417d16 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:19:42 devstack sudo[97540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-963e0cdd-7deb-44c0-a65c-77f9f354867e.01f890c0-2205-417c-b458-7eb79d417d16 Aug 29 01:19:42 devstack sudo[97540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:19:43 devstack sudo[97540]: pam_unix(sudo:session): session closed for user root Aug 29 01:19:43 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-aac8b2fa-4c20-451b-adb3-f435081f82d1 tempest-VolumesSnapshotListTestJSON-1993382796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-963e0cdd-7deb-44c0-a65c-77f9f354867e.01f890c0-2205-417c-b458-7eb79d417d16" returned: 0 in 0.295s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:19:43 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-aac8b2fa-4c20-451b-adb3-f435081f82d1 tempest-VolumesSnapshotListTestJSON-1993382796 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.970s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:19:43 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-aac8b2fa-4c20-451b-adb3-f435081f82d1 tempest-VolumesSnapshotListTestJSON-1993382796 None] Create snapshot completed successfully Aug 29 01:19:43 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-4382fcd8-507e-4217-83b2-5bcd6ec38573 tempest-VolumesSnapshotListTestJSON-1993382796 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:19:43 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-4382fcd8-507e-4217-83b2-5bcd6ec38573 tempest-VolumesSnapshotListTestJSON-1993382796 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:19:43 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-4382fcd8-507e-4217-83b2-5bcd6ec38573 tempest-VolumesSnapshotListTestJSON-1993382796 None] Creating offline snapshot d4aba804-3ec2-4561-991c-8ae212c51bd1 of volume 963e0cdd-7deb-44c0-a65c-77f9f354867e {{(pid=86111) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 29 01:19:43 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f93ffc8-38a8-4c7f-9791-4d5dc2fc0b52]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:19:43 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-4382fcd8-507e-4217-83b2-5bcd6ec38573 tempest-VolumesSnapshotListTestJSON-1993382796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-963e0cdd-7deb-44c0-a65c-77f9f354867e.01f890c0-2205-417c-b458-7eb79d417d16 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:19:43 devstack sudo[97543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-963e0cdd-7deb-44c0-a65c-77f9f354867e.01f890c0-2205-417c-b458-7eb79d417d16 Aug 29 01:19:43 devstack sudo[97543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:19:44 devstack sudo[97543]: pam_unix(sudo:session): session closed for user root Aug 29 01:19:44 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-4382fcd8-507e-4217-83b2-5bcd6ec38573 tempest-VolumesSnapshotListTestJSON-1993382796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-963e0cdd-7deb-44c0-a65c-77f9f354867e.01f890c0-2205-417c-b458-7eb79d417d16" returned: 0 in 0.514s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:19:44 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-4382fcd8-507e-4217-83b2-5bcd6ec38573 tempest-VolumesSnapshotListTestJSON-1993382796 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-963e0cdd-7deb-44c0-a65c-77f9f354867e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 29 01:19:44 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-4382fcd8-507e-4217-83b2-5bcd6ec38573 tempest-VolumesSnapshotListTestJSON-1993382796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-963e0cdd-7deb-44c0-a65c-77f9f354867e.01f890c0-2205-417c-b458-7eb79d417d16,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-963e0cdd-7deb-44c0-a65c-77f9f354867e.d4aba804-3ec2-4561-991c-8ae212c51bd1 1G {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:19:44 devstack sudo[97549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-963e0cdd-7deb-44c0-a65c-77f9f354867e.01f890c0-2205-417c-b458-7eb79d417d16,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-963e0cdd-7deb-44c0-a65c-77f9f354867e.d4aba804-3ec2-4561-991c-8ae212c51bd1 1G Aug 29 01:19:44 devstack sudo[97549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:19:44 devstack sudo[97549]: pam_unix(sudo:session): session closed for user root Aug 29 01:19:44 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-4382fcd8-507e-4217-83b2-5bcd6ec38573 tempest-VolumesSnapshotListTestJSON-1993382796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-963e0cdd-7deb-44c0-a65c-77f9f354867e.01f890c0-2205-417c-b458-7eb79d417d16,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-963e0cdd-7deb-44c0-a65c-77f9f354867e.d4aba804-3ec2-4561-991c-8ae212c51bd1 1G" returned: 0 in 0.834s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:19:44 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-4382fcd8-507e-4217-83b2-5bcd6ec38573 tempest-VolumesSnapshotListTestJSON-1993382796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-963e0cdd-7deb-44c0-a65c-77f9f354867e.01f890c0-2205-417c-b458-7eb79d417d16 -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-963e0cdd-7deb-44c0-a65c-77f9f354867e.d4aba804-3ec2-4561-991c-8ae212c51bd1 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:19:45 devstack sudo[97556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-963e0cdd-7deb-44c0-a65c-77f9f354867e.01f890c0-2205-417c-b458-7eb79d417d16 -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-963e0cdd-7deb-44c0-a65c-77f9f354867e.d4aba804-3ec2-4561-991c-8ae212c51bd1 Aug 29 01:19:45 devstack sudo[97556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:19:45 devstack sudo[97556]: pam_unix(sudo:session): session closed for user root Aug 29 01:19:45 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-4382fcd8-507e-4217-83b2-5bcd6ec38573 tempest-VolumesSnapshotListTestJSON-1993382796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-963e0cdd-7deb-44c0-a65c-77f9f354867e.01f890c0-2205-417c-b458-7eb79d417d16 -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-963e0cdd-7deb-44c0-a65c-77f9f354867e.d4aba804-3ec2-4561-991c-8ae212c51bd1" returned: 0 in 0.451s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:19:45 devstack cinder-volume[86111]: WARNING cinder.volume.drivers.remotefs [None req-4382fcd8-507e-4217-83b2-5bcd6ec38573 tempest-VolumesSnapshotListTestJSON-1993382796 None] /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-963e0cdd-7deb-44c0-a65c-77f9f354867e.d4aba804-3ec2-4561-991c-8ae212c51bd1 is being set with open permissions: ugo+rw Aug 29 01:19:45 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-4382fcd8-507e-4217-83b2-5bcd6ec38573 tempest-VolumesSnapshotListTestJSON-1993382796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-963e0cdd-7deb-44c0-a65c-77f9f354867e.d4aba804-3ec2-4561-991c-8ae212c51bd1 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:19:45 devstack sudo[97561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-963e0cdd-7deb-44c0-a65c-77f9f354867e.d4aba804-3ec2-4561-991c-8ae212c51bd1 Aug 29 01:19:45 devstack sudo[97561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:19:45 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-4382fcd8-507e-4217-83b2-5bcd6ec38573 tempest-VolumesSnapshotListTestJSON-1993382796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-963e0cdd-7deb-44c0-a65c-77f9f354867e.d4aba804-3ec2-4561-991c-8ae212c51bd1" returned: 0 in 0.315s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:19:45 devstack sudo[97561]: pam_unix(sudo:session): session closed for user root Aug 29 01:19:45 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-4382fcd8-507e-4217-83b2-5bcd6ec38573 tempest-VolumesSnapshotListTestJSON-1993382796 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.335s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:19:45 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-4382fcd8-507e-4217-83b2-5bcd6ec38573 tempest-VolumesSnapshotListTestJSON-1993382796 None] Create snapshot completed successfully Aug 29 01:19:48 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-d72f1b85-eb0c-42eb-b191-01a43b8993f4 tempest-VolumesSnapshotListTestJSON-1993382796 None] Acquiring lock "cinder-d4aba804-3ec2-4561-991c-8ae212c51bd1-delete_snapshot" by "delete_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:19:48 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-d72f1b85-eb0c-42eb-b191-01a43b8993f4 tempest-VolumesSnapshotListTestJSON-1993382796 None] Lock "cinder-d4aba804-3ec2-4561-991c-8ae212c51bd1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.058s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:19:48 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-d72f1b85-eb0c-42eb-b191-01a43b8993f4 tempest-VolumesSnapshotListTestJSON-1993382796 None] Acquiring lock "cinder-quobyte-963e0cdd-7deb-44c0-a65c-77f9f354867e" by "delete_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:19:48 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-d72f1b85-eb0c-42eb-b191-01a43b8993f4 tempest-VolumesSnapshotListTestJSON-1993382796 None] Lock "cinder-quobyte-963e0cdd-7deb-44c0-a65c-77f9f354867e" acquired by "delete_snapshot" :: waited 0.041s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:19:48 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-d72f1b85-eb0c-42eb-b191-01a43b8993f4 tempest-VolumesSnapshotListTestJSON-1993382796 None] Acquiring lock "cinder-quobyte-d4aba804-3ec2-4561-991c-8ae212c51bd1" by "_delete_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:19:48 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-d72f1b85-eb0c-42eb-b191-01a43b8993f4 tempest-VolumesSnapshotListTestJSON-1993382796 None] Lock "cinder-quobyte-d4aba804-3ec2-4561-991c-8ae212c51bd1" acquired by "_delete_snapshot" :: waited 0.045s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:19:48 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-d72f1b85-eb0c-42eb-b191-01a43b8993f4 tempest-VolumesSnapshotListTestJSON-1993382796 None] Deleting offline snapshot d4aba804-3ec2-4561-991c-8ae212c51bd1 of volume 963e0cdd-7deb-44c0-a65c-77f9f354867e {{(pid=86111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 29 01:19:48 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-d72f1b85-eb0c-42eb-b191-01a43b8993f4 tempest-VolumesSnapshotListTestJSON-1993382796 None] snapshot_file for this snap is: volume-963e0cdd-7deb-44c0-a65c-77f9f354867e.d4aba804-3ec2-4561-991c-8ae212c51bd1 {{(pid=86111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 29 01:19:48 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c1c3b85-4394-4730-87d5-deaf2d6e031a]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:19:48 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d72f1b85-eb0c-42eb-b191-01a43b8993f4 tempest-VolumesSnapshotListTestJSON-1993382796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-963e0cdd-7deb-44c0-a65c-77f9f354867e.d4aba804-3ec2-4561-991c-8ae212c51bd1 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:19:48 devstack sudo[97643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-963e0cdd-7deb-44c0-a65c-77f9f354867e.d4aba804-3ec2-4561-991c-8ae212c51bd1 Aug 29 01:19:48 devstack sudo[97643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:19:49 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-650eb1cf-caca-4c1c-9e8c-6f0756f8a563 tempest-VolumesTransfersTest-1723644807 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:19:49 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-650eb1cf-caca-4c1c-9e8c-6f0756f8a563 tempest-VolumesTransfersTest-1723644807 None] Flow 'volume_create_manager' (163f0a1f-57a6-4df3-a2f5-13895f3e2fca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:19:49 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-650eb1cf-caca-4c1c-9e8c-6f0756f8a563 tempest-VolumesTransfersTest-1723644807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6eaee07-d2e6-427d-964d-2284b7fa3405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:19:49 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-650eb1cf-caca-4c1c-9e8c-6f0756f8a563 tempest-VolumesTransfersTest-1723644807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6eaee07-d2e6-427d-964d-2284b7fa3405) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:19:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1674328181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43059ba0-c4da-4ee5-931f-544432f37831,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be5cf6234a7d41cfa3fe582523dc32b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:19:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:19:49Z,use_quota=True,user_id='db207dc18fd24d79a62a520811a5b671',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:19:49 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-650eb1cf-caca-4c1c-9e8c-6f0756f8a563 tempest-VolumesTransfersTest-1723644807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36838c78-f109-4474-bb33-a0e7710cacb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:19:49 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-650eb1cf-caca-4c1c-9e8c-6f0756f8a563 tempest-VolumesTransfersTest-1723644807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36838c78-f109-4474-bb33-a0e7710cacb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:19:49 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-650eb1cf-caca-4c1c-9e8c-6f0756f8a563 tempest-VolumesTransfersTest-1723644807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9af9a796-8017-440b-be6d-ad962ca0ec83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:19:49 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-650eb1cf-caca-4c1c-9e8c-6f0756f8a563 tempest-VolumesTransfersTest-1723644807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9af9a796-8017-440b-be6d-ad962ca0ec83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43059ba0-c4da-4ee5-931f-544432f37831', 'volume_name': 'volume-43059ba0-c4da-4ee5-931f-544432f37831', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:19:49 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-650eb1cf-caca-4c1c-9e8c-6f0756f8a563 tempest-VolumesTransfersTest-1723644807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0176ce44-f9fb-41d2-ae27-30efe035fa39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:19:49 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-650eb1cf-caca-4c1c-9e8c-6f0756f8a563 tempest-VolumesTransfersTest-1723644807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0176ce44-f9fb-41d2-ae27-30efe035fa39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:19:49 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-650eb1cf-caca-4c1c-9e8c-6f0756f8a563 tempest-VolumesTransfersTest-1723644807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5aaf67eb-8040-4600-8fbd-9a448f889879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:19:49 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-650eb1cf-caca-4c1c-9e8c-6f0756f8a563 tempest-VolumesTransfersTest-1723644807 None] Volume 43059ba0-c4da-4ee5-931f-544432f37831: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43059ba0-c4da-4ee5-931f-544432f37831', 'volume_size': 1} Aug 29 01:19:49 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-650eb1cf-caca-4c1c-9e8c-6f0756f8a563 tempest-VolumesTransfersTest-1723644807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:19:49 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-650eb1cf-caca-4c1c-9e8c-6f0756f8a563 tempest-VolumesTransfersTest-1723644807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:19:49 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-650eb1cf-caca-4c1c-9e8c-6f0756f8a563 tempest-VolumesTransfersTest-1723644807 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:19:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1674328181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43059ba0-c4da-4ee5-931f-544432f37831,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be5cf6234a7d41cfa3fe582523dc32b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:19:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:19:49Z,use_quota=True,user_id='db207dc18fd24d79a62a520811a5b671',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:19:49 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-650eb1cf-caca-4c1c-9e8c-6f0756f8a563 tempest-VolumesTransfersTest-1723644807 None] Creating volume 43059ba0-c4da-4ee5-931f-544432f37831 {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:19:49 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-650eb1cf-caca-4c1c-9e8c-6f0756f8a563 tempest-VolumesTransfersTest-1723644807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:19:49 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-650eb1cf-caca-4c1c-9e8c-6f0756f8a563 tempest-VolumesTransfersTest-1723644807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:19:49 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-650eb1cf-caca-4c1c-9e8c-6f0756f8a563 tempest-VolumesTransfersTest-1723644807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:19:49 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-650eb1cf-caca-4c1c-9e8c-6f0756f8a563 tempest-VolumesTransfersTest-1723644807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:19:49 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-650eb1cf-caca-4c1c-9e8c-6f0756f8a563 tempest-VolumesTransfersTest-1723644807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:19:49 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-650eb1cf-caca-4c1c-9e8c-6f0756f8a563 tempest-VolumesTransfersTest-1723644807 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:19:49 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-650eb1cf-caca-4c1c-9e8c-6f0756f8a563 tempest-VolumesTransfersTest-1723644807 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:19:49 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-650eb1cf-caca-4c1c-9e8c-6f0756f8a563 tempest-VolumesTransfersTest-1723644807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-43059ba0-c4da-4ee5-931f-544432f37831 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:19:49 devstack sudo[97650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-43059ba0-c4da-4ee5-931f-544432f37831 1073741824 Aug 29 01:19:49 devstack sudo[97650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:19:49 devstack sudo[97643]: pam_unix(sudo:session): session closed for user root Aug 29 01:19:49 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d72f1b85-eb0c-42eb-b191-01a43b8993f4 tempest-VolumesSnapshotListTestJSON-1993382796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-963e0cdd-7deb-44c0-a65c-77f9f354867e.d4aba804-3ec2-4561-991c-8ae212c51bd1" returned: 0 in 0.713s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:19:49 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-d72f1b85-eb0c-42eb-b191-01a43b8993f4 tempest-VolumesSnapshotListTestJSON-1993382796 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-963e0cdd-7deb-44c0-a65c-77f9f354867e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 29 01:19:49 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[60b27a94-75fe-42ef-869e-ead701679d6c]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:19:49 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d72f1b85-eb0c-42eb-b191-01a43b8993f4 tempest-VolumesSnapshotListTestJSON-1993382796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-963e0cdd-7deb-44c0-a65c-77f9f354867e.01f890c0-2205-417c-b458-7eb79d417d16 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:19:49 devstack sudo[97652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-963e0cdd-7deb-44c0-a65c-77f9f354867e.01f890c0-2205-417c-b458-7eb79d417d16 Aug 29 01:19:49 devstack sudo[97652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:19:50 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d72f1b85-eb0c-42eb-b191-01a43b8993f4 tempest-VolumesSnapshotListTestJSON-1993382796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-963e0cdd-7deb-44c0-a65c-77f9f354867e.01f890c0-2205-417c-b458-7eb79d417d16" returned: 0 in 0.562s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:19:50 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-d72f1b85-eb0c-42eb-b191-01a43b8993f4 tempest-VolumesSnapshotListTestJSON-1993382796 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-963e0cdd-7deb-44c0-a65c-77f9f354867e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 29 01:19:50 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d72f1b85-eb0c-42eb-b191-01a43b8993f4 tempest-VolumesSnapshotListTestJSON-1993382796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-963e0cdd-7deb-44c0-a65c-77f9f354867e.d4aba804-3ec2-4561-991c-8ae212c51bd1 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:19:50 devstack sudo[97652]: pam_unix(sudo:session): session closed for user root Aug 29 01:19:50 devstack sudo[97650]: pam_unix(sudo:session): session closed for user root Aug 29 01:19:50 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-650eb1cf-caca-4c1c-9e8c-6f0756f8a563 tempest-VolumesTransfersTest-1723644807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-43059ba0-c4da-4ee5-931f-544432f37831 1073741824" returned: 0 in 0.723s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:19:50 devstack sudo[97662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-963e0cdd-7deb-44c0-a65c-77f9f354867e.d4aba804-3ec2-4561-991c-8ae212c51bd1 Aug 29 01:19:50 devstack sudo[97662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:19:50 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-650eb1cf-caca-4c1c-9e8c-6f0756f8a563 tempest-VolumesTransfersTest-1723644807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-43059ba0-c4da-4ee5-931f-544432f37831 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:19:50 devstack sudo[97664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-43059ba0-c4da-4ee5-931f-544432f37831 Aug 29 01:19:50 devstack sudo[97664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:19:50 devstack sudo[97664]: pam_unix(sudo:session): session closed for user root Aug 29 01:19:50 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-650eb1cf-caca-4c1c-9e8c-6f0756f8a563 tempest-VolumesTransfersTest-1723644807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-43059ba0-c4da-4ee5-931f-544432f37831" returned: 0 in 0.578s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:19:50 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-650eb1cf-caca-4c1c-9e8c-6f0756f8a563 tempest-VolumesTransfersTest-1723644807 None] <== create_volume: return (1391ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:19:50 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-650eb1cf-caca-4c1c-9e8c-6f0756f8a563 tempest-VolumesTransfersTest-1723644807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.394s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:19:50 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-650eb1cf-caca-4c1c-9e8c-6f0756f8a563 tempest-VolumesTransfersTest-1723644807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5aaf67eb-8040-4600-8fbd-9a448f889879) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43059ba0-c4da-4ee5-931f-544432f37831', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:19:50 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-650eb1cf-caca-4c1c-9e8c-6f0756f8a563 tempest-VolumesTransfersTest-1723644807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ada436ce-01db-420c-8c36-ba5dbff1eb30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:19:50 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-650eb1cf-caca-4c1c-9e8c-6f0756f8a563 tempest-VolumesTransfersTest-1723644807 None] Volume volume-43059ba0-c4da-4ee5-931f-544432f37831 (43059ba0-c4da-4ee5-931f-544432f37831): created successfully Aug 29 01:19:50 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-650eb1cf-caca-4c1c-9e8c-6f0756f8a563 tempest-VolumesTransfersTest-1723644807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ada436ce-01db-420c-8c36-ba5dbff1eb30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:19:50 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-650eb1cf-caca-4c1c-9e8c-6f0756f8a563 tempest-VolumesTransfersTest-1723644807 None] Flow 'volume_create_manager' (163f0a1f-57a6-4df3-a2f5-13895f3e2fca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:19:50 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-650eb1cf-caca-4c1c-9e8c-6f0756f8a563 tempest-VolumesTransfersTest-1723644807 None] Created volume successfully. Aug 29 01:19:50 devstack sudo[97662]: pam_unix(sudo:session): session closed for user root Aug 29 01:19:50 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d72f1b85-eb0c-42eb-b191-01a43b8993f4 tempest-VolumesSnapshotListTestJSON-1993382796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-963e0cdd-7deb-44c0-a65c-77f9f354867e.d4aba804-3ec2-4561-991c-8ae212c51bd1" returned: 0 in 0.870s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:19:50 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d72f1b85-eb0c-42eb-b191-01a43b8993f4 tempest-VolumesSnapshotListTestJSON-1993382796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-963e0cdd-7deb-44c0-a65c-77f9f354867e.d4aba804-3ec2-4561-991c-8ae212c51bd1 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:19:50 devstack sudo[97670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-963e0cdd-7deb-44c0-a65c-77f9f354867e.d4aba804-3ec2-4561-991c-8ae212c51bd1 Aug 29 01:19:50 devstack sudo[97670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:19:51 devstack sudo[97670]: pam_unix(sudo:session): session closed for user root Aug 29 01:19:51 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d72f1b85-eb0c-42eb-b191-01a43b8993f4 tempest-VolumesSnapshotListTestJSON-1993382796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-963e0cdd-7deb-44c0-a65c-77f9f354867e.d4aba804-3ec2-4561-991c-8ae212c51bd1" returned: 0 in 0.343s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:19:51 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-d72f1b85-eb0c-42eb-b191-01a43b8993f4 tempest-VolumesSnapshotListTestJSON-1993382796 None] Lock "cinder-quobyte-d4aba804-3ec2-4561-991c-8ae212c51bd1" released by "_delete_snapshot" :: held 2.682s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:19:51 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-d72f1b85-eb0c-42eb-b191-01a43b8993f4 tempest-VolumesSnapshotListTestJSON-1993382796 None] Lock "cinder-quobyte-963e0cdd-7deb-44c0-a65c-77f9f354867e" released by "delete_snapshot" :: held 2.740s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:19:51 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-d72f1b85-eb0c-42eb-b191-01a43b8993f4 tempest-VolumesSnapshotListTestJSON-1993382796 None] Created reservations ['a48f265b-ea60-40d6-a92a-3b99fe411802', '50f79c49-1856-49ca-8e86-7278e9ada6f6', 'ed121700-ddc9-4cd2-87bd-1b67dd301a81', 'afde68f9-51d6-4a2f-9057-0bc85530276f'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:19:51 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-d72f1b85-eb0c-42eb-b191-01a43b8993f4 tempest-VolumesSnapshotListTestJSON-1993382796 None] Delete snapshot completed successfully. Aug 29 01:19:51 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-d72f1b85-eb0c-42eb-b191-01a43b8993f4 tempest-VolumesSnapshotListTestJSON-1993382796 None] Lock "cinder-d4aba804-3ec2-4561-991c-8ae212c51bd1-delete_snapshot" released by "delete_snapshot" :: held 2.989s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:19:51 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-2febcf56-bf42-46df-aa00-4381924d877c tempest-VolumesSnapshotListTestJSON-1993382796 None] Acquiring lock "cinder-01f890c0-2205-417c-b458-7eb79d417d16-delete_snapshot" by "delete_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:19:51 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-2febcf56-bf42-46df-aa00-4381924d877c tempest-VolumesSnapshotListTestJSON-1993382796 None] Lock "cinder-01f890c0-2205-417c-b458-7eb79d417d16-delete_snapshot" acquired by "delete_snapshot" :: waited 0.053s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:19:51 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-2febcf56-bf42-46df-aa00-4381924d877c tempest-VolumesSnapshotListTestJSON-1993382796 None] Acquiring lock "cinder-quobyte-963e0cdd-7deb-44c0-a65c-77f9f354867e" by "delete_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:19:52 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-2febcf56-bf42-46df-aa00-4381924d877c tempest-VolumesSnapshotListTestJSON-1993382796 None] Lock "cinder-quobyte-963e0cdd-7deb-44c0-a65c-77f9f354867e" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:19:52 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-2febcf56-bf42-46df-aa00-4381924d877c tempest-VolumesSnapshotListTestJSON-1993382796 None] Acquiring lock "cinder-quobyte-01f890c0-2205-417c-b458-7eb79d417d16" by "_delete_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:19:52 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-2febcf56-bf42-46df-aa00-4381924d877c tempest-VolumesSnapshotListTestJSON-1993382796 None] Lock "cinder-quobyte-01f890c0-2205-417c-b458-7eb79d417d16" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:19:52 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-2febcf56-bf42-46df-aa00-4381924d877c tempest-VolumesSnapshotListTestJSON-1993382796 None] Deleting offline snapshot 01f890c0-2205-417c-b458-7eb79d417d16 of volume 963e0cdd-7deb-44c0-a65c-77f9f354867e {{(pid=86111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 29 01:19:52 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-2febcf56-bf42-46df-aa00-4381924d877c tempest-VolumesSnapshotListTestJSON-1993382796 None] snapshot_file for this snap is: volume-963e0cdd-7deb-44c0-a65c-77f9f354867e.01f890c0-2205-417c-b458-7eb79d417d16 {{(pid=86111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 29 01:19:52 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fd4fa7d-74ba-4b2b-86fe-e1fa97aedd6b]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:19:52 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-2febcf56-bf42-46df-aa00-4381924d877c tempest-VolumesSnapshotListTestJSON-1993382796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-963e0cdd-7deb-44c0-a65c-77f9f354867e.01f890c0-2205-417c-b458-7eb79d417d16 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:19:52 devstack sudo[97675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-963e0cdd-7deb-44c0-a65c-77f9f354867e.01f890c0-2205-417c-b458-7eb79d417d16 Aug 29 01:19:52 devstack sudo[97675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:19:52 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-7c4e6698-6d88-440c-87b4-40d98d56d94c tempest-VolumesTransfersTest-153382739 None] Transfer volume completed successfully. Aug 29 01:19:52 devstack sudo[97675]: pam_unix(sudo:session): session closed for user root Aug 29 01:19:52 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-2febcf56-bf42-46df-aa00-4381924d877c tempest-VolumesSnapshotListTestJSON-1993382796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-963e0cdd-7deb-44c0-a65c-77f9f354867e.01f890c0-2205-417c-b458-7eb79d417d16" returned: 0 in 0.727s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:19:52 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-2febcf56-bf42-46df-aa00-4381924d877c tempest-VolumesSnapshotListTestJSON-1993382796 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-963e0cdd-7deb-44c0-a65c-77f9f354867e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 29 01:19:52 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4dbbdd6-7d27-4678-b133-3ebb34231fa6]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:19:52 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-2febcf56-bf42-46df-aa00-4381924d877c tempest-VolumesSnapshotListTestJSON-1993382796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-963e0cdd-7deb-44c0-a65c-77f9f354867e.26553ede-1493-4e4c-9937-742f27592aa7 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:19:53 devstack sudo[97681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-963e0cdd-7deb-44c0-a65c-77f9f354867e.26553ede-1493-4e4c-9937-742f27592aa7 Aug 29 01:19:53 devstack sudo[97681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:19:53 devstack sudo[97681]: pam_unix(sudo:session): session closed for user root Aug 29 01:19:53 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-2febcf56-bf42-46df-aa00-4381924d877c tempest-VolumesSnapshotListTestJSON-1993382796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-963e0cdd-7deb-44c0-a65c-77f9f354867e.26553ede-1493-4e4c-9937-742f27592aa7" returned: 0 in 0.594s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:19:53 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-2febcf56-bf42-46df-aa00-4381924d877c tempest-VolumesSnapshotListTestJSON-1993382796 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-963e0cdd-7deb-44c0-a65c-77f9f354867e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 29 01:19:53 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-2febcf56-bf42-46df-aa00-4381924d877c tempest-VolumesSnapshotListTestJSON-1993382796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-963e0cdd-7deb-44c0-a65c-77f9f354867e.01f890c0-2205-417c-b458-7eb79d417d16 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:19:53 devstack sudo[97686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-963e0cdd-7deb-44c0-a65c-77f9f354867e.01f890c0-2205-417c-b458-7eb79d417d16 Aug 29 01:19:53 devstack sudo[97686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:19:53 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-10e3fc5d-559d-4dc5-a690-c07a51a14793 tempest-VolumesTransfersTest-1472801321 None] Acquiring lock "cinder-43059ba0-c4da-4ee5-931f-544432f37831-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:19:53 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-10e3fc5d-559d-4dc5-a690-c07a51a14793 tempest-VolumesTransfersTest-1472801321 None] Lock "cinder-43059ba0-c4da-4ee5-931f-544432f37831-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:19:53 devstack cinder-volume[86111]: DEBUG dbcounter [-] [86111] Writing DB stats cinder:SELECT=136,cinder:INSERT=34,cinder:UPDATE=140,cinder:DELETE=8 {{(pid=86111) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 29 01:19:53 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-10e3fc5d-559d-4dc5-a690-c07a51a14793 tempest-VolumesTransfersTest-1472801321 None] Acquiring lock "cinder-quobyte-43059ba0-c4da-4ee5-931f-544432f37831" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:19:53 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-10e3fc5d-559d-4dc5-a690-c07a51a14793 tempest-VolumesTransfersTest-1472801321 None] Lock "cinder-quobyte-43059ba0-c4da-4ee5-931f-544432f37831" acquired by "delete_volume" :: waited 0.024s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:19:53 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[d05ca414-a3a0-4099-b016-b052ab3cc14d]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:19:53 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-10e3fc5d-559d-4dc5-a690-c07a51a14793 tempest-VolumesTransfersTest-1472801321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-43059ba0-c4da-4ee5-931f-544432f37831 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:19:53 devstack sudo[97691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-43059ba0-c4da-4ee5-931f-544432f37831 Aug 29 01:19:53 devstack sudo[97691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:19:53 devstack sudo[97686]: pam_unix(sudo:session): session closed for user root Aug 29 01:19:53 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-2febcf56-bf42-46df-aa00-4381924d877c tempest-VolumesSnapshotListTestJSON-1993382796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-963e0cdd-7deb-44c0-a65c-77f9f354867e.01f890c0-2205-417c-b458-7eb79d417d16" returned: 0 in 0.496s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:19:53 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-2febcf56-bf42-46df-aa00-4381924d877c tempest-VolumesSnapshotListTestJSON-1993382796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-963e0cdd-7deb-44c0-a65c-77f9f354867e.01f890c0-2205-417c-b458-7eb79d417d16 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:19:54 devstack sudo[97694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-963e0cdd-7deb-44c0-a65c-77f9f354867e.01f890c0-2205-417c-b458-7eb79d417d16 Aug 29 01:19:54 devstack sudo[97694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:19:54 devstack sudo[97691]: pam_unix(sudo:session): session closed for user root Aug 29 01:19:54 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-10e3fc5d-559d-4dc5-a690-c07a51a14793 tempest-VolumesTransfersTest-1472801321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-43059ba0-c4da-4ee5-931f-544432f37831" returned: 0 in 0.525s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:19:54 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-10e3fc5d-559d-4dc5-a690-c07a51a14793 tempest-VolumesTransfersTest-1472801321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-43059ba0-c4da-4ee5-931f-544432f37831 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:19:54 devstack sudo[97694]: pam_unix(sudo:session): session closed for user root Aug 29 01:19:54 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-2febcf56-bf42-46df-aa00-4381924d877c tempest-VolumesSnapshotListTestJSON-1993382796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-963e0cdd-7deb-44c0-a65c-77f9f354867e.01f890c0-2205-417c-b458-7eb79d417d16" returned: 0 in 0.356s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:19:54 devstack sudo[97700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-43059ba0-c4da-4ee5-931f-544432f37831 Aug 29 01:19:54 devstack sudo[97700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:19:54 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-2febcf56-bf42-46df-aa00-4381924d877c tempest-VolumesSnapshotListTestJSON-1993382796 None] Lock "cinder-quobyte-01f890c0-2205-417c-b458-7eb79d417d16" released by "_delete_snapshot" :: held 2.353s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:19:54 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-2febcf56-bf42-46df-aa00-4381924d877c tempest-VolumesSnapshotListTestJSON-1993382796 None] Lock "cinder-quobyte-963e0cdd-7deb-44c0-a65c-77f9f354867e" released by "delete_snapshot" :: held 2.386s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:19:54 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-2febcf56-bf42-46df-aa00-4381924d877c tempest-VolumesSnapshotListTestJSON-1993382796 None] Created reservations ['a75bd54a-5b0f-4774-907d-3004fe83439f', '0ed1acd2-5b02-4a68-a2ac-ac37cc633664', '5273547d-3d3a-40ad-b7c7-c8d68ab0c022', 'aec82655-8d1d-4ee6-91b3-7cb80298e905'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:19:54 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-2febcf56-bf42-46df-aa00-4381924d877c tempest-VolumesSnapshotListTestJSON-1993382796 None] Delete snapshot completed successfully. Aug 29 01:19:54 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-2febcf56-bf42-46df-aa00-4381924d877c tempest-VolumesSnapshotListTestJSON-1993382796 None] Lock "cinder-01f890c0-2205-417c-b458-7eb79d417d16-delete_snapshot" released by "delete_snapshot" :: held 2.596s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:19:54 devstack sudo[97700]: pam_unix(sudo:session): session closed for user root Aug 29 01:19:54 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-10e3fc5d-559d-4dc5-a690-c07a51a14793 tempest-VolumesTransfersTest-1472801321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-43059ba0-c4da-4ee5-931f-544432f37831" returned: 0 in 0.326s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:19:54 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-10e3fc5d-559d-4dc5-a690-c07a51a14793 tempest-VolumesTransfersTest-1472801321 None] Lock "cinder-quobyte-43059ba0-c4da-4ee5-931f-544432f37831" released by "delete_volume" :: held 0.894s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:19:54 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-10e3fc5d-559d-4dc5-a690-c07a51a14793 tempest-VolumesTransfersTest-1472801321 None] Created reservations ['f7c2bf84-8e0f-42e5-816b-cee21e4b2903', '144c3a02-a77b-4b7f-b67f-8b7987b25a3b', 'c068681e-2f49-4e9d-83f0-b99a780d008c', '34f437e9-d83f-485a-a1a7-f5fbc83f4a9e'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:19:54 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-10e3fc5d-559d-4dc5-a690-c07a51a14793 tempest-VolumesTransfersTest-1472801321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:19:54 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-10e3fc5d-559d-4dc5-a690-c07a51a14793 tempest-VolumesTransfersTest-1472801321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:19:54 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-10e3fc5d-559d-4dc5-a690-c07a51a14793 tempest-VolumesTransfersTest-1472801321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:19:54 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-10e3fc5d-559d-4dc5-a690-c07a51a14793 tempest-VolumesTransfersTest-1472801321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:19:54 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-10e3fc5d-559d-4dc5-a690-c07a51a14793 tempest-VolumesTransfersTest-1472801321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:19:54 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-10e3fc5d-559d-4dc5-a690-c07a51a14793 tempest-VolumesTransfersTest-1472801321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:19:54 devstack sudo[97703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:19:54 devstack sudo[97703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:19:55 devstack sudo[97703]: pam_unix(sudo:session): session closed for user root Aug 29 01:19:55 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-10e3fc5d-559d-4dc5-a690-c07a51a14793 tempest-VolumesTransfersTest-1472801321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.421s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:19:55 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-10e3fc5d-559d-4dc5-a690-c07a51a14793 tempest-VolumesTransfersTest-1472801321 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:19:55 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-076577f9-038e-42f4-9c64-8158f39c8863 tempest-VolumesSnapshotListTestJSON-1993382796 None] Acquiring lock "cinder-26553ede-1493-4e4c-9937-742f27592aa7-delete_snapshot" by "delete_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:19:55 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-10e3fc5d-559d-4dc5-a690-c07a51a14793 tempest-VolumesTransfersTest-1472801321 None] Deleted volume successfully. Aug 29 01:19:55 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-076577f9-038e-42f4-9c64-8158f39c8863 tempest-VolumesSnapshotListTestJSON-1993382796 None] Lock "cinder-26553ede-1493-4e4c-9937-742f27592aa7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.060s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:19:55 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-076577f9-038e-42f4-9c64-8158f39c8863 tempest-VolumesSnapshotListTestJSON-1993382796 None] Acquiring lock "cinder-quobyte-963e0cdd-7deb-44c0-a65c-77f9f354867e" by "delete_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:19:55 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-10e3fc5d-559d-4dc5-a690-c07a51a14793 tempest-VolumesTransfersTest-1472801321 None] Lock "cinder-43059ba0-c4da-4ee5-931f-544432f37831-delete_volume" released by "delete_volume" :: held 1.667s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:19:55 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-076577f9-038e-42f4-9c64-8158f39c8863 tempest-VolumesSnapshotListTestJSON-1993382796 None] Lock "cinder-quobyte-963e0cdd-7deb-44c0-a65c-77f9f354867e" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:19:55 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-076577f9-038e-42f4-9c64-8158f39c8863 tempest-VolumesSnapshotListTestJSON-1993382796 None] Acquiring lock "cinder-quobyte-26553ede-1493-4e4c-9937-742f27592aa7" by "_delete_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:19:55 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-076577f9-038e-42f4-9c64-8158f39c8863 tempest-VolumesSnapshotListTestJSON-1993382796 None] Lock "cinder-quobyte-26553ede-1493-4e4c-9937-742f27592aa7" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:19:55 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-076577f9-038e-42f4-9c64-8158f39c8863 tempest-VolumesSnapshotListTestJSON-1993382796 None] Deleting offline snapshot 26553ede-1493-4e4c-9937-742f27592aa7 of volume 963e0cdd-7deb-44c0-a65c-77f9f354867e {{(pid=86111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 29 01:19:55 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-076577f9-038e-42f4-9c64-8158f39c8863 tempest-VolumesSnapshotListTestJSON-1993382796 None] snapshot_file for this snap is: volume-963e0cdd-7deb-44c0-a65c-77f9f354867e.26553ede-1493-4e4c-9937-742f27592aa7 {{(pid=86111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 29 01:19:55 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[83722bf5-78ec-4f82-98ae-692a08a5bc1d]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:19:55 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-076577f9-038e-42f4-9c64-8158f39c8863 tempest-VolumesSnapshotListTestJSON-1993382796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-963e0cdd-7deb-44c0-a65c-77f9f354867e.26553ede-1493-4e4c-9937-742f27592aa7 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:19:55 devstack sudo[97706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-963e0cdd-7deb-44c0-a65c-77f9f354867e.26553ede-1493-4e4c-9937-742f27592aa7 Aug 29 01:19:55 devstack sudo[97706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:19:55 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f266ab1-dcf3-43c5-8403-b6f9d0161dc7 tempest-VolumesTransfersTest-1723644807 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:19:55 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-1f266ab1-dcf3-43c5-8403-b6f9d0161dc7 tempest-VolumesTransfersTest-1723644807 None] Flow 'volume_create_manager' (567408c8-589d-41c1-83a1-e1dbdf469c14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:19:55 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-1f266ab1-dcf3-43c5-8403-b6f9d0161dc7 tempest-VolumesTransfersTest-1723644807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d6fcca9-8dec-4713-92f9-1410a04a797f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:19:55 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-1f266ab1-dcf3-43c5-8403-b6f9d0161dc7 tempest-VolumesTransfersTest-1723644807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d6fcca9-8dec-4713-92f9-1410a04a797f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:19:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-819100696',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f017b3b-6b1a-4868-bd7e-01f675f44b83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be5cf6234a7d41cfa3fe582523dc32b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:19:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:19:56Z,use_quota=True,user_id='db207dc18fd24d79a62a520811a5b671',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:19:55 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-1f266ab1-dcf3-43c5-8403-b6f9d0161dc7 tempest-VolumesTransfersTest-1723644807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a104ccd-c576-431e-aa3b-d911ffc4c047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:19:55 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-1f266ab1-dcf3-43c5-8403-b6f9d0161dc7 tempest-VolumesTransfersTest-1723644807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a104ccd-c576-431e-aa3b-d911ffc4c047) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:19:55 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-1f266ab1-dcf3-43c5-8403-b6f9d0161dc7 tempest-VolumesTransfersTest-1723644807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3cd8642-d7e4-4850-93b0-fde1c0728852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:19:55 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-1f266ab1-dcf3-43c5-8403-b6f9d0161dc7 tempest-VolumesTransfersTest-1723644807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3cd8642-d7e4-4850-93b0-fde1c0728852) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f017b3b-6b1a-4868-bd7e-01f675f44b83', 'volume_name': 'volume-4f017b3b-6b1a-4868-bd7e-01f675f44b83', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:19:55 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-1f266ab1-dcf3-43c5-8403-b6f9d0161dc7 tempest-VolumesTransfersTest-1723644807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1124a6c-aaae-451a-9407-b9866268de31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:19:55 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-1f266ab1-dcf3-43c5-8403-b6f9d0161dc7 tempest-VolumesTransfersTest-1723644807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1124a6c-aaae-451a-9407-b9866268de31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:19:55 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-1f266ab1-dcf3-43c5-8403-b6f9d0161dc7 tempest-VolumesTransfersTest-1723644807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f9ba045-9645-4162-9b30-694d11a551e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:19:55 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-1f266ab1-dcf3-43c5-8403-b6f9d0161dc7 tempest-VolumesTransfersTest-1723644807 None] Volume 4f017b3b-6b1a-4868-bd7e-01f675f44b83: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f017b3b-6b1a-4868-bd7e-01f675f44b83', 'volume_size': 1} Aug 29 01:19:55 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-1f266ab1-dcf3-43c5-8403-b6f9d0161dc7 tempest-VolumesTransfersTest-1723644807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:19:55 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-1f266ab1-dcf3-43c5-8403-b6f9d0161dc7 tempest-VolumesTransfersTest-1723644807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:19:55 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-1f266ab1-dcf3-43c5-8403-b6f9d0161dc7 tempest-VolumesTransfersTest-1723644807 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:19:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-819100696',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f017b3b-6b1a-4868-bd7e-01f675f44b83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be5cf6234a7d41cfa3fe582523dc32b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:19:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:19:56Z,use_quota=True,user_id='db207dc18fd24d79a62a520811a5b671',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:19:55 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-1f266ab1-dcf3-43c5-8403-b6f9d0161dc7 tempest-VolumesTransfersTest-1723644807 None] Creating volume 4f017b3b-6b1a-4868-bd7e-01f675f44b83 {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:19:55 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-1f266ab1-dcf3-43c5-8403-b6f9d0161dc7 tempest-VolumesTransfersTest-1723644807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:19:55 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-1f266ab1-dcf3-43c5-8403-b6f9d0161dc7 tempest-VolumesTransfersTest-1723644807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:19:55 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-1f266ab1-dcf3-43c5-8403-b6f9d0161dc7 tempest-VolumesTransfersTest-1723644807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:19:55 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-1f266ab1-dcf3-43c5-8403-b6f9d0161dc7 tempest-VolumesTransfersTest-1723644807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:19:55 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-1f266ab1-dcf3-43c5-8403-b6f9d0161dc7 tempest-VolumesTransfersTest-1723644807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:19:55 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-1f266ab1-dcf3-43c5-8403-b6f9d0161dc7 tempest-VolumesTransfersTest-1723644807 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:19:55 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-1f266ab1-dcf3-43c5-8403-b6f9d0161dc7 tempest-VolumesTransfersTest-1723644807 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:19:55 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-1f266ab1-dcf3-43c5-8403-b6f9d0161dc7 tempest-VolumesTransfersTest-1723644807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-4f017b3b-6b1a-4868-bd7e-01f675f44b83 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:19:55 devstack sudo[97709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-4f017b3b-6b1a-4868-bd7e-01f675f44b83 1073741824 Aug 29 01:19:55 devstack sudo[97709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:19:55 devstack sudo[97706]: pam_unix(sudo:session): session closed for user root Aug 29 01:19:55 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-076577f9-038e-42f4-9c64-8158f39c8863 tempest-VolumesSnapshotListTestJSON-1993382796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-963e0cdd-7deb-44c0-a65c-77f9f354867e.26553ede-1493-4e4c-9937-742f27592aa7" returned: 0 in 0.474s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:19:55 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-076577f9-038e-42f4-9c64-8158f39c8863 tempest-VolumesSnapshotListTestJSON-1993382796 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-963e0cdd-7deb-44c0-a65c-77f9f354867e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 29 01:19:55 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[b350b5ec-8ea4-49c1-8ad1-814cf5886e66]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:19:55 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-076577f9-038e-42f4-9c64-8158f39c8863 tempest-VolumesSnapshotListTestJSON-1993382796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-963e0cdd-7deb-44c0-a65c-77f9f354867e {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:19:56 devstack sudo[97714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-963e0cdd-7deb-44c0-a65c-77f9f354867e Aug 29 01:19:56 devstack sudo[97714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:19:56 devstack sudo[97709]: pam_unix(sudo:session): session closed for user root Aug 29 01:19:56 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-1f266ab1-dcf3-43c5-8403-b6f9d0161dc7 tempest-VolumesTransfersTest-1723644807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-4f017b3b-6b1a-4868-bd7e-01f675f44b83 1073741824" returned: 0 in 0.572s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:19:56 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-1f266ab1-dcf3-43c5-8403-b6f9d0161dc7 tempest-VolumesTransfersTest-1723644807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-4f017b3b-6b1a-4868-bd7e-01f675f44b83 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:19:56 devstack sudo[97722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-4f017b3b-6b1a-4868-bd7e-01f675f44b83 Aug 29 01:19:56 devstack sudo[97722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:19:56 devstack sudo[97714]: pam_unix(sudo:session): session closed for user root Aug 29 01:19:56 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-076577f9-038e-42f4-9c64-8158f39c8863 tempest-VolumesSnapshotListTestJSON-1993382796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-963e0cdd-7deb-44c0-a65c-77f9f354867e" returned: 0 in 0.589s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:19:56 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-076577f9-038e-42f4-9c64-8158f39c8863 tempest-VolumesSnapshotListTestJSON-1993382796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-963e0cdd-7deb-44c0-a65c-77f9f354867e.26553ede-1493-4e4c-9937-742f27592aa7 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:19:56 devstack sudo[97726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-963e0cdd-7deb-44c0-a65c-77f9f354867e.26553ede-1493-4e4c-9937-742f27592aa7 Aug 29 01:19:56 devstack sudo[97726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:19:56 devstack sudo[97722]: pam_unix(sudo:session): session closed for user root Aug 29 01:19:56 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-1f266ab1-dcf3-43c5-8403-b6f9d0161dc7 tempest-VolumesTransfersTest-1723644807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-4f017b3b-6b1a-4868-bd7e-01f675f44b83" returned: 0 in 0.329s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:19:56 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-1f266ab1-dcf3-43c5-8403-b6f9d0161dc7 tempest-VolumesTransfersTest-1723644807 None] <== create_volume: return (966ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:19:56 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-1f266ab1-dcf3-43c5-8403-b6f9d0161dc7 tempest-VolumesTransfersTest-1723644807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.978s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:19:56 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-1f266ab1-dcf3-43c5-8403-b6f9d0161dc7 tempest-VolumesTransfersTest-1723644807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f9ba045-9645-4162-9b30-694d11a551e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f017b3b-6b1a-4868-bd7e-01f675f44b83', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:19:56 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-1f266ab1-dcf3-43c5-8403-b6f9d0161dc7 tempest-VolumesTransfersTest-1723644807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79ecd46a-b2c9-4551-a5ad-b24c0717b841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:19:56 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-1f266ab1-dcf3-43c5-8403-b6f9d0161dc7 tempest-VolumesTransfersTest-1723644807 None] Volume volume-4f017b3b-6b1a-4868-bd7e-01f675f44b83 (4f017b3b-6b1a-4868-bd7e-01f675f44b83): created successfully Aug 29 01:19:56 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-1f266ab1-dcf3-43c5-8403-b6f9d0161dc7 tempest-VolumesTransfersTest-1723644807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79ecd46a-b2c9-4551-a5ad-b24c0717b841) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:19:56 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-1f266ab1-dcf3-43c5-8403-b6f9d0161dc7 tempest-VolumesTransfersTest-1723644807 None] Flow 'volume_create_manager' (567408c8-589d-41c1-83a1-e1dbdf469c14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:19:56 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-1f266ab1-dcf3-43c5-8403-b6f9d0161dc7 tempest-VolumesTransfersTest-1723644807 None] Created volume successfully. Aug 29 01:19:56 devstack sudo[97726]: pam_unix(sudo:session): session closed for user root Aug 29 01:19:56 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-076577f9-038e-42f4-9c64-8158f39c8863 tempest-VolumesSnapshotListTestJSON-1993382796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-963e0cdd-7deb-44c0-a65c-77f9f354867e.26553ede-1493-4e4c-9937-742f27592aa7" returned: 0 in 0.400s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:19:56 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-076577f9-038e-42f4-9c64-8158f39c8863 tempest-VolumesSnapshotListTestJSON-1993382796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-963e0cdd-7deb-44c0-a65c-77f9f354867e.26553ede-1493-4e4c-9937-742f27592aa7 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:19:56 devstack sudo[97732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-963e0cdd-7deb-44c0-a65c-77f9f354867e.26553ede-1493-4e4c-9937-742f27592aa7 Aug 29 01:19:56 devstack sudo[97732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:19:57 devstack sudo[97732]: pam_unix(sudo:session): session closed for user root Aug 29 01:19:57 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-076577f9-038e-42f4-9c64-8158f39c8863 tempest-VolumesSnapshotListTestJSON-1993382796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-963e0cdd-7deb-44c0-a65c-77f9f354867e.26553ede-1493-4e4c-9937-742f27592aa7" returned: 0 in 0.295s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:19:57 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-076577f9-038e-42f4-9c64-8158f39c8863 tempest-VolumesSnapshotListTestJSON-1993382796 None] Lock "cinder-quobyte-26553ede-1493-4e4c-9937-742f27592aa7" released by "_delete_snapshot" :: held 1.910s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:19:57 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-076577f9-038e-42f4-9c64-8158f39c8863 tempest-VolumesSnapshotListTestJSON-1993382796 None] Lock "cinder-quobyte-963e0cdd-7deb-44c0-a65c-77f9f354867e" released by "delete_snapshot" :: held 1.958s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:19:57 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-076577f9-038e-42f4-9c64-8158f39c8863 tempest-VolumesSnapshotListTestJSON-1993382796 None] Created reservations ['1cea9a17-06a5-488e-becd-08015725c9f9', '50ed679e-581b-4a7c-ba63-f5410a1c5e6d', '512a7293-148b-408e-9549-13a630a748c7', 'eaccc012-f64d-4ccd-a059-cf5fe77b8c12'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:19:57 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-076577f9-038e-42f4-9c64-8158f39c8863 tempest-VolumesSnapshotListTestJSON-1993382796 None] Delete snapshot completed successfully. Aug 29 01:19:57 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-076577f9-038e-42f4-9c64-8158f39c8863 tempest-VolumesSnapshotListTestJSON-1993382796 None] Lock "cinder-26553ede-1493-4e4c-9937-742f27592aa7-delete_snapshot" released by "delete_snapshot" :: held 2.159s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:19:58 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-48808aaf-6b01-4499-b135-29dfe994be66 tempest-VolumesTransfersTest-1472801321 None] Acquiring lock "cinder-4f017b3b-6b1a-4868-bd7e-01f675f44b83-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:19:58 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-48808aaf-6b01-4499-b135-29dfe994be66 tempest-VolumesTransfersTest-1472801321 None] Lock "cinder-4f017b3b-6b1a-4868-bd7e-01f675f44b83-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:19:58 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-48808aaf-6b01-4499-b135-29dfe994be66 tempest-VolumesTransfersTest-1472801321 None] Acquiring lock "cinder-quobyte-4f017b3b-6b1a-4868-bd7e-01f675f44b83" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:19:58 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-48808aaf-6b01-4499-b135-29dfe994be66 tempest-VolumesTransfersTest-1472801321 None] Lock "cinder-quobyte-4f017b3b-6b1a-4868-bd7e-01f675f44b83" acquired by "delete_volume" :: waited 0.026s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:19:58 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c832c10-42a1-447e-891d-dc2be08b0640]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:19:58 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-48808aaf-6b01-4499-b135-29dfe994be66 tempest-VolumesTransfersTest-1472801321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-4f017b3b-6b1a-4868-bd7e-01f675f44b83 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:19:58 devstack sudo[97735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-4f017b3b-6b1a-4868-bd7e-01f675f44b83 Aug 29 01:19:58 devstack sudo[97735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:19:58 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-cbec0341-da32-4aa6-9823-6585e221c841 tempest-VolumesSnapshotListTestJSON-1993382796 None] Acquiring lock "cinder-963e0cdd-7deb-44c0-a65c-77f9f354867e-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:19:58 devstack sudo[97735]: pam_unix(sudo:session): session closed for user root Aug 29 01:19:58 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-48808aaf-6b01-4499-b135-29dfe994be66 tempest-VolumesTransfersTest-1472801321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-4f017b3b-6b1a-4868-bd7e-01f675f44b83" returned: 0 in 0.434s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:19:58 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-48808aaf-6b01-4499-b135-29dfe994be66 tempest-VolumesTransfersTest-1472801321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-4f017b3b-6b1a-4868-bd7e-01f675f44b83 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:19:58 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-cbec0341-da32-4aa6-9823-6585e221c841 tempest-VolumesSnapshotListTestJSON-1993382796 None] Lock "cinder-963e0cdd-7deb-44c0-a65c-77f9f354867e-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:19:58 devstack sudo[97740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-4f017b3b-6b1a-4868-bd7e-01f675f44b83 Aug 29 01:19:58 devstack sudo[97740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:19:58 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-cbec0341-da32-4aa6-9823-6585e221c841 tempest-VolumesSnapshotListTestJSON-1993382796 None] Acquiring lock "cinder-quobyte-963e0cdd-7deb-44c0-a65c-77f9f354867e" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:19:58 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-cbec0341-da32-4aa6-9823-6585e221c841 tempest-VolumesSnapshotListTestJSON-1993382796 None] Lock "cinder-quobyte-963e0cdd-7deb-44c0-a65c-77f9f354867e" acquired by "delete_volume" :: waited 0.020s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:19:58 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[1315f804-bfd4-49cc-a960-d83ab01af421]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:19:58 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-cbec0341-da32-4aa6-9823-6585e221c841 tempest-VolumesSnapshotListTestJSON-1993382796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-963e0cdd-7deb-44c0-a65c-77f9f354867e {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:19:58 devstack sudo[97742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-963e0cdd-7deb-44c0-a65c-77f9f354867e Aug 29 01:19:58 devstack sudo[97742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:19:59 devstack sudo[97740]: pam_unix(sudo:session): session closed for user root Aug 29 01:19:59 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-48808aaf-6b01-4499-b135-29dfe994be66 tempest-VolumesTransfersTest-1472801321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-4f017b3b-6b1a-4868-bd7e-01f675f44b83" returned: 0 in 0.358s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:19:59 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-48808aaf-6b01-4499-b135-29dfe994be66 tempest-VolumesTransfersTest-1472801321 None] Lock "cinder-quobyte-4f017b3b-6b1a-4868-bd7e-01f675f44b83" released by "delete_volume" :: held 0.854s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:19:59 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-48808aaf-6b01-4499-b135-29dfe994be66 tempest-VolumesTransfersTest-1472801321 None] Created reservations ['2ce3309e-0b2c-4cb2-ad6a-5dde9f91e99d', 'f1c69aa5-cf2d-4aa9-826e-6e4172f0262e', '2cb6887e-8992-4729-8857-5904d263c67a', '0959eb00-a0f1-4af4-82ba-e25248ea1fea'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:19:59 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-48808aaf-6b01-4499-b135-29dfe994be66 tempest-VolumesTransfersTest-1472801321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:19:59 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-48808aaf-6b01-4499-b135-29dfe994be66 tempest-VolumesTransfersTest-1472801321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:19:59 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-48808aaf-6b01-4499-b135-29dfe994be66 tempest-VolumesTransfersTest-1472801321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:19:59 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-48808aaf-6b01-4499-b135-29dfe994be66 tempest-VolumesTransfersTest-1472801321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:19:59 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-48808aaf-6b01-4499-b135-29dfe994be66 tempest-VolumesTransfersTest-1472801321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:19:59 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-48808aaf-6b01-4499-b135-29dfe994be66 tempest-VolumesTransfersTest-1472801321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:19:59 devstack sudo[97749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:19:59 devstack sudo[97749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:19:59 devstack sudo[97742]: pam_unix(sudo:session): session closed for user root Aug 29 01:19:59 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-cbec0341-da32-4aa6-9823-6585e221c841 tempest-VolumesSnapshotListTestJSON-1993382796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-963e0cdd-7deb-44c0-a65c-77f9f354867e" returned: 0 in 0.596s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:19:59 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-cbec0341-da32-4aa6-9823-6585e221c841 tempest-VolumesSnapshotListTestJSON-1993382796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-963e0cdd-7deb-44c0-a65c-77f9f354867e {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:19:59 devstack sudo[97751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-963e0cdd-7deb-44c0-a65c-77f9f354867e Aug 29 01:19:59 devstack sudo[97751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:19:59 devstack sudo[97751]: pam_unix(sudo:session): session closed for user root Aug 29 01:19:59 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-cbec0341-da32-4aa6-9823-6585e221c841 tempest-VolumesSnapshotListTestJSON-1993382796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-963e0cdd-7deb-44c0-a65c-77f9f354867e" returned: 0 in 0.392s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:19:59 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-cbec0341-da32-4aa6-9823-6585e221c841 tempest-VolumesSnapshotListTestJSON-1993382796 None] Lock "cinder-quobyte-963e0cdd-7deb-44c0-a65c-77f9f354867e" released by "delete_volume" :: held 1.069s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:19:59 devstack sudo[97749]: pam_unix(sudo:session): session closed for user root Aug 29 01:19:59 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-48808aaf-6b01-4499-b135-29dfe994be66 tempest-VolumesTransfersTest-1472801321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.520s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:19:59 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-48808aaf-6b01-4499-b135-29dfe994be66 tempest-VolumesTransfersTest-1472801321 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:19:59 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-48808aaf-6b01-4499-b135-29dfe994be66 tempest-VolumesTransfersTest-1472801321 None] Deleted volume successfully. Aug 29 01:19:59 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-48808aaf-6b01-4499-b135-29dfe994be66 tempest-VolumesTransfersTest-1472801321 None] Lock "cinder-4f017b3b-6b1a-4868-bd7e-01f675f44b83-delete_volume" released by "delete_volume" :: held 1.831s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:19:59 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-cbec0341-da32-4aa6-9823-6585e221c841 tempest-VolumesSnapshotListTestJSON-1993382796 None] Created reservations ['ef7f2c5c-d7bf-4bda-8739-e68d7ec278b2', '954e29e6-eb2c-4481-bc3a-6e7de04cdc6b', 'e0daf14d-3437-42f7-a281-fce72ded2584', '3abe0044-afc0-4110-8802-6674c81ed8ab'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:20:00 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-cbec0341-da32-4aa6-9823-6585e221c841 tempest-VolumesSnapshotListTestJSON-1993382796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:20:00 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-cbec0341-da32-4aa6-9823-6585e221c841 tempest-VolumesSnapshotListTestJSON-1993382796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:20:00 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-cbec0341-da32-4aa6-9823-6585e221c841 tempest-VolumesSnapshotListTestJSON-1993382796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:20:00 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-cbec0341-da32-4aa6-9823-6585e221c841 tempest-VolumesSnapshotListTestJSON-1993382796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:20:00 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-cbec0341-da32-4aa6-9823-6585e221c841 tempest-VolumesSnapshotListTestJSON-1993382796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:20:00 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-cbec0341-da32-4aa6-9823-6585e221c841 tempest-VolumesSnapshotListTestJSON-1993382796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:20:00 devstack sudo[97755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:20:00 devstack sudo[97755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:20:00 devstack sudo[97755]: pam_unix(sudo:session): session closed for user root Aug 29 01:20:00 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-cbec0341-da32-4aa6-9823-6585e221c841 tempest-VolumesSnapshotListTestJSON-1993382796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.321s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:20:00 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-cbec0341-da32-4aa6-9823-6585e221c841 tempest-VolumesSnapshotListTestJSON-1993382796 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:20:00 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-cbec0341-da32-4aa6-9823-6585e221c841 tempest-VolumesSnapshotListTestJSON-1993382796 None] Deleted volume successfully. Aug 29 01:20:00 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-cbec0341-da32-4aa6-9823-6585e221c841 tempest-VolumesSnapshotListTestJSON-1993382796 None] Lock "cinder-963e0cdd-7deb-44c0-a65c-77f9f354867e-delete_volume" released by "delete_volume" :: held 1.690s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:20:10 devstack cinder-volume[86111]: DEBUG dbcounter [-] [86111] Writing DB stats cinder:SELECT=27,cinder:INSERT=12,cinder:UPDATE=37 {{(pid=86111) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 29 01:20:10 devstack cinder-volume[86111]: DEBUG dbcounter [-] [86111] Writing DB stats cinder:SELECT=108,cinder:UPDATE=132,cinder:INSERT=33,cinder:DELETE=13 {{(pid=86111) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 29 01:20:12 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-dcba8e4c-2625-41d3-9582-208ce37d38c5 tempest-AttachVolumeNegativeTest-614873311 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:20:12 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-dcba8e4c-2625-41d3-9582-208ce37d38c5 tempest-AttachVolumeNegativeTest-614873311 None] Flow 'volume_create_manager' (2f08196a-7cdf-4468-933e-284a3ced5130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:20:12 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-dcba8e4c-2625-41d3-9582-208ce37d38c5 tempest-AttachVolumeNegativeTest-614873311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82b1944d-9b2a-46f4-91b0-3d8258ab9171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:20:12 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-dcba8e4c-2625-41d3-9582-208ce37d38c5 tempest-AttachVolumeNegativeTest-614873311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82b1944d-9b2a-46f4-91b0-3d8258ab9171) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:20:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-164417445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b46d041a-9cfa-4dff-9551-df4c858ca931,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='159178f1d77e473eabc4e957f357dddb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:20:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:20:12Z,use_quota=True,user_id='c0630dbe1c18496e8ec320517ae79496',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:20:12 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-dcba8e4c-2625-41d3-9582-208ce37d38c5 tempest-AttachVolumeNegativeTest-614873311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0221ee86-7d19-474b-881b-55f7a7b46dfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:20:12 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-dcba8e4c-2625-41d3-9582-208ce37d38c5 tempest-AttachVolumeNegativeTest-614873311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0221ee86-7d19-474b-881b-55f7a7b46dfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:20:12 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-dcba8e4c-2625-41d3-9582-208ce37d38c5 tempest-AttachVolumeNegativeTest-614873311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad4e489f-7d4d-4f36-857e-a160897c46ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:20:12 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-dcba8e4c-2625-41d3-9582-208ce37d38c5 tempest-AttachVolumeNegativeTest-614873311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad4e489f-7d4d-4f36-857e-a160897c46ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b46d041a-9cfa-4dff-9551-df4c858ca931', 'volume_name': 'volume-b46d041a-9cfa-4dff-9551-df4c858ca931', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:20:12 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-dcba8e4c-2625-41d3-9582-208ce37d38c5 tempest-AttachVolumeNegativeTest-614873311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d877b9b5-01d2-4aa4-86cb-8f67adeab341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:20:12 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-dcba8e4c-2625-41d3-9582-208ce37d38c5 tempest-AttachVolumeNegativeTest-614873311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d877b9b5-01d2-4aa4-86cb-8f67adeab341) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:20:12 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-dcba8e4c-2625-41d3-9582-208ce37d38c5 tempest-AttachVolumeNegativeTest-614873311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35a456ba-ccef-4356-a12d-98d7cb30d838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:20:12 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-dcba8e4c-2625-41d3-9582-208ce37d38c5 tempest-AttachVolumeNegativeTest-614873311 None] Volume b46d041a-9cfa-4dff-9551-df4c858ca931: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b46d041a-9cfa-4dff-9551-df4c858ca931', 'volume_size': 1} Aug 29 01:20:12 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-dcba8e4c-2625-41d3-9582-208ce37d38c5 tempest-AttachVolumeNegativeTest-614873311 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:20:12 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-dcba8e4c-2625-41d3-9582-208ce37d38c5 tempest-AttachVolumeNegativeTest-614873311 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:20:12 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-dcba8e4c-2625-41d3-9582-208ce37d38c5 tempest-AttachVolumeNegativeTest-614873311 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:20:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-164417445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b46d041a-9cfa-4dff-9551-df4c858ca931,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='159178f1d77e473eabc4e957f357dddb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:20:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:20:12Z,use_quota=True,user_id='c0630dbe1c18496e8ec320517ae79496',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:20:12 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-dcba8e4c-2625-41d3-9582-208ce37d38c5 tempest-AttachVolumeNegativeTest-614873311 None] Creating volume b46d041a-9cfa-4dff-9551-df4c858ca931 {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:20:12 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-dcba8e4c-2625-41d3-9582-208ce37d38c5 tempest-AttachVolumeNegativeTest-614873311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:20:12 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-dcba8e4c-2625-41d3-9582-208ce37d38c5 tempest-AttachVolumeNegativeTest-614873311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:20:12 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-dcba8e4c-2625-41d3-9582-208ce37d38c5 tempest-AttachVolumeNegativeTest-614873311 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:20:12 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-dcba8e4c-2625-41d3-9582-208ce37d38c5 tempest-AttachVolumeNegativeTest-614873311 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:20:12 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-dcba8e4c-2625-41d3-9582-208ce37d38c5 tempest-AttachVolumeNegativeTest-614873311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:20:12 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-dcba8e4c-2625-41d3-9582-208ce37d38c5 tempest-AttachVolumeNegativeTest-614873311 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:20:12 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-dcba8e4c-2625-41d3-9582-208ce37d38c5 tempest-AttachVolumeNegativeTest-614873311 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:20:12 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-dcba8e4c-2625-41d3-9582-208ce37d38c5 tempest-AttachVolumeNegativeTest-614873311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-b46d041a-9cfa-4dff-9551-df4c858ca931 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:20:12 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d8b2221-4161-4543-91d3-a8846ae321c4 tempest-VolumesTransfersV355Test-533404548 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:20:12 devstack sudo[97780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-b46d041a-9cfa-4dff-9551-df4c858ca931 1073741824 Aug 29 01:20:12 devstack sudo[97780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:20:12 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-7d8b2221-4161-4543-91d3-a8846ae321c4 tempest-VolumesTransfersV355Test-533404548 None] Flow 'volume_create_manager' (cf77c6b0-e850-47a3-9bfc-0501b5a3fb29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:20:12 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-7d8b2221-4161-4543-91d3-a8846ae321c4 tempest-VolumesTransfersV355Test-533404548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d65ac872-5438-42e8-9a63-681be6fc2759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:20:12 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-7d8b2221-4161-4543-91d3-a8846ae321c4 tempest-VolumesTransfersV355Test-533404548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d65ac872-5438-42e8-9a63-681be6fc2759) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:20:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-449263617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0194320-222a-4841-94ee-741499c7d89f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fae3dbadf8d44e088853528184433fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:20:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:20:12Z,use_quota=True,user_id='5d01823ad23843c6bb17386a4319ff88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:20:12 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-7d8b2221-4161-4543-91d3-a8846ae321c4 tempest-VolumesTransfersV355Test-533404548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30e22ce7-b60d-4aee-a0fb-68361ca2b9b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:20:12 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-7d8b2221-4161-4543-91d3-a8846ae321c4 tempest-VolumesTransfersV355Test-533404548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30e22ce7-b60d-4aee-a0fb-68361ca2b9b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:20:12 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-7d8b2221-4161-4543-91d3-a8846ae321c4 tempest-VolumesTransfersV355Test-533404548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09c37fc5-1f0c-4c0f-810a-02dd10f06e85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:20:12 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-7d8b2221-4161-4543-91d3-a8846ae321c4 tempest-VolumesTransfersV355Test-533404548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09c37fc5-1f0c-4c0f-810a-02dd10f06e85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0194320-222a-4841-94ee-741499c7d89f', 'volume_name': 'volume-e0194320-222a-4841-94ee-741499c7d89f', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:20:12 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-7d8b2221-4161-4543-91d3-a8846ae321c4 tempest-VolumesTransfersV355Test-533404548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fd0b7df-6b86-45c1-874a-7726de2f93e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:20:12 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-7d8b2221-4161-4543-91d3-a8846ae321c4 tempest-VolumesTransfersV355Test-533404548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fd0b7df-6b86-45c1-874a-7726de2f93e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:20:12 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-7d8b2221-4161-4543-91d3-a8846ae321c4 tempest-VolumesTransfersV355Test-533404548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dec58ccf-8493-46f8-93ea-cfd3af90f631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:20:12 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-7d8b2221-4161-4543-91d3-a8846ae321c4 tempest-VolumesTransfersV355Test-533404548 None] Volume e0194320-222a-4841-94ee-741499c7d89f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0194320-222a-4841-94ee-741499c7d89f', 'volume_size': 1} Aug 29 01:20:12 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-7d8b2221-4161-4543-91d3-a8846ae321c4 tempest-VolumesTransfersV355Test-533404548 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:20:13 devstack sudo[97780]: pam_unix(sudo:session): session closed for user root Aug 29 01:20:13 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-dcba8e4c-2625-41d3-9582-208ce37d38c5 tempest-AttachVolumeNegativeTest-614873311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-b46d041a-9cfa-4dff-9551-df4c858ca931 1073741824" returned: 0 in 0.585s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:20:13 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-dcba8e4c-2625-41d3-9582-208ce37d38c5 tempest-AttachVolumeNegativeTest-614873311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-b46d041a-9cfa-4dff-9551-df4c858ca931 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:20:13 devstack sudo[97786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-b46d041a-9cfa-4dff-9551-df4c858ca931 Aug 29 01:20:13 devstack sudo[97786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:20:13 devstack sudo[97786]: pam_unix(sudo:session): session closed for user root Aug 29 01:20:13 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-dcba8e4c-2625-41d3-9582-208ce37d38c5 tempest-AttachVolumeNegativeTest-614873311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-b46d041a-9cfa-4dff-9551-df4c858ca931" returned: 0 in 0.263s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:20:13 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-dcba8e4c-2625-41d3-9582-208ce37d38c5 tempest-AttachVolumeNegativeTest-614873311 None] <== create_volume: return (902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:20:13 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-dcba8e4c-2625-41d3-9582-208ce37d38c5 tempest-AttachVolumeNegativeTest-614873311 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.904s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:20:13 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-7d8b2221-4161-4543-91d3-a8846ae321c4 tempest-VolumesTransfersV355Test-533404548 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.761s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:20:13 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-7d8b2221-4161-4543-91d3-a8846ae321c4 tempest-VolumesTransfersV355Test-533404548 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:20:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-449263617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0194320-222a-4841-94ee-741499c7d89f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fae3dbadf8d44e088853528184433fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:20:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:20:12Z,use_quota=True,user_id='5d01823ad23843c6bb17386a4319ff88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:20:13 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-7d8b2221-4161-4543-91d3-a8846ae321c4 tempest-VolumesTransfersV355Test-533404548 None] Creating volume e0194320-222a-4841-94ee-741499c7d89f {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:20:13 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-7d8b2221-4161-4543-91d3-a8846ae321c4 tempest-VolumesTransfersV355Test-533404548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:20:13 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-7d8b2221-4161-4543-91d3-a8846ae321c4 tempest-VolumesTransfersV355Test-533404548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:20:13 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-7d8b2221-4161-4543-91d3-a8846ae321c4 tempest-VolumesTransfersV355Test-533404548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:20:13 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-7d8b2221-4161-4543-91d3-a8846ae321c4 tempest-VolumesTransfersV355Test-533404548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:20:13 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-7d8b2221-4161-4543-91d3-a8846ae321c4 tempest-VolumesTransfersV355Test-533404548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:20:13 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-7d8b2221-4161-4543-91d3-a8846ae321c4 tempest-VolumesTransfersV355Test-533404548 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:20:13 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-7d8b2221-4161-4543-91d3-a8846ae321c4 tempest-VolumesTransfersV355Test-533404548 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:20:13 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-7d8b2221-4161-4543-91d3-a8846ae321c4 tempest-VolumesTransfersV355Test-533404548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-e0194320-222a-4841-94ee-741499c7d89f 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:20:13 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-dcba8e4c-2625-41d3-9582-208ce37d38c5 tempest-AttachVolumeNegativeTest-614873311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35a456ba-ccef-4356-a12d-98d7cb30d838) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b46d041a-9cfa-4dff-9551-df4c858ca931', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:20:13 devstack sudo[97789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-e0194320-222a-4841-94ee-741499c7d89f 1073741824 Aug 29 01:20:13 devstack sudo[97789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:20:13 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-dcba8e4c-2625-41d3-9582-208ce37d38c5 tempest-AttachVolumeNegativeTest-614873311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (292a28fa-5092-4d24-a1ad-daab9b89b034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:20:13 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-dcba8e4c-2625-41d3-9582-208ce37d38c5 tempest-AttachVolumeNegativeTest-614873311 None] Volume volume-b46d041a-9cfa-4dff-9551-df4c858ca931 (b46d041a-9cfa-4dff-9551-df4c858ca931): created successfully Aug 29 01:20:13 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-dcba8e4c-2625-41d3-9582-208ce37d38c5 tempest-AttachVolumeNegativeTest-614873311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (292a28fa-5092-4d24-a1ad-daab9b89b034) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:20:13 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-dcba8e4c-2625-41d3-9582-208ce37d38c5 tempest-AttachVolumeNegativeTest-614873311 None] Flow 'volume_create_manager' (2f08196a-7cdf-4468-933e-284a3ced5130) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:20:13 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-dcba8e4c-2625-41d3-9582-208ce37d38c5 tempest-AttachVolumeNegativeTest-614873311 None] Created volume successfully. Aug 29 01:20:14 devstack sudo[97789]: pam_unix(sudo:session): session closed for user root Aug 29 01:20:14 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-7d8b2221-4161-4543-91d3-a8846ae321c4 tempest-VolumesTransfersV355Test-533404548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-e0194320-222a-4841-94ee-741499c7d89f 1073741824" returned: 0 in 0.546s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:20:14 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-7d8b2221-4161-4543-91d3-a8846ae321c4 tempest-VolumesTransfersV355Test-533404548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-e0194320-222a-4841-94ee-741499c7d89f {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:20:14 devstack sudo[97795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-e0194320-222a-4841-94ee-741499c7d89f Aug 29 01:20:14 devstack sudo[97795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:20:14 devstack sudo[97795]: pam_unix(sudo:session): session closed for user root Aug 29 01:20:14 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-7d8b2221-4161-4543-91d3-a8846ae321c4 tempest-VolumesTransfersV355Test-533404548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-e0194320-222a-4841-94ee-741499c7d89f" returned: 0 in 0.407s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:20:14 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-7d8b2221-4161-4543-91d3-a8846ae321c4 tempest-VolumesTransfersV355Test-533404548 None] <== create_volume: return (1012ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:20:14 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-7d8b2221-4161-4543-91d3-a8846ae321c4 tempest-VolumesTransfersV355Test-533404548 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.021s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:20:14 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-7d8b2221-4161-4543-91d3-a8846ae321c4 tempest-VolumesTransfersV355Test-533404548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dec58ccf-8493-46f8-93ea-cfd3af90f631) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0194320-222a-4841-94ee-741499c7d89f', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:20:14 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-7d8b2221-4161-4543-91d3-a8846ae321c4 tempest-VolumesTransfersV355Test-533404548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7de1f089-47ae-4d0a-9e49-f5adb7e3ca7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:20:14 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-7d8b2221-4161-4543-91d3-a8846ae321c4 tempest-VolumesTransfersV355Test-533404548 None] Volume volume-e0194320-222a-4841-94ee-741499c7d89f (e0194320-222a-4841-94ee-741499c7d89f): created successfully Aug 29 01:20:14 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-7d8b2221-4161-4543-91d3-a8846ae321c4 tempest-VolumesTransfersV355Test-533404548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7de1f089-47ae-4d0a-9e49-f5adb7e3ca7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:20:14 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-7d8b2221-4161-4543-91d3-a8846ae321c4 tempest-VolumesTransfersV355Test-533404548 None] Flow 'volume_create_manager' (cf77c6b0-e850-47a3-9bfc-0501b5a3fb29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:20:14 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-7d8b2221-4161-4543-91d3-a8846ae321c4 tempest-VolumesTransfersV355Test-533404548 None] Created volume successfully. Aug 29 01:20:15 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [req-eff8fdf3-94aa-434a-a751-b8d1c01212c9 req-e01dfdf5-74c3-4441-a1f9-45a53872f20a tempest-AttachVolumeNegativeTest-614873311 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:20:15 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [req-eff8fdf3-94aa-434a-a751-b8d1c01212c9 req-e01dfdf5-74c3-4441-a1f9-45a53872f20a tempest-AttachVolumeNegativeTest-614873311 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:20:15 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [req-eff8fdf3-94aa-434a-a751-b8d1c01212c9 req-e01dfdf5-74c3-4441-a1f9-45a53872f20a tempest-AttachVolumeNegativeTest-614873311 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:20:15 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [req-eff8fdf3-94aa-434a-a751-b8d1c01212c9 req-e01dfdf5-74c3-4441-a1f9-45a53872f20a tempest-AttachVolumeNegativeTest-614873311 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630', 'name': 'volume-b46d041a-9cfa-4dff-9551-df4c858ca931', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '79decc40-b6eb-48e1-b141-5d878acaf52f', 'enforce_multipath': True} {{(pid=86111) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 29 01:20:15 devstack cinder-volume[86111]: INFO cinder.volume.manager [req-eff8fdf3-94aa-434a-a751-b8d1c01212c9 req-e01dfdf5-74c3-4441-a1f9-45a53872f20a tempest-AttachVolumeNegativeTest-614873311 None] attachment_update completed successfully. Aug 29 01:20:16 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-d8d41c05-fa5d-4b00-97a0-25c03180c8e2 tempest-VolumesTransfersV355Test-1068864599 None] Transfer volume completed successfully. Aug 29 01:20:17 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-950d7b09-cb74-4610-b294-df09e29f24f7 tempest-VolumesTransfersV355Test-1971159124 None] Acquiring lock "cinder-e0194320-222a-4841-94ee-741499c7d89f-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:20:17 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-950d7b09-cb74-4610-b294-df09e29f24f7 tempest-VolumesTransfersV355Test-1971159124 None] Lock "cinder-e0194320-222a-4841-94ee-741499c7d89f-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:20:17 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-950d7b09-cb74-4610-b294-df09e29f24f7 tempest-VolumesTransfersV355Test-1971159124 None] Acquiring lock "cinder-quobyte-e0194320-222a-4841-94ee-741499c7d89f" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:20:17 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-950d7b09-cb74-4610-b294-df09e29f24f7 tempest-VolumesTransfersV355Test-1971159124 None] Lock "cinder-quobyte-e0194320-222a-4841-94ee-741499c7d89f" acquired by "delete_volume" :: waited 0.023s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:20:17 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[99df8dea-7866-48ad-83a7-dfbfedba7bcb]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:20:17 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-950d7b09-cb74-4610-b294-df09e29f24f7 tempest-VolumesTransfersV355Test-1971159124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-e0194320-222a-4841-94ee-741499c7d89f {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:20:17 devstack sudo[98195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-e0194320-222a-4841-94ee-741499c7d89f Aug 29 01:20:17 devstack sudo[98195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:20:18 devstack sudo[98195]: pam_unix(sudo:session): session closed for user root Aug 29 01:20:18 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-950d7b09-cb74-4610-b294-df09e29f24f7 tempest-VolumesTransfersV355Test-1971159124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-e0194320-222a-4841-94ee-741499c7d89f" returned: 0 in 0.628s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:20:18 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-950d7b09-cb74-4610-b294-df09e29f24f7 tempest-VolumesTransfersV355Test-1971159124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-e0194320-222a-4841-94ee-741499c7d89f {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:20:18 devstack cinder-volume[86111]: INFO cinder.volume.manager [req-c3cca7d0-98f1-4155-bb93-d993e7232e5c req-748ad4dc-002a-4ff4-9513-ef422cc1513a tempest-AttachVolumeNegativeTest-614873311 None] Terminate volume connection completed successfully. Aug 29 01:20:18 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [req-c3cca7d0-98f1-4155-bb93-d993e7232e5c req-748ad4dc-002a-4ff4-9513-ef422cc1513a tempest-AttachVolumeNegativeTest-614873311 None] Deleting attachment 79decc40-b6eb-48e1-b141-5d878acaf52f. {{(pid=86111) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 29 01:20:18 devstack sudo[98227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-e0194320-222a-4841-94ee-741499c7d89f Aug 29 01:20:18 devstack sudo[98227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:20:18 devstack sudo[98227]: pam_unix(sudo:session): session closed for user root Aug 29 01:20:18 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-950d7b09-cb74-4610-b294-df09e29f24f7 tempest-VolumesTransfersV355Test-1971159124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-e0194320-222a-4841-94ee-741499c7d89f" returned: 0 in 0.292s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:20:18 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-950d7b09-cb74-4610-b294-df09e29f24f7 tempest-VolumesTransfersV355Test-1971159124 None] Lock "cinder-quobyte-e0194320-222a-4841-94ee-741499c7d89f" released by "delete_volume" :: held 0.986s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:20:18 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-950d7b09-cb74-4610-b294-df09e29f24f7 tempest-VolumesTransfersV355Test-1971159124 None] Created reservations ['97541c2a-f882-4cc6-9dd1-a33d6dec2611', 'b16ee7d0-139d-4fc1-8b93-d986bcc46073', '588991df-3378-4037-9491-5b6cdf408af2', 'b66491c2-8562-4f3d-9f41-551327f71fd1'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:20:18 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-950d7b09-cb74-4610-b294-df09e29f24f7 tempest-VolumesTransfersV355Test-1971159124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:20:18 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-950d7b09-cb74-4610-b294-df09e29f24f7 tempest-VolumesTransfersV355Test-1971159124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:20:18 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-950d7b09-cb74-4610-b294-df09e29f24f7 tempest-VolumesTransfersV355Test-1971159124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:20:18 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-950d7b09-cb74-4610-b294-df09e29f24f7 tempest-VolumesTransfersV355Test-1971159124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:20:18 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-950d7b09-cb74-4610-b294-df09e29f24f7 tempest-VolumesTransfersV355Test-1971159124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:20:18 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-950d7b09-cb74-4610-b294-df09e29f24f7 tempest-VolumesTransfersV355Test-1971159124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:20:18 devstack sudo[98230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:20:18 devstack sudo[98230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:20:19 devstack sudo[98230]: pam_unix(sudo:session): session closed for user root Aug 29 01:20:19 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-950d7b09-cb74-4610-b294-df09e29f24f7 tempest-VolumesTransfersV355Test-1971159124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.333s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:20:19 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-950d7b09-cb74-4610-b294-df09e29f24f7 tempest-VolumesTransfersV355Test-1971159124 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:20:19 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-950d7b09-cb74-4610-b294-df09e29f24f7 tempest-VolumesTransfersV355Test-1971159124 None] Deleted volume successfully. Aug 29 01:20:19 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-950d7b09-cb74-4610-b294-df09e29f24f7 tempest-VolumesTransfersV355Test-1971159124 None] Lock "cinder-e0194320-222a-4841-94ee-741499c7d89f-delete_volume" released by "delete_volume" :: held 1.626s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:20:20 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-286c1eee-b5fa-43be-aac6-e10f65cd8398 tempest-VolumesTransfersV355Test-533404548 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:20:20 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-286c1eee-b5fa-43be-aac6-e10f65cd8398 tempest-VolumesTransfersV355Test-533404548 None] Flow 'volume_create_manager' (f789aba0-a4d8-422c-8632-bfaaeaac5e56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:20:20 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-286c1eee-b5fa-43be-aac6-e10f65cd8398 tempest-VolumesTransfersV355Test-533404548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db1d400d-bfdd-4c6c-982e-68c53e7528c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:20:20 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-286c1eee-b5fa-43be-aac6-e10f65cd8398 tempest-VolumesTransfersV355Test-533404548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db1d400d-bfdd-4c6c-982e-68c53e7528c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:20:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-314328794',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2fa217f-8e27-4261-b86d-0ce1ccef68fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fae3dbadf8d44e088853528184433fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:20:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:20:21Z,use_quota=True,user_id='5d01823ad23843c6bb17386a4319ff88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:20:20 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-286c1eee-b5fa-43be-aac6-e10f65cd8398 tempest-VolumesTransfersV355Test-533404548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a78579f7-c0ea-46c2-9386-2c4fc4fe7f04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:20:20 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-286c1eee-b5fa-43be-aac6-e10f65cd8398 tempest-VolumesTransfersV355Test-533404548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a78579f7-c0ea-46c2-9386-2c4fc4fe7f04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:20:20 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-286c1eee-b5fa-43be-aac6-e10f65cd8398 tempest-VolumesTransfersV355Test-533404548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bf03a69-a6ef-4077-a459-3fe0e13edb32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:20:20 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-286c1eee-b5fa-43be-aac6-e10f65cd8398 tempest-VolumesTransfersV355Test-533404548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bf03a69-a6ef-4077-a459-3fe0e13edb32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2fa217f-8e27-4261-b86d-0ce1ccef68fe', 'volume_name': 'volume-c2fa217f-8e27-4261-b86d-0ce1ccef68fe', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:20:20 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-286c1eee-b5fa-43be-aac6-e10f65cd8398 tempest-VolumesTransfersV355Test-533404548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c4c5288-5c9b-47d5-b5eb-0c263512b9b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:20:20 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-286c1eee-b5fa-43be-aac6-e10f65cd8398 tempest-VolumesTransfersV355Test-533404548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c4c5288-5c9b-47d5-b5eb-0c263512b9b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:20:20 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-286c1eee-b5fa-43be-aac6-e10f65cd8398 tempest-VolumesTransfersV355Test-533404548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21d1a9e6-d815-4e15-a5c7-80ae1ad3cbf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:20:20 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-286c1eee-b5fa-43be-aac6-e10f65cd8398 tempest-VolumesTransfersV355Test-533404548 None] Volume c2fa217f-8e27-4261-b86d-0ce1ccef68fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2fa217f-8e27-4261-b86d-0ce1ccef68fe', 'volume_size': 1} Aug 29 01:20:20 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-286c1eee-b5fa-43be-aac6-e10f65cd8398 tempest-VolumesTransfersV355Test-533404548 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:20:20 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-286c1eee-b5fa-43be-aac6-e10f65cd8398 tempest-VolumesTransfersV355Test-533404548 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:20:20 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-286c1eee-b5fa-43be-aac6-e10f65cd8398 tempest-VolumesTransfersV355Test-533404548 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:20:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-314328794',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2fa217f-8e27-4261-b86d-0ce1ccef68fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fae3dbadf8d44e088853528184433fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:20:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:20:21Z,use_quota=True,user_id='5d01823ad23843c6bb17386a4319ff88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:20:20 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-286c1eee-b5fa-43be-aac6-e10f65cd8398 tempest-VolumesTransfersV355Test-533404548 None] Creating volume c2fa217f-8e27-4261-b86d-0ce1ccef68fe {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:20:20 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-286c1eee-b5fa-43be-aac6-e10f65cd8398 tempest-VolumesTransfersV355Test-533404548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:20:20 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-286c1eee-b5fa-43be-aac6-e10f65cd8398 tempest-VolumesTransfersV355Test-533404548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:20:20 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-286c1eee-b5fa-43be-aac6-e10f65cd8398 tempest-VolumesTransfersV355Test-533404548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:20:20 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-286c1eee-b5fa-43be-aac6-e10f65cd8398 tempest-VolumesTransfersV355Test-533404548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:20:20 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-286c1eee-b5fa-43be-aac6-e10f65cd8398 tempest-VolumesTransfersV355Test-533404548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:20:20 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-286c1eee-b5fa-43be-aac6-e10f65cd8398 tempest-VolumesTransfersV355Test-533404548 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:20:20 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-286c1eee-b5fa-43be-aac6-e10f65cd8398 tempest-VolumesTransfersV355Test-533404548 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:20:20 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-286c1eee-b5fa-43be-aac6-e10f65cd8398 tempest-VolumesTransfersV355Test-533404548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-c2fa217f-8e27-4261-b86d-0ce1ccef68fe 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:20:21 devstack sudo[98254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-c2fa217f-8e27-4261-b86d-0ce1ccef68fe 1073741824 Aug 29 01:20:21 devstack sudo[98254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:20:21 devstack sudo[98254]: pam_unix(sudo:session): session closed for user root Aug 29 01:20:21 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-286c1eee-b5fa-43be-aac6-e10f65cd8398 tempest-VolumesTransfersV355Test-533404548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-c2fa217f-8e27-4261-b86d-0ce1ccef68fe 1073741824" returned: 0 in 0.620s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:20:21 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-286c1eee-b5fa-43be-aac6-e10f65cd8398 tempest-VolumesTransfersV355Test-533404548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-c2fa217f-8e27-4261-b86d-0ce1ccef68fe {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:20:21 devstack sudo[98262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-c2fa217f-8e27-4261-b86d-0ce1ccef68fe Aug 29 01:20:21 devstack sudo[98262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:20:21 devstack sudo[98262]: pam_unix(sudo:session): session closed for user root Aug 29 01:20:21 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-286c1eee-b5fa-43be-aac6-e10f65cd8398 tempest-VolumesTransfersV355Test-533404548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-c2fa217f-8e27-4261-b86d-0ce1ccef68fe" returned: 0 in 0.314s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:20:21 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-286c1eee-b5fa-43be-aac6-e10f65cd8398 tempest-VolumesTransfersV355Test-533404548 None] <== create_volume: return (995ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:20:21 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-286c1eee-b5fa-43be-aac6-e10f65cd8398 tempest-VolumesTransfersV355Test-533404548 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.998s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:20:21 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-286c1eee-b5fa-43be-aac6-e10f65cd8398 tempest-VolumesTransfersV355Test-533404548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21d1a9e6-d815-4e15-a5c7-80ae1ad3cbf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2fa217f-8e27-4261-b86d-0ce1ccef68fe', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:20:21 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-286c1eee-b5fa-43be-aac6-e10f65cd8398 tempest-VolumesTransfersV355Test-533404548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76f8a267-453a-4092-8a7d-f0331e9efa4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:20:22 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-286c1eee-b5fa-43be-aac6-e10f65cd8398 tempest-VolumesTransfersV355Test-533404548 None] Volume volume-c2fa217f-8e27-4261-b86d-0ce1ccef68fe (c2fa217f-8e27-4261-b86d-0ce1ccef68fe): created successfully Aug 29 01:20:22 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-286c1eee-b5fa-43be-aac6-e10f65cd8398 tempest-VolumesTransfersV355Test-533404548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76f8a267-453a-4092-8a7d-f0331e9efa4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:20:22 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-286c1eee-b5fa-43be-aac6-e10f65cd8398 tempest-VolumesTransfersV355Test-533404548 None] Flow 'volume_create_manager' (f789aba0-a4d8-422c-8632-bfaaeaac5e56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:20:22 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-286c1eee-b5fa-43be-aac6-e10f65cd8398 tempest-VolumesTransfersV355Test-533404548 None] Created volume successfully. Aug 29 01:20:23 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-d3226d8c-36c4-43c1-9d56-9040c838faec tempest-VolumesTransfersV355Test-1971159124 None] Acquiring lock "cinder-c2fa217f-8e27-4261-b86d-0ce1ccef68fe-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:20:23 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-d3226d8c-36c4-43c1-9d56-9040c838faec tempest-VolumesTransfersV355Test-1971159124 None] Lock "cinder-c2fa217f-8e27-4261-b86d-0ce1ccef68fe-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:20:23 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-d3226d8c-36c4-43c1-9d56-9040c838faec tempest-VolumesTransfersV355Test-1971159124 None] Acquiring lock "cinder-quobyte-c2fa217f-8e27-4261-b86d-0ce1ccef68fe" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:20:23 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-d3226d8c-36c4-43c1-9d56-9040c838faec tempest-VolumesTransfersV355Test-1971159124 None] Lock "cinder-quobyte-c2fa217f-8e27-4261-b86d-0ce1ccef68fe" acquired by "delete_volume" :: waited 0.027s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:20:23 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac9e018f-4a84-43d6-bc88-b43df0147aab]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:20:23 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d3226d8c-36c4-43c1-9d56-9040c838faec tempest-VolumesTransfersV355Test-1971159124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-c2fa217f-8e27-4261-b86d-0ce1ccef68fe {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:20:23 devstack sudo[98271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-c2fa217f-8e27-4261-b86d-0ce1ccef68fe Aug 29 01:20:23 devstack sudo[98271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:20:23 devstack sudo[98271]: pam_unix(sudo:session): session closed for user root Aug 29 01:20:23 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d3226d8c-36c4-43c1-9d56-9040c838faec tempest-VolumesTransfersV355Test-1971159124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-c2fa217f-8e27-4261-b86d-0ce1ccef68fe" returned: 0 in 0.424s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:20:23 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d3226d8c-36c4-43c1-9d56-9040c838faec tempest-VolumesTransfersV355Test-1971159124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-c2fa217f-8e27-4261-b86d-0ce1ccef68fe {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:20:23 devstack sudo[98277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-c2fa217f-8e27-4261-b86d-0ce1ccef68fe Aug 29 01:20:23 devstack sudo[98277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:20:24 devstack sudo[98277]: pam_unix(sudo:session): session closed for user root Aug 29 01:20:24 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d3226d8c-36c4-43c1-9d56-9040c838faec tempest-VolumesTransfersV355Test-1971159124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-c2fa217f-8e27-4261-b86d-0ce1ccef68fe" returned: 0 in 0.299s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:20:24 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-d3226d8c-36c4-43c1-9d56-9040c838faec tempest-VolumesTransfersV355Test-1971159124 None] Lock "cinder-quobyte-c2fa217f-8e27-4261-b86d-0ce1ccef68fe" released by "delete_volume" :: held 0.786s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:20:24 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-d3226d8c-36c4-43c1-9d56-9040c838faec tempest-VolumesTransfersV355Test-1971159124 None] Created reservations ['378953a6-71bd-4c1d-a0df-0da140e50216', '29118c66-4432-44e7-a953-c380fad2c725', '5e4e3add-40c8-426c-a1c4-7bfc005a79e8', '93678b30-2c24-42c7-8f45-c606d03ae3f3'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:20:24 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-d3226d8c-36c4-43c1-9d56-9040c838faec tempest-VolumesTransfersV355Test-1971159124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:20:24 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-d3226d8c-36c4-43c1-9d56-9040c838faec tempest-VolumesTransfersV355Test-1971159124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:20:24 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-d3226d8c-36c4-43c1-9d56-9040c838faec tempest-VolumesTransfersV355Test-1971159124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:20:24 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-d3226d8c-36c4-43c1-9d56-9040c838faec tempest-VolumesTransfersV355Test-1971159124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:20:24 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-d3226d8c-36c4-43c1-9d56-9040c838faec tempest-VolumesTransfersV355Test-1971159124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:20:24 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d3226d8c-36c4-43c1-9d56-9040c838faec tempest-VolumesTransfersV355Test-1971159124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:20:24 devstack sudo[98282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:20:24 devstack sudo[98282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:20:24 devstack sudo[98282]: pam_unix(sudo:session): session closed for user root Aug 29 01:20:24 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d3226d8c-36c4-43c1-9d56-9040c838faec tempest-VolumesTransfersV355Test-1971159124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.428s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:20:24 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-d3226d8c-36c4-43c1-9d56-9040c838faec tempest-VolumesTransfersV355Test-1971159124 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:20:24 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-d3226d8c-36c4-43c1-9d56-9040c838faec tempest-VolumesTransfersV355Test-1971159124 None] Deleted volume successfully. Aug 29 01:20:24 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-d3226d8c-36c4-43c1-9d56-9040c838faec tempest-VolumesTransfersV355Test-1971159124 None] Lock "cinder-c2fa217f-8e27-4261-b86d-0ce1ccef68fe-delete_volume" released by "delete_volume" :: held 1.537s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:20:30 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-7956ad8c-d54f-47b3-984d-531517670543 tempest-AttachVolumeNegativeTest-614873311 None] Acquiring lock "cinder-b46d041a-9cfa-4dff-9551-df4c858ca931-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:20:30 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-7956ad8c-d54f-47b3-984d-531517670543 tempest-AttachVolumeNegativeTest-614873311 None] Lock "cinder-b46d041a-9cfa-4dff-9551-df4c858ca931-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:20:30 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-7956ad8c-d54f-47b3-984d-531517670543 tempest-AttachVolumeNegativeTest-614873311 None] Acquiring lock "cinder-quobyte-b46d041a-9cfa-4dff-9551-df4c858ca931" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:20:30 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-7956ad8c-d54f-47b3-984d-531517670543 tempest-AttachVolumeNegativeTest-614873311 None] Lock "cinder-quobyte-b46d041a-9cfa-4dff-9551-df4c858ca931" acquired by "delete_volume" :: waited 0.024s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:20:31 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ee2f672-76e0-4a84-b1da-e7470b9d3a99]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:20:31 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-7956ad8c-d54f-47b3-984d-531517670543 tempest-AttachVolumeNegativeTest-614873311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-b46d041a-9cfa-4dff-9551-df4c858ca931 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:20:31 devstack sudo[98324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-b46d041a-9cfa-4dff-9551-df4c858ca931 Aug 29 01:20:31 devstack sudo[98324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:20:31 devstack sudo[98324]: pam_unix(sudo:session): session closed for user root Aug 29 01:20:31 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-7956ad8c-d54f-47b3-984d-531517670543 tempest-AttachVolumeNegativeTest-614873311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-b46d041a-9cfa-4dff-9551-df4c858ca931" returned: 0 in 0.409s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:20:31 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-7956ad8c-d54f-47b3-984d-531517670543 tempest-AttachVolumeNegativeTest-614873311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-b46d041a-9cfa-4dff-9551-df4c858ca931 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:20:31 devstack sudo[98329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-b46d041a-9cfa-4dff-9551-df4c858ca931 Aug 29 01:20:31 devstack sudo[98329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:20:31 devstack sudo[98329]: pam_unix(sudo:session): session closed for user root Aug 29 01:20:31 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-7956ad8c-d54f-47b3-984d-531517670543 tempest-AttachVolumeNegativeTest-614873311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-b46d041a-9cfa-4dff-9551-df4c858ca931" returned: 0 in 0.351s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:20:31 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-7956ad8c-d54f-47b3-984d-531517670543 tempest-AttachVolumeNegativeTest-614873311 None] Lock "cinder-quobyte-b46d041a-9cfa-4dff-9551-df4c858ca931" released by "delete_volume" :: held 0.849s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:20:31 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-7956ad8c-d54f-47b3-984d-531517670543 tempest-AttachVolumeNegativeTest-614873311 None] Created reservations ['493bfcaf-2f0f-4e5d-8dfe-797419331132', '093ec435-46fc-4c44-9525-d386156476d9', '637d1d6e-7875-4d0a-856d-19c9791e6aed', '1e440b59-0c83-4bfd-9023-8274471051b5'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:20:31 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-7956ad8c-d54f-47b3-984d-531517670543 tempest-AttachVolumeNegativeTest-614873311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:20:31 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-7956ad8c-d54f-47b3-984d-531517670543 tempest-AttachVolumeNegativeTest-614873311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:20:31 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-7956ad8c-d54f-47b3-984d-531517670543 tempest-AttachVolumeNegativeTest-614873311 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:20:32 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-7956ad8c-d54f-47b3-984d-531517670543 tempest-AttachVolumeNegativeTest-614873311 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:20:32 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-7956ad8c-d54f-47b3-984d-531517670543 tempest-AttachVolumeNegativeTest-614873311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:20:32 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-7956ad8c-d54f-47b3-984d-531517670543 tempest-AttachVolumeNegativeTest-614873311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:20:32 devstack sudo[98332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:20:32 devstack sudo[98332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:20:32 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-48eff3de-89c5-402a-8923-9e1d0f899ba8 tempest-AttachVolumeNegativeTest-614873311 None] Acquiring lock "cinder-f385845e-757d-4d26-966c-a21a15ab3cce-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:20:32 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-48eff3de-89c5-402a-8923-9e1d0f899ba8 tempest-AttachVolumeNegativeTest-614873311 None] Lock "cinder-f385845e-757d-4d26-966c-a21a15ab3cce-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:20:32 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-48eff3de-89c5-402a-8923-9e1d0f899ba8 tempest-AttachVolumeNegativeTest-614873311 None] Acquiring lock "cinder-quobyte-f385845e-757d-4d26-966c-a21a15ab3cce" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:20:32 devstack sudo[98332]: pam_unix(sudo:session): session closed for user root Aug 29 01:20:32 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-48eff3de-89c5-402a-8923-9e1d0f899ba8 tempest-AttachVolumeNegativeTest-614873311 None] Lock "cinder-quobyte-f385845e-757d-4d26-966c-a21a15ab3cce" acquired by "delete_volume" :: waited 0.028s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:20:32 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-7956ad8c-d54f-47b3-984d-531517670543 tempest-AttachVolumeNegativeTest-614873311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.467s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:20:32 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-7956ad8c-d54f-47b3-984d-531517670543 tempest-AttachVolumeNegativeTest-614873311 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:20:32 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-7956ad8c-d54f-47b3-984d-531517670543 tempest-AttachVolumeNegativeTest-614873311 None] Deleted volume successfully. Aug 29 01:20:32 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-7956ad8c-d54f-47b3-984d-531517670543 tempest-AttachVolumeNegativeTest-614873311 None] Lock "cinder-b46d041a-9cfa-4dff-9551-df4c858ca931-delete_volume" released by "delete_volume" :: held 1.596s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:20:32 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[51434fbe-8a02-43cf-a3b4-f7b43f88b161]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:20:32 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-48eff3de-89c5-402a-8923-9e1d0f899ba8 tempest-AttachVolumeNegativeTest-614873311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-f385845e-757d-4d26-966c-a21a15ab3cce {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:20:32 devstack sudo[98335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-f385845e-757d-4d26-966c-a21a15ab3cce Aug 29 01:20:32 devstack sudo[98335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:20:33 devstack sudo[98335]: pam_unix(sudo:session): session closed for user root Aug 29 01:20:33 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-48eff3de-89c5-402a-8923-9e1d0f899ba8 tempest-AttachVolumeNegativeTest-614873311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-f385845e-757d-4d26-966c-a21a15ab3cce" returned: 0 in 0.544s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:20:33 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-48eff3de-89c5-402a-8923-9e1d0f899ba8 tempest-AttachVolumeNegativeTest-614873311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-f385845e-757d-4d26-966c-a21a15ab3cce {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:20:33 devstack sudo[98340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-f385845e-757d-4d26-966c-a21a15ab3cce Aug 29 01:20:33 devstack sudo[98340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:20:33 devstack sudo[98340]: pam_unix(sudo:session): session closed for user root Aug 29 01:20:33 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-48eff3de-89c5-402a-8923-9e1d0f899ba8 tempest-AttachVolumeNegativeTest-614873311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-f385845e-757d-4d26-966c-a21a15ab3cce" returned: 0 in 0.419s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:20:33 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-48eff3de-89c5-402a-8923-9e1d0f899ba8 tempest-AttachVolumeNegativeTest-614873311 None] Lock "cinder-quobyte-f385845e-757d-4d26-966c-a21a15ab3cce" released by "delete_volume" :: held 1.038s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:20:33 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-48eff3de-89c5-402a-8923-9e1d0f899ba8 tempest-AttachVolumeNegativeTest-614873311 None] Created reservations ['c0bee414-1309-41b5-afb3-0f5a20f4965a', '874e76a9-1afd-4b7d-9707-f7bfe5f249df', 'f6afc290-88d9-48f9-8688-eb8b0c81f270', '7944cf4e-154a-47d3-adc2-ac8860f2bc4a'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:20:33 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-48eff3de-89c5-402a-8923-9e1d0f899ba8 tempest-AttachVolumeNegativeTest-614873311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:20:33 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-48eff3de-89c5-402a-8923-9e1d0f899ba8 tempest-AttachVolumeNegativeTest-614873311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:20:33 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-48eff3de-89c5-402a-8923-9e1d0f899ba8 tempest-AttachVolumeNegativeTest-614873311 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:20:33 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-48eff3de-89c5-402a-8923-9e1d0f899ba8 tempest-AttachVolumeNegativeTest-614873311 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:20:33 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-48eff3de-89c5-402a-8923-9e1d0f899ba8 tempest-AttachVolumeNegativeTest-614873311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:20:33 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-48eff3de-89c5-402a-8923-9e1d0f899ba8 tempest-AttachVolumeNegativeTest-614873311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:20:33 devstack sudo[98343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:20:33 devstack sudo[98343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:20:34 devstack sudo[98343]: pam_unix(sudo:session): session closed for user root Aug 29 01:20:34 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-48eff3de-89c5-402a-8923-9e1d0f899ba8 tempest-AttachVolumeNegativeTest-614873311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.364s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:20:34 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-48eff3de-89c5-402a-8923-9e1d0f899ba8 tempest-AttachVolumeNegativeTest-614873311 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:20:34 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-48eff3de-89c5-402a-8923-9e1d0f899ba8 tempest-AttachVolumeNegativeTest-614873311 None] Deleted volume successfully. Aug 29 01:20:34 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-48eff3de-89c5-402a-8923-9e1d0f899ba8 tempest-AttachVolumeNegativeTest-614873311 None] Lock "cinder-f385845e-757d-4d26-966c-a21a15ab3cce-delete_volume" released by "delete_volume" :: held 1.760s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:20:34 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-66c717d6-79a2-49f6-bd9c-fdf052ff4221 tempest-AttachVolumeNegativeTest-614873311 None] Acquiring lock "cinder-a7de1227-64f7-4764-ba98-fc77c7de7ae0-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:20:34 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-66c717d6-79a2-49f6-bd9c-fdf052ff4221 tempest-AttachVolumeNegativeTest-614873311 None] Lock "cinder-a7de1227-64f7-4764-ba98-fc77c7de7ae0-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:20:34 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-66c717d6-79a2-49f6-bd9c-fdf052ff4221 tempest-AttachVolumeNegativeTest-614873311 None] Acquiring lock "cinder-quobyte-a7de1227-64f7-4764-ba98-fc77c7de7ae0" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:20:34 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-66c717d6-79a2-49f6-bd9c-fdf052ff4221 tempest-AttachVolumeNegativeTest-614873311 None] Lock "cinder-quobyte-a7de1227-64f7-4764-ba98-fc77c7de7ae0" acquired by "delete_volume" :: waited 0.036s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:20:35 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb02c162-339b-4846-9864-3e9ff64033af]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:20:35 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-66c717d6-79a2-49f6-bd9c-fdf052ff4221 tempest-AttachVolumeNegativeTest-614873311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a7de1227-64f7-4764-ba98-fc77c7de7ae0 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:20:35 devstack sudo[98350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a7de1227-64f7-4764-ba98-fc77c7de7ae0 Aug 29 01:20:35 devstack sudo[98350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:20:35 devstack sudo[98350]: pam_unix(sudo:session): session closed for user root Aug 29 01:20:35 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-66c717d6-79a2-49f6-bd9c-fdf052ff4221 tempest-AttachVolumeNegativeTest-614873311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a7de1227-64f7-4764-ba98-fc77c7de7ae0" returned: 0 in 0.487s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:20:35 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-66c717d6-79a2-49f6-bd9c-fdf052ff4221 tempest-AttachVolumeNegativeTest-614873311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a7de1227-64f7-4764-ba98-fc77c7de7ae0 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:20:35 devstack sudo[98355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a7de1227-64f7-4764-ba98-fc77c7de7ae0 Aug 29 01:20:35 devstack sudo[98355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:20:35 devstack sudo[98355]: pam_unix(sudo:session): session closed for user root Aug 29 01:20:35 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-66c717d6-79a2-49f6-bd9c-fdf052ff4221 tempest-AttachVolumeNegativeTest-614873311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a7de1227-64f7-4764-ba98-fc77c7de7ae0" returned: 0 in 0.293s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:20:35 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-66c717d6-79a2-49f6-bd9c-fdf052ff4221 tempest-AttachVolumeNegativeTest-614873311 None] Lock "cinder-quobyte-a7de1227-64f7-4764-ba98-fc77c7de7ae0" released by "delete_volume" :: held 0.841s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:20:35 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-66c717d6-79a2-49f6-bd9c-fdf052ff4221 tempest-AttachVolumeNegativeTest-614873311 None] Created reservations ['d3bb4fd1-da86-48ba-b455-ddbfa75c1902', 'a26d3e4f-592b-4ba8-bbe0-bbd32de99896', '26d0d772-ba4c-4e11-8d8f-ad6db8955239', 'f19f693d-c2a8-4b0d-8dd0-9877097b1b0a'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:20:35 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-66c717d6-79a2-49f6-bd9c-fdf052ff4221 tempest-AttachVolumeNegativeTest-614873311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:20:35 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-66c717d6-79a2-49f6-bd9c-fdf052ff4221 tempest-AttachVolumeNegativeTest-614873311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:20:35 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-66c717d6-79a2-49f6-bd9c-fdf052ff4221 tempest-AttachVolumeNegativeTest-614873311 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:20:35 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-66c717d6-79a2-49f6-bd9c-fdf052ff4221 tempest-AttachVolumeNegativeTest-614873311 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:20:35 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-66c717d6-79a2-49f6-bd9c-fdf052ff4221 tempest-AttachVolumeNegativeTest-614873311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:20:35 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-66c717d6-79a2-49f6-bd9c-fdf052ff4221 tempest-AttachVolumeNegativeTest-614873311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:20:36 devstack sudo[98358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:20:36 devstack sudo[98358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:20:36 devstack sudo[98358]: pam_unix(sudo:session): session closed for user root Aug 29 01:20:36 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-66c717d6-79a2-49f6-bd9c-fdf052ff4221 tempest-AttachVolumeNegativeTest-614873311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.419s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:20:36 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-66c717d6-79a2-49f6-bd9c-fdf052ff4221 tempest-AttachVolumeNegativeTest-614873311 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:20:36 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-66c717d6-79a2-49f6-bd9c-fdf052ff4221 tempest-AttachVolumeNegativeTest-614873311 None] Deleted volume successfully. Aug 29 01:20:36 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-66c717d6-79a2-49f6-bd9c-fdf052ff4221 tempest-AttachVolumeNegativeTest-614873311 None] Lock "cinder-a7de1227-64f7-4764-ba98-fc77c7de7ae0-delete_volume" released by "delete_volume" :: held 1.567s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:20:37 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-a76d607f-a725-4ce8-b88f-134c40f5141b tempest-VolumesTransfersV357Test-1089393687 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:20:37 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-a76d607f-a725-4ce8-b88f-134c40f5141b tempest-VolumesTransfersV357Test-1089393687 None] Flow 'volume_create_manager' (bb2f37ea-06bd-4ab6-bfea-13649b9e2197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:20:37 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-a76d607f-a725-4ce8-b88f-134c40f5141b tempest-VolumesTransfersV357Test-1089393687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (760a9bd8-69d7-4975-bf6a-8e6783f6bb14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:20:37 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-a76d607f-a725-4ce8-b88f-134c40f5141b tempest-VolumesTransfersV357Test-1089393687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (760a9bd8-69d7-4975-bf6a-8e6783f6bb14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:20:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-365752082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f7f39c9-31ce-43f1-8e77-f618f33de917,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='444ecc9b1e73488798de548cd315fe50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:20:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:20:37Z,use_quota=True,user_id='1b92c58b13e24e13a2e3b627d273118a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:20:37 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-a76d607f-a725-4ce8-b88f-134c40f5141b tempest-VolumesTransfersV357Test-1089393687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7733f53f-ab1b-4e9f-8bc1-544421520a3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:20:37 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-a76d607f-a725-4ce8-b88f-134c40f5141b tempest-VolumesTransfersV357Test-1089393687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7733f53f-ab1b-4e9f-8bc1-544421520a3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:20:37 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-a76d607f-a725-4ce8-b88f-134c40f5141b tempest-VolumesTransfersV357Test-1089393687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e879d43-11a3-42d0-91d6-08d408e57a17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:20:37 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-a76d607f-a725-4ce8-b88f-134c40f5141b tempest-VolumesTransfersV357Test-1089393687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e879d43-11a3-42d0-91d6-08d408e57a17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f7f39c9-31ce-43f1-8e77-f618f33de917', 'volume_name': 'volume-5f7f39c9-31ce-43f1-8e77-f618f33de917', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:20:37 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-a76d607f-a725-4ce8-b88f-134c40f5141b tempest-VolumesTransfersV357Test-1089393687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a0a17b8-06df-434a-99cf-250a9a44e4c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:20:37 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-a76d607f-a725-4ce8-b88f-134c40f5141b tempest-VolumesTransfersV357Test-1089393687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a0a17b8-06df-434a-99cf-250a9a44e4c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:20:37 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-a76d607f-a725-4ce8-b88f-134c40f5141b tempest-VolumesTransfersV357Test-1089393687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (996532d1-a2d7-4712-aa06-f43c9263e929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:20:37 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-a76d607f-a725-4ce8-b88f-134c40f5141b tempest-VolumesTransfersV357Test-1089393687 None] Volume 5f7f39c9-31ce-43f1-8e77-f618f33de917: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f7f39c9-31ce-43f1-8e77-f618f33de917', 'volume_size': 1} Aug 29 01:20:37 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-a76d607f-a725-4ce8-b88f-134c40f5141b tempest-VolumesTransfersV357Test-1089393687 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:20:37 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-a76d607f-a725-4ce8-b88f-134c40f5141b tempest-VolumesTransfersV357Test-1089393687 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:20:37 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-a76d607f-a725-4ce8-b88f-134c40f5141b tempest-VolumesTransfersV357Test-1089393687 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:20:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-365752082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f7f39c9-31ce-43f1-8e77-f618f33de917,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='444ecc9b1e73488798de548cd315fe50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:20:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:20:37Z,use_quota=True,user_id='1b92c58b13e24e13a2e3b627d273118a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:20:37 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-a76d607f-a725-4ce8-b88f-134c40f5141b tempest-VolumesTransfersV357Test-1089393687 None] Creating volume 5f7f39c9-31ce-43f1-8e77-f618f33de917 {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:20:37 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-a76d607f-a725-4ce8-b88f-134c40f5141b tempest-VolumesTransfersV357Test-1089393687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:20:37 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-a76d607f-a725-4ce8-b88f-134c40f5141b tempest-VolumesTransfersV357Test-1089393687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:20:37 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-a76d607f-a725-4ce8-b88f-134c40f5141b tempest-VolumesTransfersV357Test-1089393687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:20:37 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-a76d607f-a725-4ce8-b88f-134c40f5141b tempest-VolumesTransfersV357Test-1089393687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:20:37 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-a76d607f-a725-4ce8-b88f-134c40f5141b tempest-VolumesTransfersV357Test-1089393687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:20:37 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-a76d607f-a725-4ce8-b88f-134c40f5141b tempest-VolumesTransfersV357Test-1089393687 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:20:37 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-a76d607f-a725-4ce8-b88f-134c40f5141b tempest-VolumesTransfersV357Test-1089393687 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:20:37 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-a76d607f-a725-4ce8-b88f-134c40f5141b tempest-VolumesTransfersV357Test-1089393687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-5f7f39c9-31ce-43f1-8e77-f618f33de917 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:20:37 devstack sudo[98362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-5f7f39c9-31ce-43f1-8e77-f618f33de917 1073741824 Aug 29 01:20:37 devstack sudo[98362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:20:38 devstack sudo[98362]: pam_unix(sudo:session): session closed for user root Aug 29 01:20:38 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-a76d607f-a725-4ce8-b88f-134c40f5141b tempest-VolumesTransfersV357Test-1089393687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-5f7f39c9-31ce-43f1-8e77-f618f33de917 1073741824" returned: 0 in 0.548s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:20:38 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-a76d607f-a725-4ce8-b88f-134c40f5141b tempest-VolumesTransfersV357Test-1089393687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-5f7f39c9-31ce-43f1-8e77-f618f33de917 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:20:38 devstack sudo[98382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-5f7f39c9-31ce-43f1-8e77-f618f33de917 Aug 29 01:20:38 devstack sudo[98382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:20:38 devstack sudo[98382]: pam_unix(sudo:session): session closed for user root Aug 29 01:20:38 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-a76d607f-a725-4ce8-b88f-134c40f5141b tempest-VolumesTransfersV357Test-1089393687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-5f7f39c9-31ce-43f1-8e77-f618f33de917" returned: 0 in 0.327s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:20:38 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-a76d607f-a725-4ce8-b88f-134c40f5141b tempest-VolumesTransfersV357Test-1089393687 None] <== create_volume: return (951ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:20:38 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-a76d607f-a725-4ce8-b88f-134c40f5141b tempest-VolumesTransfersV357Test-1089393687 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.955s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:20:38 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-a76d607f-a725-4ce8-b88f-134c40f5141b tempest-VolumesTransfersV357Test-1089393687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (996532d1-a2d7-4712-aa06-f43c9263e929) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f7f39c9-31ce-43f1-8e77-f618f33de917', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:20:38 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-a76d607f-a725-4ce8-b88f-134c40f5141b tempest-VolumesTransfersV357Test-1089393687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a3b5a1b-0883-4731-9fae-322164b6ce59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:20:38 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-a76d607f-a725-4ce8-b88f-134c40f5141b tempest-VolumesTransfersV357Test-1089393687 None] Volume volume-5f7f39c9-31ce-43f1-8e77-f618f33de917 (5f7f39c9-31ce-43f1-8e77-f618f33de917): created successfully Aug 29 01:20:38 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-a76d607f-a725-4ce8-b88f-134c40f5141b tempest-VolumesTransfersV357Test-1089393687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a3b5a1b-0883-4731-9fae-322164b6ce59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:20:38 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-a76d607f-a725-4ce8-b88f-134c40f5141b tempest-VolumesTransfersV357Test-1089393687 None] Flow 'volume_create_manager' (bb2f37ea-06bd-4ab6-bfea-13649b9e2197) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:20:38 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-a76d607f-a725-4ce8-b88f-134c40f5141b tempest-VolumesTransfersV357Test-1089393687 None] Created volume successfully. Aug 29 01:20:40 devstack cinder-volume[86111]: DEBUG oslo_service.periodic_task [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86111) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 29 01:20:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:20:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:20:40 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:20:40 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:20:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:20:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:20:40 devstack sudo[98463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:20:40 devstack sudo[98463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:20:40 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-7dcfef97-52b6-4ad7-9f8a-40ec86e373d1 tempest-VolumesTransfersV357Test-50477562 None] Transfer volume completed successfully. Aug 29 01:20:41 devstack sudo[98463]: pam_unix(sudo:session): session closed for user root Aug 29 01:20:41 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-de752545-d617-440e-8362-d04fae0901a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.705s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:20:41 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:20:41 devstack cinder-volume[86111]: DEBUG oslo_service.periodic_task [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Running periodic task VolumeManager._thread_info {{(pid=86111) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 29 01:20:41 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-de752545-d617-440e-8362-d04fae0901a5 None None] thread count: 28 {{(pid=86111) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 29 01:20:41 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-de752545-d617-440e-8362-d04fae0901a5 None None] thread info: [<_MainThread(MainThread, started 129173440548992)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86111) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 29 01:20:42 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-2d962e7a-4f3c-43f4-98bf-412b2cb8a2b6 tempest-VolumesTransfersV357Test-1831170091 None] Acquiring lock "cinder-5f7f39c9-31ce-43f1-8e77-f618f33de917-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:20:42 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-2d962e7a-4f3c-43f4-98bf-412b2cb8a2b6 tempest-VolumesTransfersV357Test-1831170091 None] Lock "cinder-5f7f39c9-31ce-43f1-8e77-f618f33de917-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:20:42 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-2d962e7a-4f3c-43f4-98bf-412b2cb8a2b6 tempest-VolumesTransfersV357Test-1831170091 None] Acquiring lock "cinder-quobyte-5f7f39c9-31ce-43f1-8e77-f618f33de917" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:20:42 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-2d962e7a-4f3c-43f4-98bf-412b2cb8a2b6 tempest-VolumesTransfersV357Test-1831170091 None] Lock "cinder-quobyte-5f7f39c9-31ce-43f1-8e77-f618f33de917" acquired by "delete_volume" :: waited 0.039s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:20:42 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[954f8cf0-c7e4-477c-b12a-bcc5e8346a88]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:20:42 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-2d962e7a-4f3c-43f4-98bf-412b2cb8a2b6 tempest-VolumesTransfersV357Test-1831170091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-5f7f39c9-31ce-43f1-8e77-f618f33de917 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:20:42 devstack sudo[98477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-5f7f39c9-31ce-43f1-8e77-f618f33de917 Aug 29 01:20:42 devstack sudo[98477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:20:43 devstack sudo[98477]: pam_unix(sudo:session): session closed for user root Aug 29 01:20:43 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-2d962e7a-4f3c-43f4-98bf-412b2cb8a2b6 tempest-VolumesTransfersV357Test-1831170091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-5f7f39c9-31ce-43f1-8e77-f618f33de917" returned: 0 in 0.697s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:20:43 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-2d962e7a-4f3c-43f4-98bf-412b2cb8a2b6 tempest-VolumesTransfersV357Test-1831170091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-5f7f39c9-31ce-43f1-8e77-f618f33de917 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:20:43 devstack sudo[98492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-5f7f39c9-31ce-43f1-8e77-f618f33de917 Aug 29 01:20:43 devstack sudo[98492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:20:43 devstack sudo[98492]: pam_unix(sudo:session): session closed for user root Aug 29 01:20:43 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-2d962e7a-4f3c-43f4-98bf-412b2cb8a2b6 tempest-VolumesTransfersV357Test-1831170091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-5f7f39c9-31ce-43f1-8e77-f618f33de917" returned: 0 in 0.415s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:20:43 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-2d962e7a-4f3c-43f4-98bf-412b2cb8a2b6 tempest-VolumesTransfersV357Test-1831170091 None] Lock "cinder-quobyte-5f7f39c9-31ce-43f1-8e77-f618f33de917" released by "delete_volume" :: held 1.216s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:20:43 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-2d962e7a-4f3c-43f4-98bf-412b2cb8a2b6 tempest-VolumesTransfersV357Test-1831170091 None] Created reservations ['bae20bd3-1519-48db-8c7c-6dd63a21995d', '53adc7cc-5966-4319-9109-7afe2f828356', '2757a8ea-91ab-48bb-8955-a8a276c72347', '631d8fea-159e-429f-ab4b-f36d5c5e5438'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:20:44 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-2d962e7a-4f3c-43f4-98bf-412b2cb8a2b6 tempest-VolumesTransfersV357Test-1831170091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:20:44 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-2d962e7a-4f3c-43f4-98bf-412b2cb8a2b6 tempest-VolumesTransfersV357Test-1831170091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:20:44 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-2d962e7a-4f3c-43f4-98bf-412b2cb8a2b6 tempest-VolumesTransfersV357Test-1831170091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:20:44 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-2d962e7a-4f3c-43f4-98bf-412b2cb8a2b6 tempest-VolumesTransfersV357Test-1831170091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:20:44 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-2d962e7a-4f3c-43f4-98bf-412b2cb8a2b6 tempest-VolumesTransfersV357Test-1831170091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:20:44 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-2d962e7a-4f3c-43f4-98bf-412b2cb8a2b6 tempest-VolumesTransfersV357Test-1831170091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:20:44 devstack sudo[98501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:20:44 devstack sudo[98501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:20:44 devstack sudo[98501]: pam_unix(sudo:session): session closed for user root Aug 29 01:20:44 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-2d962e7a-4f3c-43f4-98bf-412b2cb8a2b6 tempest-VolumesTransfersV357Test-1831170091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.388s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:20:44 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-2d962e7a-4f3c-43f4-98bf-412b2cb8a2b6 tempest-VolumesTransfersV357Test-1831170091 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:20:44 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-2d962e7a-4f3c-43f4-98bf-412b2cb8a2b6 tempest-VolumesTransfersV357Test-1831170091 None] Deleted volume successfully. Aug 29 01:20:44 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-2d962e7a-4f3c-43f4-98bf-412b2cb8a2b6 tempest-VolumesTransfersV357Test-1831170091 None] Lock "cinder-5f7f39c9-31ce-43f1-8e77-f618f33de917-delete_volume" released by "delete_volume" :: held 2.055s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:20:45 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd1ec60c-4fac-4cff-803f-16b9d20de4f8 tempest-VolumesTransfersV357Test-1089393687 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:20:45 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-fd1ec60c-4fac-4cff-803f-16b9d20de4f8 tempest-VolumesTransfersV357Test-1089393687 None] Flow 'volume_create_manager' (acf3a226-6df6-438e-847f-3039c980494f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:20:45 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-fd1ec60c-4fac-4cff-803f-16b9d20de4f8 tempest-VolumesTransfersV357Test-1089393687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16178102-0b02-42fe-ba50-91200f38361c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:20:45 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-fd1ec60c-4fac-4cff-803f-16b9d20de4f8 tempest-VolumesTransfersV357Test-1089393687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16178102-0b02-42fe-ba50-91200f38361c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:20:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2019994222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ece1cdb4-982e-447d-a26a-1fcb0812a13b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='444ecc9b1e73488798de548cd315fe50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:20:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:20:46Z,use_quota=True,user_id='1b92c58b13e24e13a2e3b627d273118a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:20:45 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-fd1ec60c-4fac-4cff-803f-16b9d20de4f8 tempest-VolumesTransfersV357Test-1089393687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9b10aa1-be6c-4d5e-b637-224b96ba7b05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:20:45 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-fd1ec60c-4fac-4cff-803f-16b9d20de4f8 tempest-VolumesTransfersV357Test-1089393687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9b10aa1-be6c-4d5e-b637-224b96ba7b05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:20:45 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-fd1ec60c-4fac-4cff-803f-16b9d20de4f8 tempest-VolumesTransfersV357Test-1089393687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95a8ee73-26b8-4c1c-a035-a7de09181871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:20:45 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-fd1ec60c-4fac-4cff-803f-16b9d20de4f8 tempest-VolumesTransfersV357Test-1089393687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95a8ee73-26b8-4c1c-a035-a7de09181871) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ece1cdb4-982e-447d-a26a-1fcb0812a13b', 'volume_name': 'volume-ece1cdb4-982e-447d-a26a-1fcb0812a13b', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:20:45 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-fd1ec60c-4fac-4cff-803f-16b9d20de4f8 tempest-VolumesTransfersV357Test-1089393687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad55030f-718c-4568-bc62-7053cb9ae32b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:20:45 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-fd1ec60c-4fac-4cff-803f-16b9d20de4f8 tempest-VolumesTransfersV357Test-1089393687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad55030f-718c-4568-bc62-7053cb9ae32b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:20:45 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-fd1ec60c-4fac-4cff-803f-16b9d20de4f8 tempest-VolumesTransfersV357Test-1089393687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af19ad18-824c-42e3-8498-4fe945dcd1f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:20:45 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-fd1ec60c-4fac-4cff-803f-16b9d20de4f8 tempest-VolumesTransfersV357Test-1089393687 None] Volume ece1cdb4-982e-447d-a26a-1fcb0812a13b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ece1cdb4-982e-447d-a26a-1fcb0812a13b', 'volume_size': 1} Aug 29 01:20:45 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-fd1ec60c-4fac-4cff-803f-16b9d20de4f8 tempest-VolumesTransfersV357Test-1089393687 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:20:45 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-fd1ec60c-4fac-4cff-803f-16b9d20de4f8 tempest-VolumesTransfersV357Test-1089393687 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:20:45 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-fd1ec60c-4fac-4cff-803f-16b9d20de4f8 tempest-VolumesTransfersV357Test-1089393687 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:20:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2019994222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ece1cdb4-982e-447d-a26a-1fcb0812a13b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='444ecc9b1e73488798de548cd315fe50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:20:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:20:46Z,use_quota=True,user_id='1b92c58b13e24e13a2e3b627d273118a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:20:45 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-fd1ec60c-4fac-4cff-803f-16b9d20de4f8 tempest-VolumesTransfersV357Test-1089393687 None] Creating volume ece1cdb4-982e-447d-a26a-1fcb0812a13b {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:20:45 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-fd1ec60c-4fac-4cff-803f-16b9d20de4f8 tempest-VolumesTransfersV357Test-1089393687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:20:45 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-fd1ec60c-4fac-4cff-803f-16b9d20de4f8 tempest-VolumesTransfersV357Test-1089393687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:20:45 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-fd1ec60c-4fac-4cff-803f-16b9d20de4f8 tempest-VolumesTransfersV357Test-1089393687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:20:45 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-fd1ec60c-4fac-4cff-803f-16b9d20de4f8 tempest-VolumesTransfersV357Test-1089393687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:20:45 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-fd1ec60c-4fac-4cff-803f-16b9d20de4f8 tempest-VolumesTransfersV357Test-1089393687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:20:45 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-fd1ec60c-4fac-4cff-803f-16b9d20de4f8 tempest-VolumesTransfersV357Test-1089393687 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:20:45 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-fd1ec60c-4fac-4cff-803f-16b9d20de4f8 tempest-VolumesTransfersV357Test-1089393687 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:20:45 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-fd1ec60c-4fac-4cff-803f-16b9d20de4f8 tempest-VolumesTransfersV357Test-1089393687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ece1cdb4-982e-447d-a26a-1fcb0812a13b 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:20:46 devstack sudo[98505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ece1cdb4-982e-447d-a26a-1fcb0812a13b 1073741824 Aug 29 01:20:46 devstack sudo[98505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:20:46 devstack sudo[98505]: pam_unix(sudo:session): session closed for user root Aug 29 01:20:46 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-fd1ec60c-4fac-4cff-803f-16b9d20de4f8 tempest-VolumesTransfersV357Test-1089393687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ece1cdb4-982e-447d-a26a-1fcb0812a13b 1073741824" returned: 0 in 0.881s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:20:46 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-fd1ec60c-4fac-4cff-803f-16b9d20de4f8 tempest-VolumesTransfersV357Test-1089393687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ece1cdb4-982e-447d-a26a-1fcb0812a13b {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:20:46 devstack sudo[98512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ece1cdb4-982e-447d-a26a-1fcb0812a13b Aug 29 01:20:46 devstack sudo[98512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:20:47 devstack sudo[98512]: pam_unix(sudo:session): session closed for user root Aug 29 01:20:47 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-fd1ec60c-4fac-4cff-803f-16b9d20de4f8 tempest-VolumesTransfersV357Test-1089393687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ece1cdb4-982e-447d-a26a-1fcb0812a13b" returned: 0 in 0.786s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:20:47 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-fd1ec60c-4fac-4cff-803f-16b9d20de4f8 tempest-VolumesTransfersV357Test-1089393687 None] <== create_volume: return (1744ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:20:47 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-fd1ec60c-4fac-4cff-803f-16b9d20de4f8 tempest-VolumesTransfersV357Test-1089393687 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.750s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:20:47 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-fd1ec60c-4fac-4cff-803f-16b9d20de4f8 tempest-VolumesTransfersV357Test-1089393687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af19ad18-824c-42e3-8498-4fe945dcd1f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ece1cdb4-982e-447d-a26a-1fcb0812a13b', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:20:47 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-fd1ec60c-4fac-4cff-803f-16b9d20de4f8 tempest-VolumesTransfersV357Test-1089393687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94cd7c0b-2a57-4491-ae2c-148cb0f42dea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:20:47 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-fd1ec60c-4fac-4cff-803f-16b9d20de4f8 tempest-VolumesTransfersV357Test-1089393687 None] Volume volume-ece1cdb4-982e-447d-a26a-1fcb0812a13b (ece1cdb4-982e-447d-a26a-1fcb0812a13b): created successfully Aug 29 01:20:47 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-fd1ec60c-4fac-4cff-803f-16b9d20de4f8 tempest-VolumesTransfersV357Test-1089393687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94cd7c0b-2a57-4491-ae2c-148cb0f42dea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:20:48 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-fd1ec60c-4fac-4cff-803f-16b9d20de4f8 tempest-VolumesTransfersV357Test-1089393687 None] Flow 'volume_create_manager' (acf3a226-6df6-438e-847f-3039c980494f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:20:48 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-fd1ec60c-4fac-4cff-803f-16b9d20de4f8 tempest-VolumesTransfersV357Test-1089393687 None] Created volume successfully. Aug 29 01:20:49 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-acd4df18-aa33-4a27-b3e4-33f9dd2f1119 tempest-TestMinimumBasicScenario-220803035 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:20:49 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-acd4df18-aa33-4a27-b3e4-33f9dd2f1119 tempest-TestMinimumBasicScenario-220803035 None] Flow 'volume_create_manager' (12e82f30-ada1-4e54-a48c-55db24df8683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:20:49 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-acd4df18-aa33-4a27-b3e4-33f9dd2f1119 tempest-TestMinimumBasicScenario-220803035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63083fd3-759d-4ec4-b1db-9ad94514dc5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:20:49 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-acd4df18-aa33-4a27-b3e4-33f9dd2f1119 tempest-TestMinimumBasicScenario-220803035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63083fd3-759d-4ec4-b1db-9ad94514dc5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:20:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-420143011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53f75ed2-1fc9-4753-b665-b370fa5b51bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='982687fb64ca40e0af801ab12978c32a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:20:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:20:49Z,use_quota=True,user_id='be471177376641ac80a1d4a167dee167',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:20:49 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-acd4df18-aa33-4a27-b3e4-33f9dd2f1119 tempest-TestMinimumBasicScenario-220803035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bceb304f-062d-4dcc-8883-e6db08110646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:20:49 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-acd4df18-aa33-4a27-b3e4-33f9dd2f1119 tempest-TestMinimumBasicScenario-220803035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bceb304f-062d-4dcc-8883-e6db08110646) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:20:49 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-acd4df18-aa33-4a27-b3e4-33f9dd2f1119 tempest-TestMinimumBasicScenario-220803035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec2c9419-442d-4b19-86ac-b6828af96ee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:20:49 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-acd4df18-aa33-4a27-b3e4-33f9dd2f1119 tempest-TestMinimumBasicScenario-220803035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec2c9419-442d-4b19-86ac-b6828af96ee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53f75ed2-1fc9-4753-b665-b370fa5b51bf', 'volume_name': 'volume-53f75ed2-1fc9-4753-b665-b370fa5b51bf', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:20:49 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-acd4df18-aa33-4a27-b3e4-33f9dd2f1119 tempest-TestMinimumBasicScenario-220803035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ce27db6-1d2e-4e52-9ba3-2a5b17ea3ba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:20:49 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-acd4df18-aa33-4a27-b3e4-33f9dd2f1119 tempest-TestMinimumBasicScenario-220803035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ce27db6-1d2e-4e52-9ba3-2a5b17ea3ba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:20:49 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-acd4df18-aa33-4a27-b3e4-33f9dd2f1119 tempest-TestMinimumBasicScenario-220803035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a5514b2-11dd-404e-8eb3-d952cdea6a7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:20:49 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-acd4df18-aa33-4a27-b3e4-33f9dd2f1119 tempest-TestMinimumBasicScenario-220803035 None] Volume 53f75ed2-1fc9-4753-b665-b370fa5b51bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53f75ed2-1fc9-4753-b665-b370fa5b51bf', 'volume_size': 1} Aug 29 01:20:49 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-acd4df18-aa33-4a27-b3e4-33f9dd2f1119 tempest-TestMinimumBasicScenario-220803035 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:20:49 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-acd4df18-aa33-4a27-b3e4-33f9dd2f1119 tempest-TestMinimumBasicScenario-220803035 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:20:49 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-acd4df18-aa33-4a27-b3e4-33f9dd2f1119 tempest-TestMinimumBasicScenario-220803035 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:20:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-420143011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53f75ed2-1fc9-4753-b665-b370fa5b51bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='982687fb64ca40e0af801ab12978c32a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:20:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:20:49Z,use_quota=True,user_id='be471177376641ac80a1d4a167dee167',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:20:49 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-acd4df18-aa33-4a27-b3e4-33f9dd2f1119 tempest-TestMinimumBasicScenario-220803035 None] Creating volume 53f75ed2-1fc9-4753-b665-b370fa5b51bf {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:20:49 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-acd4df18-aa33-4a27-b3e4-33f9dd2f1119 tempest-TestMinimumBasicScenario-220803035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:20:49 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-acd4df18-aa33-4a27-b3e4-33f9dd2f1119 tempest-TestMinimumBasicScenario-220803035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:20:49 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-acd4df18-aa33-4a27-b3e4-33f9dd2f1119 tempest-TestMinimumBasicScenario-220803035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:20:49 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-acd4df18-aa33-4a27-b3e4-33f9dd2f1119 tempest-TestMinimumBasicScenario-220803035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:20:49 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-acd4df18-aa33-4a27-b3e4-33f9dd2f1119 tempest-TestMinimumBasicScenario-220803035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:20:49 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-acd4df18-aa33-4a27-b3e4-33f9dd2f1119 tempest-TestMinimumBasicScenario-220803035 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:20:49 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-acd4df18-aa33-4a27-b3e4-33f9dd2f1119 tempest-TestMinimumBasicScenario-220803035 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:20:49 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-acd4df18-aa33-4a27-b3e4-33f9dd2f1119 tempest-TestMinimumBasicScenario-220803035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-53f75ed2-1fc9-4753-b665-b370fa5b51bf 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:20:49 devstack sudo[98595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-53f75ed2-1fc9-4753-b665-b370fa5b51bf 1073741824 Aug 29 01:20:49 devstack sudo[98595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:20:50 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-68fbf9ee-0203-431e-aa29-ed38577b0010 tempest-VolumesTransfersV357Test-1831170091 None] Acquiring lock "cinder-ece1cdb4-982e-447d-a26a-1fcb0812a13b-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:20:50 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-68fbf9ee-0203-431e-aa29-ed38577b0010 tempest-VolumesTransfersV357Test-1831170091 None] Lock "cinder-ece1cdb4-982e-447d-a26a-1fcb0812a13b-delete_volume" acquired by "delete_volume" :: waited 0.084s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:20:50 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-68fbf9ee-0203-431e-aa29-ed38577b0010 tempest-VolumesTransfersV357Test-1831170091 None] Acquiring lock "cinder-quobyte-ece1cdb4-982e-447d-a26a-1fcb0812a13b" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:20:50 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-68fbf9ee-0203-431e-aa29-ed38577b0010 tempest-VolumesTransfersV357Test-1831170091 None] Lock "cinder-quobyte-ece1cdb4-982e-447d-a26a-1fcb0812a13b" acquired by "delete_volume" :: waited 0.036s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:20:50 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[5769e055-803d-4b66-ac89-f69d8bc5c350]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:20:50 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-68fbf9ee-0203-431e-aa29-ed38577b0010 tempest-VolumesTransfersV357Test-1831170091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ece1cdb4-982e-447d-a26a-1fcb0812a13b {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:20:51 devstack sudo[98606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ece1cdb4-982e-447d-a26a-1fcb0812a13b Aug 29 01:20:51 devstack sudo[98606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:20:51 devstack sudo[98595]: pam_unix(sudo:session): session closed for user root Aug 29 01:20:51 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-acd4df18-aa33-4a27-b3e4-33f9dd2f1119 tempest-TestMinimumBasicScenario-220803035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-53f75ed2-1fc9-4753-b665-b370fa5b51bf 1073741824" returned: 0 in 1.800s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:20:51 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-acd4df18-aa33-4a27-b3e4-33f9dd2f1119 tempest-TestMinimumBasicScenario-220803035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-53f75ed2-1fc9-4753-b665-b370fa5b51bf {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:20:51 devstack sudo[98612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-53f75ed2-1fc9-4753-b665-b370fa5b51bf Aug 29 01:20:51 devstack sudo[98612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:20:51 devstack sudo[98606]: pam_unix(sudo:session): session closed for user root Aug 29 01:20:51 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-68fbf9ee-0203-431e-aa29-ed38577b0010 tempest-VolumesTransfersV357Test-1831170091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ece1cdb4-982e-447d-a26a-1fcb0812a13b" returned: 0 in 0.864s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:20:51 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-68fbf9ee-0203-431e-aa29-ed38577b0010 tempest-VolumesTransfersV357Test-1831170091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ece1cdb4-982e-447d-a26a-1fcb0812a13b {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:20:51 devstack sudo[98614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ece1cdb4-982e-447d-a26a-1fcb0812a13b Aug 29 01:20:51 devstack sudo[98614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:20:52 devstack sudo[98612]: pam_unix(sudo:session): session closed for user root Aug 29 01:20:52 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-acd4df18-aa33-4a27-b3e4-33f9dd2f1119 tempest-TestMinimumBasicScenario-220803035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-53f75ed2-1fc9-4753-b665-b370fa5b51bf" returned: 0 in 0.432s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:20:52 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-acd4df18-aa33-4a27-b3e4-33f9dd2f1119 tempest-TestMinimumBasicScenario-220803035 None] <== create_volume: return (2315ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:20:52 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-acd4df18-aa33-4a27-b3e4-33f9dd2f1119 tempest-TestMinimumBasicScenario-220803035 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.324s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:20:52 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-acd4df18-aa33-4a27-b3e4-33f9dd2f1119 tempest-TestMinimumBasicScenario-220803035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a5514b2-11dd-404e-8eb3-d952cdea6a7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53f75ed2-1fc9-4753-b665-b370fa5b51bf', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:20:52 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-acd4df18-aa33-4a27-b3e4-33f9dd2f1119 tempest-TestMinimumBasicScenario-220803035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b5aff4b-005f-4005-975b-360e0eaa69d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:20:52 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-acd4df18-aa33-4a27-b3e4-33f9dd2f1119 tempest-TestMinimumBasicScenario-220803035 None] Volume volume-53f75ed2-1fc9-4753-b665-b370fa5b51bf (53f75ed2-1fc9-4753-b665-b370fa5b51bf): created successfully Aug 29 01:20:52 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-acd4df18-aa33-4a27-b3e4-33f9dd2f1119 tempest-TestMinimumBasicScenario-220803035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b5aff4b-005f-4005-975b-360e0eaa69d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:20:52 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-acd4df18-aa33-4a27-b3e4-33f9dd2f1119 tempest-TestMinimumBasicScenario-220803035 None] Flow 'volume_create_manager' (12e82f30-ada1-4e54-a48c-55db24df8683) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:20:52 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-acd4df18-aa33-4a27-b3e4-33f9dd2f1119 tempest-TestMinimumBasicScenario-220803035 None] Created volume successfully. Aug 29 01:20:52 devstack sudo[98614]: pam_unix(sudo:session): session closed for user root Aug 29 01:20:52 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-68fbf9ee-0203-431e-aa29-ed38577b0010 tempest-VolumesTransfersV357Test-1831170091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ece1cdb4-982e-447d-a26a-1fcb0812a13b" returned: 0 in 0.575s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:20:52 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-68fbf9ee-0203-431e-aa29-ed38577b0010 tempest-VolumesTransfersV357Test-1831170091 None] Lock "cinder-quobyte-ece1cdb4-982e-447d-a26a-1fcb0812a13b" released by "delete_volume" :: held 1.594s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:20:52 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-68fbf9ee-0203-431e-aa29-ed38577b0010 tempest-VolumesTransfersV357Test-1831170091 None] Created reservations ['d1c273a5-0f85-46ad-946f-05200921dc7e', '601d6a33-326c-4224-8208-a5bee23d29c3', 'c74bb945-cc2b-42f2-abc8-d2d4d901fd8e', '170e2ca9-25a2-41a8-a7d5-093aa20bbe45'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:20:52 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-68fbf9ee-0203-431e-aa29-ed38577b0010 tempest-VolumesTransfersV357Test-1831170091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:20:52 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-68fbf9ee-0203-431e-aa29-ed38577b0010 tempest-VolumesTransfersV357Test-1831170091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:20:52 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-68fbf9ee-0203-431e-aa29-ed38577b0010 tempest-VolumesTransfersV357Test-1831170091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:20:52 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-68fbf9ee-0203-431e-aa29-ed38577b0010 tempest-VolumesTransfersV357Test-1831170091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:20:52 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-68fbf9ee-0203-431e-aa29-ed38577b0010 tempest-VolumesTransfersV357Test-1831170091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:20:52 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-68fbf9ee-0203-431e-aa29-ed38577b0010 tempest-VolumesTransfersV357Test-1831170091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:20:52 devstack sudo[98618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:20:52 devstack sudo[98618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:20:53 devstack sudo[98618]: pam_unix(sudo:session): session closed for user root Aug 29 01:20:53 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-68fbf9ee-0203-431e-aa29-ed38577b0010 tempest-VolumesTransfersV357Test-1831170091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.559s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:20:53 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-68fbf9ee-0203-431e-aa29-ed38577b0010 tempest-VolumesTransfersV357Test-1831170091 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:20:53 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-68fbf9ee-0203-431e-aa29-ed38577b0010 tempest-VolumesTransfersV357Test-1831170091 None] Deleted volume successfully. Aug 29 01:20:53 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-68fbf9ee-0203-431e-aa29-ed38577b0010 tempest-VolumesTransfersV357Test-1831170091 None] Lock "cinder-ece1cdb4-982e-447d-a26a-1fcb0812a13b-delete_volume" released by "delete_volume" :: held 2.735s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:20:54 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [req-0ec122ee-a4ef-406a-9d33-447e36e305ea req-4776b1df-43aa-4c19-b33b-7e94d99affdc tempest-TestMinimumBasicScenario-220803035 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:20:54 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [req-0ec122ee-a4ef-406a-9d33-447e36e305ea req-4776b1df-43aa-4c19-b33b-7e94d99affdc tempest-TestMinimumBasicScenario-220803035 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:20:54 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [req-0ec122ee-a4ef-406a-9d33-447e36e305ea req-4776b1df-43aa-4c19-b33b-7e94d99affdc tempest-TestMinimumBasicScenario-220803035 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.032s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:20:54 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [req-0ec122ee-a4ef-406a-9d33-447e36e305ea req-4776b1df-43aa-4c19-b33b-7e94d99affdc tempest-TestMinimumBasicScenario-220803035 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630', 'name': 'volume-53f75ed2-1fc9-4753-b665-b370fa5b51bf', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'af02a8a8-7007-4a9a-ae26-c02f3243bd9d', 'enforce_multipath': True} {{(pid=86111) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 29 01:20:54 devstack cinder-volume[86111]: INFO cinder.volume.manager [req-0ec122ee-a4ef-406a-9d33-447e36e305ea req-4776b1df-43aa-4c19-b33b-7e94d99affdc tempest-TestMinimumBasicScenario-220803035 None] attachment_update completed successfully. Aug 29 01:20:56 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [req-488e6f20-dd14-471a-9a9b-45e194c53e2d req-fcf5dd25-3532-4d36-8fcf-213edd185cd1 tempest-VolumesSnapshotsTestJSON-461653286 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:20:56 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [req-488e6f20-dd14-471a-9a9b-45e194c53e2d req-fcf5dd25-3532-4d36-8fcf-213edd185cd1 tempest-VolumesSnapshotsTestJSON-461653286 None] Flow 'volume_create_manager' (33edc56d-5931-4ff1-acca-37200c4f4a4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:20:56 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [req-488e6f20-dd14-471a-9a9b-45e194c53e2d req-fcf5dd25-3532-4d36-8fcf-213edd185cd1 tempest-VolumesSnapshotsTestJSON-461653286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ea9d72b-f44e-4b8f-8332-9fac478b87af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:20:56 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [req-488e6f20-dd14-471a-9a9b-45e194c53e2d req-fcf5dd25-3532-4d36-8fcf-213edd185cd1 tempest-VolumesSnapshotsTestJSON-461653286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ea9d72b-f44e-4b8f-8332-9fac478b87af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:20:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1310317044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8885b9c-2478-4a3a-87cf-d6215e9431e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d5d5f85c4de4dfe975f8db4dd576d53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:20:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:20:56Z,use_quota=True,user_id='2114acacb98e483f8e7d5a9d1c0fa2e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:20:56 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [req-488e6f20-dd14-471a-9a9b-45e194c53e2d req-fcf5dd25-3532-4d36-8fcf-213edd185cd1 tempest-VolumesSnapshotsTestJSON-461653286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f209a410-ff4b-41e6-b568-ca072a897c5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:20:56 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [req-488e6f20-dd14-471a-9a9b-45e194c53e2d req-fcf5dd25-3532-4d36-8fcf-213edd185cd1 tempest-VolumesSnapshotsTestJSON-461653286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f209a410-ff4b-41e6-b568-ca072a897c5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:20:56 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [req-488e6f20-dd14-471a-9a9b-45e194c53e2d req-fcf5dd25-3532-4d36-8fcf-213edd185cd1 tempest-VolumesSnapshotsTestJSON-461653286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f099bb2-464f-40e4-a5ff-60357f97586a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:20:56 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [req-488e6f20-dd14-471a-9a9b-45e194c53e2d req-fcf5dd25-3532-4d36-8fcf-213edd185cd1 tempest-VolumesSnapshotsTestJSON-461653286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f099bb2-464f-40e4-a5ff-60357f97586a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8885b9c-2478-4a3a-87cf-d6215e9431e9', 'volume_name': 'volume-a8885b9c-2478-4a3a-87cf-d6215e9431e9', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:20:56 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [req-488e6f20-dd14-471a-9a9b-45e194c53e2d req-fcf5dd25-3532-4d36-8fcf-213edd185cd1 tempest-VolumesSnapshotsTestJSON-461653286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af35fea5-b125-40d8-bd42-7cd7e3e25975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:20:56 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [req-488e6f20-dd14-471a-9a9b-45e194c53e2d req-fcf5dd25-3532-4d36-8fcf-213edd185cd1 tempest-VolumesSnapshotsTestJSON-461653286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af35fea5-b125-40d8-bd42-7cd7e3e25975) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:20:56 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [req-488e6f20-dd14-471a-9a9b-45e194c53e2d req-fcf5dd25-3532-4d36-8fcf-213edd185cd1 tempest-VolumesSnapshotsTestJSON-461653286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2f9136b-1706-4e33-8d7a-717c2e82d90a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:20:56 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [req-488e6f20-dd14-471a-9a9b-45e194c53e2d req-fcf5dd25-3532-4d36-8fcf-213edd185cd1 tempest-VolumesSnapshotsTestJSON-461653286 None] Volume a8885b9c-2478-4a3a-87cf-d6215e9431e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8885b9c-2478-4a3a-87cf-d6215e9431e9', 'volume_size': 1} Aug 29 01:20:56 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [req-488e6f20-dd14-471a-9a9b-45e194c53e2d req-fcf5dd25-3532-4d36-8fcf-213edd185cd1 tempest-VolumesSnapshotsTestJSON-461653286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:20:56 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [req-488e6f20-dd14-471a-9a9b-45e194c53e2d req-fcf5dd25-3532-4d36-8fcf-213edd185cd1 tempest-VolumesSnapshotsTestJSON-461653286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:20:56 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [req-488e6f20-dd14-471a-9a9b-45e194c53e2d req-fcf5dd25-3532-4d36-8fcf-213edd185cd1 tempest-VolumesSnapshotsTestJSON-461653286 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:20:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1310317044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8885b9c-2478-4a3a-87cf-d6215e9431e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d5d5f85c4de4dfe975f8db4dd576d53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:20:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:20:56Z,use_quota=True,user_id='2114acacb98e483f8e7d5a9d1c0fa2e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:20:56 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [req-488e6f20-dd14-471a-9a9b-45e194c53e2d req-fcf5dd25-3532-4d36-8fcf-213edd185cd1 tempest-VolumesSnapshotsTestJSON-461653286 None] Creating volume a8885b9c-2478-4a3a-87cf-d6215e9431e9 {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:20:56 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [req-488e6f20-dd14-471a-9a9b-45e194c53e2d req-fcf5dd25-3532-4d36-8fcf-213edd185cd1 tempest-VolumesSnapshotsTestJSON-461653286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:20:56 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [req-488e6f20-dd14-471a-9a9b-45e194c53e2d req-fcf5dd25-3532-4d36-8fcf-213edd185cd1 tempest-VolumesSnapshotsTestJSON-461653286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:20:56 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [req-488e6f20-dd14-471a-9a9b-45e194c53e2d req-fcf5dd25-3532-4d36-8fcf-213edd185cd1 tempest-VolumesSnapshotsTestJSON-461653286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:20:56 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [req-488e6f20-dd14-471a-9a9b-45e194c53e2d req-fcf5dd25-3532-4d36-8fcf-213edd185cd1 tempest-VolumesSnapshotsTestJSON-461653286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:20:56 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [req-488e6f20-dd14-471a-9a9b-45e194c53e2d req-fcf5dd25-3532-4d36-8fcf-213edd185cd1 tempest-VolumesSnapshotsTestJSON-461653286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:20:56 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [req-488e6f20-dd14-471a-9a9b-45e194c53e2d req-fcf5dd25-3532-4d36-8fcf-213edd185cd1 tempest-VolumesSnapshotsTestJSON-461653286 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:20:56 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [req-488e6f20-dd14-471a-9a9b-45e194c53e2d req-fcf5dd25-3532-4d36-8fcf-213edd185cd1 tempest-VolumesSnapshotsTestJSON-461653286 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:20:56 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [req-488e6f20-dd14-471a-9a9b-45e194c53e2d req-fcf5dd25-3532-4d36-8fcf-213edd185cd1 tempest-VolumesSnapshotsTestJSON-461653286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a8885b9c-2478-4a3a-87cf-d6215e9431e9 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:20:56 devstack sudo[99042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a8885b9c-2478-4a3a-87cf-d6215e9431e9 1073741824 Aug 29 01:20:56 devstack sudo[99042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:20:57 devstack sudo[99042]: pam_unix(sudo:session): session closed for user root Aug 29 01:20:57 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [req-488e6f20-dd14-471a-9a9b-45e194c53e2d req-fcf5dd25-3532-4d36-8fcf-213edd185cd1 tempest-VolumesSnapshotsTestJSON-461653286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a8885b9c-2478-4a3a-87cf-d6215e9431e9 1073741824" returned: 0 in 0.643s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:20:57 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [req-488e6f20-dd14-471a-9a9b-45e194c53e2d req-fcf5dd25-3532-4d36-8fcf-213edd185cd1 tempest-VolumesSnapshotsTestJSON-461653286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a8885b9c-2478-4a3a-87cf-d6215e9431e9 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:20:57 devstack sudo[99048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a8885b9c-2478-4a3a-87cf-d6215e9431e9 Aug 29 01:20:57 devstack sudo[99048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:20:57 devstack sudo[99048]: pam_unix(sudo:session): session closed for user root Aug 29 01:20:57 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [req-488e6f20-dd14-471a-9a9b-45e194c53e2d req-fcf5dd25-3532-4d36-8fcf-213edd185cd1 tempest-VolumesSnapshotsTestJSON-461653286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a8885b9c-2478-4a3a-87cf-d6215e9431e9" returned: 0 in 0.368s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:20:57 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [req-488e6f20-dd14-471a-9a9b-45e194c53e2d req-fcf5dd25-3532-4d36-8fcf-213edd185cd1 tempest-VolumesSnapshotsTestJSON-461653286 None] <== create_volume: return (1112ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:20:57 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [req-488e6f20-dd14-471a-9a9b-45e194c53e2d req-fcf5dd25-3532-4d36-8fcf-213edd185cd1 tempest-VolumesSnapshotsTestJSON-461653286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.125s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:20:57 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [req-488e6f20-dd14-471a-9a9b-45e194c53e2d req-fcf5dd25-3532-4d36-8fcf-213edd185cd1 tempest-VolumesSnapshotsTestJSON-461653286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2f9136b-1706-4e33-8d7a-717c2e82d90a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8885b9c-2478-4a3a-87cf-d6215e9431e9', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:20:57 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [req-488e6f20-dd14-471a-9a9b-45e194c53e2d req-fcf5dd25-3532-4d36-8fcf-213edd185cd1 tempest-VolumesSnapshotsTestJSON-461653286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d23dfa84-8d3e-4deb-a0c7-003df8a4c602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:20:57 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [req-488e6f20-dd14-471a-9a9b-45e194c53e2d req-fcf5dd25-3532-4d36-8fcf-213edd185cd1 tempest-VolumesSnapshotsTestJSON-461653286 None] Volume volume-a8885b9c-2478-4a3a-87cf-d6215e9431e9 (a8885b9c-2478-4a3a-87cf-d6215e9431e9): created successfully Aug 29 01:20:57 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [req-488e6f20-dd14-471a-9a9b-45e194c53e2d req-fcf5dd25-3532-4d36-8fcf-213edd185cd1 tempest-VolumesSnapshotsTestJSON-461653286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d23dfa84-8d3e-4deb-a0c7-003df8a4c602) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:20:57 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [req-488e6f20-dd14-471a-9a9b-45e194c53e2d req-fcf5dd25-3532-4d36-8fcf-213edd185cd1 tempest-VolumesSnapshotsTestJSON-461653286 None] Flow 'volume_create_manager' (33edc56d-5931-4ff1-acca-37200c4f4a4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:20:57 devstack cinder-volume[86111]: INFO cinder.volume.manager [req-488e6f20-dd14-471a-9a9b-45e194c53e2d req-fcf5dd25-3532-4d36-8fcf-213edd185cd1 tempest-VolumesSnapshotsTestJSON-461653286 None] Created volume successfully. Aug 29 01:20:59 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [req-6d95135c-8f00-4b70-ac8a-cd43c90ea69c req-eb6e8b98-d3e3-4dd5-b10a-78c73fe1f190 tempest-VolumesSnapshotsTestJSON-461653286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:20:59 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [req-6d95135c-8f00-4b70-ac8a-cd43c90ea69c req-eb6e8b98-d3e3-4dd5-b10a-78c73fe1f190 tempest-VolumesSnapshotsTestJSON-461653286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:20:59 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [req-6d95135c-8f00-4b70-ac8a-cd43c90ea69c req-eb6e8b98-d3e3-4dd5-b10a-78c73fe1f190 tempest-VolumesSnapshotsTestJSON-461653286 None] Creating offline snapshot b3869822-faa1-4e6c-b378-0bb09e019922 of volume a8885b9c-2478-4a3a-87cf-d6215e9431e9 {{(pid=86111) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 29 01:20:59 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[26ac7299-b5ae-41c3-a9d3-9082eb665fe6]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:20:59 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [req-6d95135c-8f00-4b70-ac8a-cd43c90ea69c req-eb6e8b98-d3e3-4dd5-b10a-78c73fe1f190 tempest-VolumesSnapshotsTestJSON-461653286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a8885b9c-2478-4a3a-87cf-d6215e9431e9 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:20:59 devstack sudo[99052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a8885b9c-2478-4a3a-87cf-d6215e9431e9 Aug 29 01:20:59 devstack sudo[99052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:20:59 devstack sudo[99052]: pam_unix(sudo:session): session closed for user root Aug 29 01:20:59 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [req-6d95135c-8f00-4b70-ac8a-cd43c90ea69c req-eb6e8b98-d3e3-4dd5-b10a-78c73fe1f190 tempest-VolumesSnapshotsTestJSON-461653286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a8885b9c-2478-4a3a-87cf-d6215e9431e9" returned: 0 in 0.505s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:20:59 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [req-6d95135c-8f00-4b70-ac8a-cd43c90ea69c req-eb6e8b98-d3e3-4dd5-b10a-78c73fe1f190 tempest-VolumesSnapshotsTestJSON-461653286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a8885b9c-2478-4a3a-87cf-d6215e9431e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a8885b9c-2478-4a3a-87cf-d6215e9431e9.b3869822-faa1-4e6c-b378-0bb09e019922 1G {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:20:59 devstack sudo[99057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a8885b9c-2478-4a3a-87cf-d6215e9431e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a8885b9c-2478-4a3a-87cf-d6215e9431e9.b3869822-faa1-4e6c-b378-0bb09e019922 1G Aug 29 01:20:59 devstack sudo[99057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:21:00 devstack sudo[99057]: pam_unix(sudo:session): session closed for user root Aug 29 01:21:00 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [req-6d95135c-8f00-4b70-ac8a-cd43c90ea69c req-eb6e8b98-d3e3-4dd5-b10a-78c73fe1f190 tempest-VolumesSnapshotsTestJSON-461653286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a8885b9c-2478-4a3a-87cf-d6215e9431e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a8885b9c-2478-4a3a-87cf-d6215e9431e9.b3869822-faa1-4e6c-b378-0bb09e019922 1G" returned: 0 in 0.537s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:21:00 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [req-6d95135c-8f00-4b70-ac8a-cd43c90ea69c req-eb6e8b98-d3e3-4dd5-b10a-78c73fe1f190 tempest-VolumesSnapshotsTestJSON-461653286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8885b9c-2478-4a3a-87cf-d6215e9431e9 -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a8885b9c-2478-4a3a-87cf-d6215e9431e9.b3869822-faa1-4e6c-b378-0bb09e019922 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:21:00 devstack sudo[99063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8885b9c-2478-4a3a-87cf-d6215e9431e9 -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a8885b9c-2478-4a3a-87cf-d6215e9431e9.b3869822-faa1-4e6c-b378-0bb09e019922 Aug 29 01:21:00 devstack sudo[99063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:21:00 devstack sudo[99063]: pam_unix(sudo:session): session closed for user root Aug 29 01:21:00 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [req-6d95135c-8f00-4b70-ac8a-cd43c90ea69c req-eb6e8b98-d3e3-4dd5-b10a-78c73fe1f190 tempest-VolumesSnapshotsTestJSON-461653286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8885b9c-2478-4a3a-87cf-d6215e9431e9 -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a8885b9c-2478-4a3a-87cf-d6215e9431e9.b3869822-faa1-4e6c-b378-0bb09e019922" returned: 0 in 0.363s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:21:00 devstack cinder-volume[86111]: WARNING cinder.volume.drivers.remotefs [req-6d95135c-8f00-4b70-ac8a-cd43c90ea69c req-eb6e8b98-d3e3-4dd5-b10a-78c73fe1f190 tempest-VolumesSnapshotsTestJSON-461653286 None] /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a8885b9c-2478-4a3a-87cf-d6215e9431e9.b3869822-faa1-4e6c-b378-0bb09e019922 is being set with open permissions: ugo+rw Aug 29 01:21:00 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [req-6d95135c-8f00-4b70-ac8a-cd43c90ea69c req-eb6e8b98-d3e3-4dd5-b10a-78c73fe1f190 tempest-VolumesSnapshotsTestJSON-461653286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a8885b9c-2478-4a3a-87cf-d6215e9431e9.b3869822-faa1-4e6c-b378-0bb09e019922 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:21:00 devstack sudo[99068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a8885b9c-2478-4a3a-87cf-d6215e9431e9.b3869822-faa1-4e6c-b378-0bb09e019922 Aug 29 01:21:00 devstack sudo[99068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:21:01 devstack sudo[99068]: pam_unix(sudo:session): session closed for user root Aug 29 01:21:01 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [req-6d95135c-8f00-4b70-ac8a-cd43c90ea69c req-eb6e8b98-d3e3-4dd5-b10a-78c73fe1f190 tempest-VolumesSnapshotsTestJSON-461653286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a8885b9c-2478-4a3a-87cf-d6215e9431e9.b3869822-faa1-4e6c-b378-0bb09e019922" returned: 0 in 0.497s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:21:01 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [req-6d95135c-8f00-4b70-ac8a-cd43c90ea69c req-eb6e8b98-d3e3-4dd5-b10a-78c73fe1f190 tempest-VolumesSnapshotsTestJSON-461653286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a8885b9c-2478-4a3a-87cf-d6215e9431e9.info {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:21:01 devstack sudo[99071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a8885b9c-2478-4a3a-87cf-d6215e9431e9.info Aug 29 01:21:01 devstack sudo[99071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:21:01 devstack sudo[99071]: pam_unix(sudo:session): session closed for user root Aug 29 01:21:01 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [req-6d95135c-8f00-4b70-ac8a-cd43c90ea69c req-eb6e8b98-d3e3-4dd5-b10a-78c73fe1f190 tempest-VolumesSnapshotsTestJSON-461653286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a8885b9c-2478-4a3a-87cf-d6215e9431e9.info" returned: 0 in 0.432s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:21:01 devstack cinder-volume[86111]: WARNING cinder.volume.drivers.remotefs [req-6d95135c-8f00-4b70-ac8a-cd43c90ea69c req-eb6e8b98-d3e3-4dd5-b10a-78c73fe1f190 tempest-VolumesSnapshotsTestJSON-461653286 None] /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a8885b9c-2478-4a3a-87cf-d6215e9431e9.info is being set with open permissions: ugo+rw Aug 29 01:21:01 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [req-6d95135c-8f00-4b70-ac8a-cd43c90ea69c req-eb6e8b98-d3e3-4dd5-b10a-78c73fe1f190 tempest-VolumesSnapshotsTestJSON-461653286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a8885b9c-2478-4a3a-87cf-d6215e9431e9.info {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:21:01 devstack sudo[99075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a8885b9c-2478-4a3a-87cf-d6215e9431e9.info Aug 29 01:21:01 devstack sudo[99075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:21:02 devstack sudo[99075]: pam_unix(sudo:session): session closed for user root Aug 29 01:21:02 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [req-6d95135c-8f00-4b70-ac8a-cd43c90ea69c req-eb6e8b98-d3e3-4dd5-b10a-78c73fe1f190 tempest-VolumesSnapshotsTestJSON-461653286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a8885b9c-2478-4a3a-87cf-d6215e9431e9.info" returned: 0 in 0.479s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:21:02 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [req-6d95135c-8f00-4b70-ac8a-cd43c90ea69c req-eb6e8b98-d3e3-4dd5-b10a-78c73fe1f190 tempest-VolumesSnapshotsTestJSON-461653286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.053s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:21:02 devstack cinder-volume[86111]: INFO cinder.volume.manager [req-6d95135c-8f00-4b70-ac8a-cd43c90ea69c req-eb6e8b98-d3e3-4dd5-b10a-78c73fe1f190 tempest-VolumesSnapshotsTestJSON-461653286 None] Create snapshot completed successfully Aug 29 01:21:02 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4e1b951-c023-401d-a72e-41d9d1bd6e2d tempest-VolumesCloneNegativeTest-2108158147 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:21:02 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-e4e1b951-c023-401d-a72e-41d9d1bd6e2d tempest-VolumesCloneNegativeTest-2108158147 None] Flow 'volume_create_manager' (389c2745-d9a6-4b32-8111-29a90e17dd4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:21:02 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-e4e1b951-c023-401d-a72e-41d9d1bd6e2d tempest-VolumesCloneNegativeTest-2108158147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7de95ddb-e867-4213-86c6-90db4283c54b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:21:02 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-e4e1b951-c023-401d-a72e-41d9d1bd6e2d tempest-VolumesCloneNegativeTest-2108158147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7de95ddb-e867-4213-86c6-90db4283c54b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:21:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-577490092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=756aeb3a-4e4f-4f96-b4a5-f29c75bd3df8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f00c19811ef4167ba27b8c1cc2f5216',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:21:03Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:21:03Z,use_quota=True,user_id='abd252b8d569415081f426b76272626e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:21:02 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-e4e1b951-c023-401d-a72e-41d9d1bd6e2d tempest-VolumesCloneNegativeTest-2108158147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6172124-311f-432a-a607-f2716c288899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:21:02 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-e4e1b951-c023-401d-a72e-41d9d1bd6e2d tempest-VolumesCloneNegativeTest-2108158147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6172124-311f-432a-a607-f2716c288899) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:21:03 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-e4e1b951-c023-401d-a72e-41d9d1bd6e2d tempest-VolumesCloneNegativeTest-2108158147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09d6548f-e2de-468e-a554-7ae807b8e151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:21:03 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-e4e1b951-c023-401d-a72e-41d9d1bd6e2d tempest-VolumesCloneNegativeTest-2108158147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09d6548f-e2de-468e-a554-7ae807b8e151) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '756aeb3a-4e4f-4f96-b4a5-f29c75bd3df8', 'volume_name': 'volume-756aeb3a-4e4f-4f96-b4a5-f29c75bd3df8', 'volume_size': 2}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:21:03 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-e4e1b951-c023-401d-a72e-41d9d1bd6e2d tempest-VolumesCloneNegativeTest-2108158147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46a303c7-9aed-4ae2-9b25-646f7707124f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:21:03 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-e4e1b951-c023-401d-a72e-41d9d1bd6e2d tempest-VolumesCloneNegativeTest-2108158147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46a303c7-9aed-4ae2-9b25-646f7707124f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:21:03 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-e4e1b951-c023-401d-a72e-41d9d1bd6e2d tempest-VolumesCloneNegativeTest-2108158147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d576c9a-f381-4a34-924a-0f6b39e574a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:21:03 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-e4e1b951-c023-401d-a72e-41d9d1bd6e2d tempest-VolumesCloneNegativeTest-2108158147 None] Volume 756aeb3a-4e4f-4f96-b4a5-f29c75bd3df8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-756aeb3a-4e4f-4f96-b4a5-f29c75bd3df8', 'volume_size': 2} Aug 29 01:21:03 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-e4e1b951-c023-401d-a72e-41d9d1bd6e2d tempest-VolumesCloneNegativeTest-2108158147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:21:03 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-e4e1b951-c023-401d-a72e-41d9d1bd6e2d tempest-VolumesCloneNegativeTest-2108158147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:21:03 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-e4e1b951-c023-401d-a72e-41d9d1bd6e2d tempest-VolumesCloneNegativeTest-2108158147 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:21:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-577490092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=756aeb3a-4e4f-4f96-b4a5-f29c75bd3df8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f00c19811ef4167ba27b8c1cc2f5216',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:21:03Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:21:03Z,use_quota=True,user_id='abd252b8d569415081f426b76272626e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:21:03 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-e4e1b951-c023-401d-a72e-41d9d1bd6e2d tempest-VolumesCloneNegativeTest-2108158147 None] Creating volume 756aeb3a-4e4f-4f96-b4a5-f29c75bd3df8 {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:21:03 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-e4e1b951-c023-401d-a72e-41d9d1bd6e2d tempest-VolumesCloneNegativeTest-2108158147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:21:03 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-e4e1b951-c023-401d-a72e-41d9d1bd6e2d tempest-VolumesCloneNegativeTest-2108158147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:21:03 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-e4e1b951-c023-401d-a72e-41d9d1bd6e2d tempest-VolumesCloneNegativeTest-2108158147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:21:03 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-e4e1b951-c023-401d-a72e-41d9d1bd6e2d tempest-VolumesCloneNegativeTest-2108158147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:21:03 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-e4e1b951-c023-401d-a72e-41d9d1bd6e2d tempest-VolumesCloneNegativeTest-2108158147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:21:03 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-e4e1b951-c023-401d-a72e-41d9d1bd6e2d tempest-VolumesCloneNegativeTest-2108158147 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:21:03 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-e4e1b951-c023-401d-a72e-41d9d1bd6e2d tempest-VolumesCloneNegativeTest-2108158147 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:21:03 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-e4e1b951-c023-401d-a72e-41d9d1bd6e2d tempest-VolumesCloneNegativeTest-2108158147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-756aeb3a-4e4f-4f96-b4a5-f29c75bd3df8 2147483648 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:21:03 devstack sudo[99080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-756aeb3a-4e4f-4f96-b4a5-f29c75bd3df8 2147483648 Aug 29 01:21:03 devstack sudo[99080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:21:03 devstack cinder-volume[86111]: DEBUG cinder.coordination [req-9613e8e1-6f02-4ade-90da-23fe1f10c9cb req-447c9b78-4d24-49e7-a092-c4a731faddf6 tempest-VolumesSnapshotsTestJSON-461653286 None] Acquiring lock "cinder-b3869822-faa1-4e6c-b378-0bb09e019922-delete_snapshot" by "delete_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:21:03 devstack cinder-volume[86111]: DEBUG cinder.coordination [req-9613e8e1-6f02-4ade-90da-23fe1f10c9cb req-447c9b78-4d24-49e7-a092-c4a731faddf6 tempest-VolumesSnapshotsTestJSON-461653286 None] Lock "cinder-b3869822-faa1-4e6c-b378-0bb09e019922-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:21:03 devstack cinder-volume[86111]: DEBUG cinder.coordination [req-9613e8e1-6f02-4ade-90da-23fe1f10c9cb req-447c9b78-4d24-49e7-a092-c4a731faddf6 tempest-VolumesSnapshotsTestJSON-461653286 None] Acquiring lock "cinder-quobyte-a8885b9c-2478-4a3a-87cf-d6215e9431e9" by "delete_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:21:03 devstack cinder-volume[86111]: DEBUG cinder.coordination [req-9613e8e1-6f02-4ade-90da-23fe1f10c9cb req-447c9b78-4d24-49e7-a092-c4a731faddf6 tempest-VolumesSnapshotsTestJSON-461653286 None] Lock "cinder-quobyte-a8885b9c-2478-4a3a-87cf-d6215e9431e9" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:21:03 devstack cinder-volume[86111]: DEBUG cinder.coordination [req-9613e8e1-6f02-4ade-90da-23fe1f10c9cb req-447c9b78-4d24-49e7-a092-c4a731faddf6 tempest-VolumesSnapshotsTestJSON-461653286 None] Acquiring lock "cinder-quobyte-b3869822-faa1-4e6c-b378-0bb09e019922" by "_delete_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:21:03 devstack cinder-volume[86111]: DEBUG cinder.coordination [req-9613e8e1-6f02-4ade-90da-23fe1f10c9cb req-447c9b78-4d24-49e7-a092-c4a731faddf6 tempest-VolumesSnapshotsTestJSON-461653286 None] Lock "cinder-quobyte-b3869822-faa1-4e6c-b378-0bb09e019922" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:21:03 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [req-9613e8e1-6f02-4ade-90da-23fe1f10c9cb req-447c9b78-4d24-49e7-a092-c4a731faddf6 tempest-VolumesSnapshotsTestJSON-461653286 None] Deleting offline snapshot b3869822-faa1-4e6c-b378-0bb09e019922 of volume a8885b9c-2478-4a3a-87cf-d6215e9431e9 {{(pid=86111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 29 01:21:03 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [req-9613e8e1-6f02-4ade-90da-23fe1f10c9cb req-447c9b78-4d24-49e7-a092-c4a731faddf6 tempest-VolumesSnapshotsTestJSON-461653286 None] snapshot_file for this snap is: volume-a8885b9c-2478-4a3a-87cf-d6215e9431e9.b3869822-faa1-4e6c-b378-0bb09e019922 {{(pid=86111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 29 01:21:03 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebb3e7a8-330b-4807-86fb-16ecc8756162]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:21:03 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [req-9613e8e1-6f02-4ade-90da-23fe1f10c9cb req-447c9b78-4d24-49e7-a092-c4a731faddf6 tempest-VolumesSnapshotsTestJSON-461653286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a8885b9c-2478-4a3a-87cf-d6215e9431e9.b3869822-faa1-4e6c-b378-0bb09e019922 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:21:03 devstack sudo[99086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a8885b9c-2478-4a3a-87cf-d6215e9431e9.b3869822-faa1-4e6c-b378-0bb09e019922 Aug 29 01:21:03 devstack sudo[99086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:21:04 devstack sudo[99080]: pam_unix(sudo:session): session closed for user root Aug 29 01:21:04 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-e4e1b951-c023-401d-a72e-41d9d1bd6e2d tempest-VolumesCloneNegativeTest-2108158147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-756aeb3a-4e4f-4f96-b4a5-f29c75bd3df8 2147483648" returned: 0 in 0.917s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:21:04 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-e4e1b951-c023-401d-a72e-41d9d1bd6e2d tempest-VolumesCloneNegativeTest-2108158147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-756aeb3a-4e4f-4f96-b4a5-f29c75bd3df8 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:21:04 devstack sudo[99088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-756aeb3a-4e4f-4f96-b4a5-f29c75bd3df8 Aug 29 01:21:04 devstack sudo[99088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:21:04 devstack sudo[99086]: pam_unix(sudo:session): session closed for user root Aug 29 01:21:04 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [req-9613e8e1-6f02-4ade-90da-23fe1f10c9cb req-447c9b78-4d24-49e7-a092-c4a731faddf6 tempest-VolumesSnapshotsTestJSON-461653286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a8885b9c-2478-4a3a-87cf-d6215e9431e9.b3869822-faa1-4e6c-b378-0bb09e019922" returned: 0 in 0.643s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:21:04 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [req-9613e8e1-6f02-4ade-90da-23fe1f10c9cb req-447c9b78-4d24-49e7-a092-c4a731faddf6 tempest-VolumesSnapshotsTestJSON-461653286 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a8885b9c-2478-4a3a-87cf-d6215e9431e9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 29 01:21:04 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8b15a61-2a86-4254-b688-d8cda233fadd]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:21:04 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [req-9613e8e1-6f02-4ade-90da-23fe1f10c9cb req-447c9b78-4d24-49e7-a092-c4a731faddf6 tempest-VolumesSnapshotsTestJSON-461653286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a8885b9c-2478-4a3a-87cf-d6215e9431e9 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:21:04 devstack sudo[99088]: pam_unix(sudo:session): session closed for user root Aug 29 01:21:04 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-e4e1b951-c023-401d-a72e-41d9d1bd6e2d tempest-VolumesCloneNegativeTest-2108158147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-756aeb3a-4e4f-4f96-b4a5-f29c75bd3df8" returned: 0 in 0.408s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:21:04 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-e4e1b951-c023-401d-a72e-41d9d1bd6e2d tempest-VolumesCloneNegativeTest-2108158147 None] <== create_volume: return (1426ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:21:04 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-e4e1b951-c023-401d-a72e-41d9d1bd6e2d tempest-VolumesCloneNegativeTest-2108158147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.436s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:21:04 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-e4e1b951-c023-401d-a72e-41d9d1bd6e2d tempest-VolumesCloneNegativeTest-2108158147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d576c9a-f381-4a34-924a-0f6b39e574a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-756aeb3a-4e4f-4f96-b4a5-f29c75bd3df8', 'volume_size': 2}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:21:04 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-e4e1b951-c023-401d-a72e-41d9d1bd6e2d tempest-VolumesCloneNegativeTest-2108158147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92868ae5-b1db-4720-a6f8-e9abd68fee2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:21:04 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-e4e1b951-c023-401d-a72e-41d9d1bd6e2d tempest-VolumesCloneNegativeTest-2108158147 None] Volume volume-756aeb3a-4e4f-4f96-b4a5-f29c75bd3df8 (756aeb3a-4e4f-4f96-b4a5-f29c75bd3df8): created successfully Aug 29 01:21:04 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-e4e1b951-c023-401d-a72e-41d9d1bd6e2d tempest-VolumesCloneNegativeTest-2108158147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92868ae5-b1db-4720-a6f8-e9abd68fee2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:21:04 devstack sudo[99094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a8885b9c-2478-4a3a-87cf-d6215e9431e9 Aug 29 01:21:04 devstack sudo[99094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:21:04 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-e4e1b951-c023-401d-a72e-41d9d1bd6e2d tempest-VolumesCloneNegativeTest-2108158147 None] Flow 'volume_create_manager' (389c2745-d9a6-4b32-8111-29a90e17dd4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:21:04 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-e4e1b951-c023-401d-a72e-41d9d1bd6e2d tempest-VolumesCloneNegativeTest-2108158147 None] Created volume successfully. Aug 29 01:21:04 devstack sudo[99094]: pam_unix(sudo:session): session closed for user root Aug 29 01:21:04 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [req-9613e8e1-6f02-4ade-90da-23fe1f10c9cb req-447c9b78-4d24-49e7-a092-c4a731faddf6 tempest-VolumesSnapshotsTestJSON-461653286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a8885b9c-2478-4a3a-87cf-d6215e9431e9" returned: 0 in 0.563s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:21:04 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [req-9613e8e1-6f02-4ade-90da-23fe1f10c9cb req-447c9b78-4d24-49e7-a092-c4a731faddf6 tempest-VolumesSnapshotsTestJSON-461653286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a8885b9c-2478-4a3a-87cf-d6215e9431e9.b3869822-faa1-4e6c-b378-0bb09e019922 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:21:04 devstack sudo[99136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a8885b9c-2478-4a3a-87cf-d6215e9431e9.b3869822-faa1-4e6c-b378-0bb09e019922 Aug 29 01:21:04 devstack sudo[99136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:21:05 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-cea925b5-9745-469d-b172-e4f197ed27d0 tempest-VolumesCloneNegativeTest-2108158147 None] Acquiring lock "cinder-756aeb3a-4e4f-4f96-b4a5-f29c75bd3df8-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:21:05 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-cea925b5-9745-469d-b172-e4f197ed27d0 tempest-VolumesCloneNegativeTest-2108158147 None] Lock "cinder-756aeb3a-4e4f-4f96-b4a5-f29c75bd3df8-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:21:05 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-cea925b5-9745-469d-b172-e4f197ed27d0 tempest-VolumesCloneNegativeTest-2108158147 None] Acquiring lock "cinder-quobyte-756aeb3a-4e4f-4f96-b4a5-f29c75bd3df8" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:21:05 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-cea925b5-9745-469d-b172-e4f197ed27d0 tempest-VolumesCloneNegativeTest-2108158147 None] Lock "cinder-quobyte-756aeb3a-4e4f-4f96-b4a5-f29c75bd3df8" acquired by "delete_volume" :: waited 0.028s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:21:05 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca307f6f-f084-4e2e-8e5c-208a3152f613]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:21:05 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-cea925b5-9745-469d-b172-e4f197ed27d0 tempest-VolumesCloneNegativeTest-2108158147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-756aeb3a-4e4f-4f96-b4a5-f29c75bd3df8 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:21:05 devstack sudo[99141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-756aeb3a-4e4f-4f96-b4a5-f29c75bd3df8 Aug 29 01:21:05 devstack sudo[99141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:21:05 devstack sudo[99136]: pam_unix(sudo:session): session closed for user root Aug 29 01:21:05 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [req-9613e8e1-6f02-4ade-90da-23fe1f10c9cb req-447c9b78-4d24-49e7-a092-c4a731faddf6 tempest-VolumesSnapshotsTestJSON-461653286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a8885b9c-2478-4a3a-87cf-d6215e9431e9.b3869822-faa1-4e6c-b378-0bb09e019922" returned: 0 in 0.562s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:21:05 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [req-9613e8e1-6f02-4ade-90da-23fe1f10c9cb req-447c9b78-4d24-49e7-a092-c4a731faddf6 tempest-VolumesSnapshotsTestJSON-461653286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a8885b9c-2478-4a3a-87cf-d6215e9431e9.b3869822-faa1-4e6c-b378-0bb09e019922 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:21:05 devstack sudo[99143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a8885b9c-2478-4a3a-87cf-d6215e9431e9.b3869822-faa1-4e6c-b378-0bb09e019922 Aug 29 01:21:05 devstack sudo[99143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:21:05 devstack sudo[99141]: pam_unix(sudo:session): session closed for user root Aug 29 01:21:05 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-cea925b5-9745-469d-b172-e4f197ed27d0 tempest-VolumesCloneNegativeTest-2108158147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-756aeb3a-4e4f-4f96-b4a5-f29c75bd3df8" returned: 0 in 0.443s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:21:05 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-cea925b5-9745-469d-b172-e4f197ed27d0 tempest-VolumesCloneNegativeTest-2108158147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-756aeb3a-4e4f-4f96-b4a5-f29c75bd3df8 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:21:05 devstack sudo[99143]: pam_unix(sudo:session): session closed for user root Aug 29 01:21:05 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [req-9613e8e1-6f02-4ade-90da-23fe1f10c9cb req-447c9b78-4d24-49e7-a092-c4a731faddf6 tempest-VolumesSnapshotsTestJSON-461653286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a8885b9c-2478-4a3a-87cf-d6215e9431e9.b3869822-faa1-4e6c-b378-0bb09e019922" returned: 0 in 0.277s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:21:05 devstack sudo[99149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-756aeb3a-4e4f-4f96-b4a5-f29c75bd3df8 Aug 29 01:21:05 devstack sudo[99149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:21:05 devstack cinder-volume[86111]: DEBUG cinder.coordination [req-9613e8e1-6f02-4ade-90da-23fe1f10c9cb req-447c9b78-4d24-49e7-a092-c4a731faddf6 tempest-VolumesSnapshotsTestJSON-461653286 None] Lock "cinder-quobyte-b3869822-faa1-4e6c-b378-0bb09e019922" released by "_delete_snapshot" :: held 2.196s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:21:05 devstack cinder-volume[86111]: DEBUG cinder.coordination [req-9613e8e1-6f02-4ade-90da-23fe1f10c9cb req-447c9b78-4d24-49e7-a092-c4a731faddf6 tempest-VolumesSnapshotsTestJSON-461653286 None] Lock "cinder-quobyte-a8885b9c-2478-4a3a-87cf-d6215e9431e9" released by "delete_snapshot" :: held 2.232s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:21:05 devstack cinder-volume[86111]: DEBUG cinder.quota [req-9613e8e1-6f02-4ade-90da-23fe1f10c9cb req-447c9b78-4d24-49e7-a092-c4a731faddf6 tempest-VolumesSnapshotsTestJSON-461653286 None] Created reservations ['6ab39e2f-f5d1-41bb-b099-9ce579b240ef', 'b069f765-bb20-4311-b6d1-2c2837dbc040', '7acda4ad-bf38-4c34-b639-405f1874aa7b', '91af7a95-8aed-4034-b678-155bd12ae1d7'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:21:05 devstack cinder-volume[86111]: INFO cinder.volume.manager [req-9613e8e1-6f02-4ade-90da-23fe1f10c9cb req-447c9b78-4d24-49e7-a092-c4a731faddf6 tempest-VolumesSnapshotsTestJSON-461653286 None] Delete snapshot completed successfully. Aug 29 01:21:05 devstack cinder-volume[86111]: DEBUG cinder.coordination [req-9613e8e1-6f02-4ade-90da-23fe1f10c9cb req-447c9b78-4d24-49e7-a092-c4a731faddf6 tempest-VolumesSnapshotsTestJSON-461653286 None] Lock "cinder-b3869822-faa1-4e6c-b378-0bb09e019922-delete_snapshot" released by "delete_snapshot" :: held 2.400s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:21:06 devstack sudo[99149]: pam_unix(sudo:session): session closed for user root Aug 29 01:21:06 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-cea925b5-9745-469d-b172-e4f197ed27d0 tempest-VolumesCloneNegativeTest-2108158147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-756aeb3a-4e4f-4f96-b4a5-f29c75bd3df8" returned: 0 in 0.266s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:21:06 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-cea925b5-9745-469d-b172-e4f197ed27d0 tempest-VolumesCloneNegativeTest-2108158147 None] Lock "cinder-quobyte-756aeb3a-4e4f-4f96-b4a5-f29c75bd3df8" released by "delete_volume" :: held 0.763s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:21:06 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-cea925b5-9745-469d-b172-e4f197ed27d0 tempest-VolumesCloneNegativeTest-2108158147 None] Created reservations ['7aee29e3-07d7-46f4-8639-9d823b86d5c7', 'db6398b5-6f69-4fb3-947c-1bef06c73444', 'b0b87c7a-9596-4093-97ed-bfa5a518e5bf', '51cd5505-f94e-423b-bbc3-7f8b76587121'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:21:06 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-cea925b5-9745-469d-b172-e4f197ed27d0 tempest-VolumesCloneNegativeTest-2108158147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:21:06 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-cea925b5-9745-469d-b172-e4f197ed27d0 tempest-VolumesCloneNegativeTest-2108158147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:21:06 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-cea925b5-9745-469d-b172-e4f197ed27d0 tempest-VolumesCloneNegativeTest-2108158147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:21:06 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-cea925b5-9745-469d-b172-e4f197ed27d0 tempest-VolumesCloneNegativeTest-2108158147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:21:06 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-cea925b5-9745-469d-b172-e4f197ed27d0 tempest-VolumesCloneNegativeTest-2108158147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:21:06 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-cea925b5-9745-469d-b172-e4f197ed27d0 tempest-VolumesCloneNegativeTest-2108158147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:21:06 devstack sudo[99152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:21:06 devstack sudo[99152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:21:06 devstack sudo[99152]: pam_unix(sudo:session): session closed for user root Aug 29 01:21:06 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-cea925b5-9745-469d-b172-e4f197ed27d0 tempest-VolumesCloneNegativeTest-2108158147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.289s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:21:06 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-cea925b5-9745-469d-b172-e4f197ed27d0 tempest-VolumesCloneNegativeTest-2108158147 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:21:06 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-cea925b5-9745-469d-b172-e4f197ed27d0 tempest-VolumesCloneNegativeTest-2108158147 None] Deleted volume successfully. Aug 29 01:21:06 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-cea925b5-9745-469d-b172-e4f197ed27d0 tempest-VolumesCloneNegativeTest-2108158147 None] Lock "cinder-756aeb3a-4e4f-4f96-b4a5-f29c75bd3df8-delete_volume" released by "delete_volume" :: held 1.309s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:21:06 devstack cinder-volume[86111]: DEBUG cinder.coordination [req-cb0555ca-360b-4a59-9841-19f729339310 req-d63c8a22-671f-47ba-990f-beb84982983f tempest-VolumesSnapshotsTestJSON-461653286 None] Acquiring lock "cinder-a8885b9c-2478-4a3a-87cf-d6215e9431e9-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:21:07 devstack cinder-volume[86111]: DEBUG cinder.coordination [req-cb0555ca-360b-4a59-9841-19f729339310 req-d63c8a22-671f-47ba-990f-beb84982983f tempest-VolumesSnapshotsTestJSON-461653286 None] Lock "cinder-a8885b9c-2478-4a3a-87cf-d6215e9431e9-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:21:07 devstack cinder-volume[86111]: DEBUG cinder.coordination [req-cb0555ca-360b-4a59-9841-19f729339310 req-d63c8a22-671f-47ba-990f-beb84982983f tempest-VolumesSnapshotsTestJSON-461653286 None] Acquiring lock "cinder-quobyte-a8885b9c-2478-4a3a-87cf-d6215e9431e9" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:21:07 devstack cinder-volume[86111]: DEBUG cinder.coordination [req-cb0555ca-360b-4a59-9841-19f729339310 req-d63c8a22-671f-47ba-990f-beb84982983f tempest-VolumesSnapshotsTestJSON-461653286 None] Lock "cinder-quobyte-a8885b9c-2478-4a3a-87cf-d6215e9431e9" acquired by "delete_volume" :: waited 0.033s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:21:07 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2a89366-cd79-467d-9352-bf97b4d87d95]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:21:07 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [req-cb0555ca-360b-4a59-9841-19f729339310 req-d63c8a22-671f-47ba-990f-beb84982983f tempest-VolumesSnapshotsTestJSON-461653286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a8885b9c-2478-4a3a-87cf-d6215e9431e9 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:21:07 devstack sudo[99158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a8885b9c-2478-4a3a-87cf-d6215e9431e9 Aug 29 01:21:07 devstack sudo[99158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:21:07 devstack sudo[99158]: pam_unix(sudo:session): session closed for user root Aug 29 01:21:07 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [req-cb0555ca-360b-4a59-9841-19f729339310 req-d63c8a22-671f-47ba-990f-beb84982983f tempest-VolumesSnapshotsTestJSON-461653286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a8885b9c-2478-4a3a-87cf-d6215e9431e9" returned: 0 in 0.489s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:21:07 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [req-cb0555ca-360b-4a59-9841-19f729339310 req-d63c8a22-671f-47ba-990f-beb84982983f tempest-VolumesSnapshotsTestJSON-461653286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a8885b9c-2478-4a3a-87cf-d6215e9431e9 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:21:07 devstack sudo[99164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a8885b9c-2478-4a3a-87cf-d6215e9431e9 Aug 29 01:21:07 devstack sudo[99164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:21:07 devstack sudo[99164]: pam_unix(sudo:session): session closed for user root Aug 29 01:21:07 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [req-cb0555ca-360b-4a59-9841-19f729339310 req-d63c8a22-671f-47ba-990f-beb84982983f tempest-VolumesSnapshotsTestJSON-461653286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a8885b9c-2478-4a3a-87cf-d6215e9431e9" returned: 0 in 0.299s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:21:08 devstack cinder-volume[86111]: DEBUG cinder.coordination [req-cb0555ca-360b-4a59-9841-19f729339310 req-d63c8a22-671f-47ba-990f-beb84982983f tempest-VolumesSnapshotsTestJSON-461653286 None] Lock "cinder-quobyte-a8885b9c-2478-4a3a-87cf-d6215e9431e9" released by "delete_volume" :: held 0.899s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:21:08 devstack cinder-volume[86111]: DEBUG cinder.quota [req-cb0555ca-360b-4a59-9841-19f729339310 req-d63c8a22-671f-47ba-990f-beb84982983f tempest-VolumesSnapshotsTestJSON-461653286 None] Created reservations ['0665244e-0c8b-4f7b-8120-573414aee470', '37d9ae96-e054-4b43-8fbb-7924f23485eb', 'c7e85e2a-b832-48a3-933a-8be4ee17452d', '7ffaabf7-9136-4fb6-8f2f-7f09fb3050d9'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:21:08 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [req-cb0555ca-360b-4a59-9841-19f729339310 req-d63c8a22-671f-47ba-990f-beb84982983f tempest-VolumesSnapshotsTestJSON-461653286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:21:08 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [req-cb0555ca-360b-4a59-9841-19f729339310 req-d63c8a22-671f-47ba-990f-beb84982983f tempest-VolumesSnapshotsTestJSON-461653286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:21:08 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [req-cb0555ca-360b-4a59-9841-19f729339310 req-d63c8a22-671f-47ba-990f-beb84982983f tempest-VolumesSnapshotsTestJSON-461653286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:21:08 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [req-cb0555ca-360b-4a59-9841-19f729339310 req-d63c8a22-671f-47ba-990f-beb84982983f tempest-VolumesSnapshotsTestJSON-461653286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:21:08 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [req-cb0555ca-360b-4a59-9841-19f729339310 req-d63c8a22-671f-47ba-990f-beb84982983f tempest-VolumesSnapshotsTestJSON-461653286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:21:08 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [req-cb0555ca-360b-4a59-9841-19f729339310 req-d63c8a22-671f-47ba-990f-beb84982983f tempest-VolumesSnapshotsTestJSON-461653286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:21:08 devstack sudo[99167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:21:08 devstack sudo[99167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:21:08 devstack sudo[99167]: pam_unix(sudo:session): session closed for user root Aug 29 01:21:08 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [req-cb0555ca-360b-4a59-9841-19f729339310 req-d63c8a22-671f-47ba-990f-beb84982983f tempest-VolumesSnapshotsTestJSON-461653286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.331s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:21:08 devstack cinder-volume[86111]: DEBUG cinder.manager [req-cb0555ca-360b-4a59-9841-19f729339310 req-d63c8a22-671f-47ba-990f-beb84982983f tempest-VolumesSnapshotsTestJSON-461653286 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:21:08 devstack cinder-volume[86111]: INFO cinder.volume.manager [req-cb0555ca-360b-4a59-9841-19f729339310 req-d63c8a22-671f-47ba-990f-beb84982983f tempest-VolumesSnapshotsTestJSON-461653286 None] Deleted volume successfully. Aug 29 01:21:08 devstack cinder-volume[86111]: DEBUG cinder.coordination [req-cb0555ca-360b-4a59-9841-19f729339310 req-d63c8a22-671f-47ba-990f-beb84982983f tempest-VolumesSnapshotsTestJSON-461653286 None] Lock "cinder-a8885b9c-2478-4a3a-87cf-d6215e9431e9-delete_volume" released by "delete_volume" :: held 1.543s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:21:09 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4909214-6c58-4ae2-aafb-46f0b13c1946 tempest-VolumesNegativeTest-625938978 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:21:09 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-c4909214-6c58-4ae2-aafb-46f0b13c1946 tempest-VolumesNegativeTest-625938978 None] Flow 'volume_create_manager' (feeca20a-c08e-4fc9-8434-b7cad6ecf0b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:21:09 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-c4909214-6c58-4ae2-aafb-46f0b13c1946 tempest-VolumesNegativeTest-625938978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d23fca34-5f21-462f-9532-655ff5481864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:21:09 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-c4909214-6c58-4ae2-aafb-46f0b13c1946 tempest-VolumesNegativeTest-625938978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d23fca34-5f21-462f-9532-655ff5481864) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:21:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-977401565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18095f63-7e49-4fa9-9e9e-57f400f303b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d912c48481644628638277ecea7da3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:21:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:21:10Z,use_quota=True,user_id='f6e3e6755f074b9b92d74df7bb3ad65a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:21:09 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-c4909214-6c58-4ae2-aafb-46f0b13c1946 tempest-VolumesNegativeTest-625938978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04e1504b-97fc-4c0a-b68a-aca8b2c475d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:21:09 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-c4909214-6c58-4ae2-aafb-46f0b13c1946 tempest-VolumesNegativeTest-625938978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04e1504b-97fc-4c0a-b68a-aca8b2c475d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:21:09 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-c4909214-6c58-4ae2-aafb-46f0b13c1946 tempest-VolumesNegativeTest-625938978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d71d94ff-cd9c-4832-b71c-09f177355037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:21:09 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-c4909214-6c58-4ae2-aafb-46f0b13c1946 tempest-VolumesNegativeTest-625938978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d71d94ff-cd9c-4832-b71c-09f177355037) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18095f63-7e49-4fa9-9e9e-57f400f303b9', 'volume_name': 'volume-18095f63-7e49-4fa9-9e9e-57f400f303b9', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:21:09 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-c4909214-6c58-4ae2-aafb-46f0b13c1946 tempest-VolumesNegativeTest-625938978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc974231-13ba-4255-91aa-fa824216bbd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:21:09 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-c4909214-6c58-4ae2-aafb-46f0b13c1946 tempest-VolumesNegativeTest-625938978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc974231-13ba-4255-91aa-fa824216bbd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:21:09 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-c4909214-6c58-4ae2-aafb-46f0b13c1946 tempest-VolumesNegativeTest-625938978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11804813-1336-449f-9e5d-5c765e292bef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:21:09 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-c4909214-6c58-4ae2-aafb-46f0b13c1946 tempest-VolumesNegativeTest-625938978 None] Volume 18095f63-7e49-4fa9-9e9e-57f400f303b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18095f63-7e49-4fa9-9e9e-57f400f303b9', 'volume_size': 1} Aug 29 01:21:09 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-c4909214-6c58-4ae2-aafb-46f0b13c1946 tempest-VolumesNegativeTest-625938978 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:21:09 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-c4909214-6c58-4ae2-aafb-46f0b13c1946 tempest-VolumesNegativeTest-625938978 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:21:09 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-c4909214-6c58-4ae2-aafb-46f0b13c1946 tempest-VolumesNegativeTest-625938978 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:21:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-977401565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18095f63-7e49-4fa9-9e9e-57f400f303b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d912c48481644628638277ecea7da3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:21:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:21:10Z,use_quota=True,user_id='f6e3e6755f074b9b92d74df7bb3ad65a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:21:09 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-c4909214-6c58-4ae2-aafb-46f0b13c1946 tempest-VolumesNegativeTest-625938978 None] Creating volume 18095f63-7e49-4fa9-9e9e-57f400f303b9 {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:21:09 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-c4909214-6c58-4ae2-aafb-46f0b13c1946 tempest-VolumesNegativeTest-625938978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:21:09 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-c4909214-6c58-4ae2-aafb-46f0b13c1946 tempest-VolumesNegativeTest-625938978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:21:09 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-c4909214-6c58-4ae2-aafb-46f0b13c1946 tempest-VolumesNegativeTest-625938978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:21:09 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-c4909214-6c58-4ae2-aafb-46f0b13c1946 tempest-VolumesNegativeTest-625938978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:21:09 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-c4909214-6c58-4ae2-aafb-46f0b13c1946 tempest-VolumesNegativeTest-625938978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:21:09 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-c4909214-6c58-4ae2-aafb-46f0b13c1946 tempest-VolumesNegativeTest-625938978 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:21:09 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-c4909214-6c58-4ae2-aafb-46f0b13c1946 tempest-VolumesNegativeTest-625938978 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:21:09 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c4909214-6c58-4ae2-aafb-46f0b13c1946 tempest-VolumesNegativeTest-625938978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-18095f63-7e49-4fa9-9e9e-57f400f303b9 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:21:10 devstack sudo[99171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-18095f63-7e49-4fa9-9e9e-57f400f303b9 1073741824 Aug 29 01:21:10 devstack sudo[99171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:21:10 devstack sudo[99171]: pam_unix(sudo:session): session closed for user root Aug 29 01:21:10 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c4909214-6c58-4ae2-aafb-46f0b13c1946 tempest-VolumesNegativeTest-625938978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-18095f63-7e49-4fa9-9e9e-57f400f303b9 1073741824" returned: 0 in 0.473s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:21:10 devstack cinder-volume[86111]: DEBUG dbcounter [-] [86111] Writing DB stats cinder:UPDATE=105,cinder:SELECT=85,cinder:DELETE=7,cinder:INSERT=22 {{(pid=86111) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 29 01:21:10 devstack cinder-volume[86111]: DEBUG dbcounter [-] [86111] Writing DB stats cinder:SELECT=89,cinder:UPDATE=110,cinder:INSERT=27,cinder:DELETE=11 {{(pid=86111) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 29 01:21:10 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c4909214-6c58-4ae2-aafb-46f0b13c1946 tempest-VolumesNegativeTest-625938978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-18095f63-7e49-4fa9-9e9e-57f400f303b9 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:21:10 devstack sudo[99177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-18095f63-7e49-4fa9-9e9e-57f400f303b9 Aug 29 01:21:10 devstack sudo[99177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:21:10 devstack sudo[99177]: pam_unix(sudo:session): session closed for user root Aug 29 01:21:10 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c4909214-6c58-4ae2-aafb-46f0b13c1946 tempest-VolumesNegativeTest-625938978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-18095f63-7e49-4fa9-9e9e-57f400f303b9" returned: 0 in 0.258s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:21:10 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-c4909214-6c58-4ae2-aafb-46f0b13c1946 tempest-VolumesNegativeTest-625938978 None] <== create_volume: return (783ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:21:10 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-c4909214-6c58-4ae2-aafb-46f0b13c1946 tempest-VolumesNegativeTest-625938978 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.786s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:21:10 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-c4909214-6c58-4ae2-aafb-46f0b13c1946 tempest-VolumesNegativeTest-625938978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11804813-1336-449f-9e5d-5c765e292bef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18095f63-7e49-4fa9-9e9e-57f400f303b9', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:21:10 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-c4909214-6c58-4ae2-aafb-46f0b13c1946 tempest-VolumesNegativeTest-625938978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (385a8277-6359-4eea-a1d5-3dd98682344b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:21:10 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-c4909214-6c58-4ae2-aafb-46f0b13c1946 tempest-VolumesNegativeTest-625938978 None] Volume volume-18095f63-7e49-4fa9-9e9e-57f400f303b9 (18095f63-7e49-4fa9-9e9e-57f400f303b9): created successfully Aug 29 01:21:10 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-c4909214-6c58-4ae2-aafb-46f0b13c1946 tempest-VolumesNegativeTest-625938978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (385a8277-6359-4eea-a1d5-3dd98682344b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:21:10 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-c4909214-6c58-4ae2-aafb-46f0b13c1946 tempest-VolumesNegativeTest-625938978 None] Flow 'volume_create_manager' (feeca20a-c08e-4fc9-8434-b7cad6ecf0b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:21:10 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-c4909214-6c58-4ae2-aafb-46f0b13c1946 tempest-VolumesNegativeTest-625938978 None] Created volume successfully. Aug 29 01:21:12 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-2aaf6988-ff6b-414d-b76b-ab0ac64f692d tempest-GroupSnapshotsV319Test-920302355 None] Group tempest-GroupSnapshotsV319Test-Group-178124930: creating Aug 29 01:21:12 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-2aaf6988-ff6b-414d-b76b-ab0ac64f692d tempest-GroupSnapshotsV319Test-920302355 None] Group tempest-GroupSnapshotsV319Test-Group-178124930: created successfully Aug 29 01:21:12 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-2aaf6988-ff6b-414d-b76b-ab0ac64f692d tempest-GroupSnapshotsV319Test-920302355 None] Create group completed successfully. Aug 29 01:21:14 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-758e6961-e187-4532-a7b3-cc3cdd6299c8 tempest-GroupSnapshotsV319Test-920302355 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:21:14 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-758e6961-e187-4532-a7b3-cc3cdd6299c8 tempest-GroupSnapshotsV319Test-920302355 None] Flow 'volume_create_manager' (6f54b030-11f6-4159-9cd5-90406f08aff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:21:14 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-758e6961-e187-4532-a7b3-cc3cdd6299c8 tempest-GroupSnapshotsV319Test-920302355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31bd1a55-24fe-4152-bf59-2aef9435e86a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:21:14 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-758e6961-e187-4532-a7b3-cc3cdd6299c8 tempest-GroupSnapshotsV319Test-920302355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31bd1a55-24fe-4152-bf59-2aef9435e86a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:21:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1364373142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=62d0afa0-b31c-43d2-a370-937c047ac1ec,host='devstack@QuobyteHD#QuobyteHD',id=a0e1a1e0-7869-4f1e-b977-b39d5b84d759,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3ab65505a26421c955d71d1b46249aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:21:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:21:14Z,use_quota=True,user_id='316b46c5ac4249959a0a5a2d81a24414',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7553c9a0-6ad6-4bdf-9e7c-cfa492e37e35),volume_type_id=7553c9a0-6ad6-4bdf-9e7c-cfa492e37e35)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:21:14 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-758e6961-e187-4532-a7b3-cc3cdd6299c8 tempest-GroupSnapshotsV319Test-920302355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76fe58f1-69e5-4ff2-b389-85106b65b6c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:21:14 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-758e6961-e187-4532-a7b3-cc3cdd6299c8 tempest-GroupSnapshotsV319Test-920302355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76fe58f1-69e5-4ff2-b389-85106b65b6c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:21:14 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-758e6961-e187-4532-a7b3-cc3cdd6299c8 tempest-GroupSnapshotsV319Test-920302355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea0d16b0-1f72-43cb-b243-fd73c6ae7cb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:21:14 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-758e6961-e187-4532-a7b3-cc3cdd6299c8 tempest-GroupSnapshotsV319Test-920302355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea0d16b0-1f72-43cb-b243-fd73c6ae7cb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0e1a1e0-7869-4f1e-b977-b39d5b84d759', 'volume_name': 'volume-a0e1a1e0-7869-4f1e-b977-b39d5b84d759', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:21:14 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-758e6961-e187-4532-a7b3-cc3cdd6299c8 tempest-GroupSnapshotsV319Test-920302355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccab5220-e1d6-4792-bfda-1ba2865066d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:21:14 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-758e6961-e187-4532-a7b3-cc3cdd6299c8 tempest-GroupSnapshotsV319Test-920302355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccab5220-e1d6-4792-bfda-1ba2865066d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:21:14 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-758e6961-e187-4532-a7b3-cc3cdd6299c8 tempest-GroupSnapshotsV319Test-920302355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c62ef0b-aa60-46a7-bfc4-45ee8cada45f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:21:14 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-758e6961-e187-4532-a7b3-cc3cdd6299c8 tempest-GroupSnapshotsV319Test-920302355 None] Volume a0e1a1e0-7869-4f1e-b977-b39d5b84d759: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0e1a1e0-7869-4f1e-b977-b39d5b84d759', 'volume_size': 1} Aug 29 01:21:14 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-758e6961-e187-4532-a7b3-cc3cdd6299c8 tempest-GroupSnapshotsV319Test-920302355 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:21:14 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-758e6961-e187-4532-a7b3-cc3cdd6299c8 tempest-GroupSnapshotsV319Test-920302355 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:21:14 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-758e6961-e187-4532-a7b3-cc3cdd6299c8 tempest-GroupSnapshotsV319Test-920302355 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=62d0afa0-b31c-43d2-a370-937c047ac1ec,created_at=2026-08-28T23:21:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1364373142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=62d0afa0-b31c-43d2-a370-937c047ac1ec,host='devstack@QuobyteHD#QuobyteHD',id=a0e1a1e0-7869-4f1e-b977-b39d5b84d759,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3ab65505a26421c955d71d1b46249aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:21:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:21:14Z,use_quota=True,user_id='316b46c5ac4249959a0a5a2d81a24414',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7553c9a0-6ad6-4bdf-9e7c-cfa492e37e35),volume_type_id=7553c9a0-6ad6-4bdf-9e7c-cfa492e37e35)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:21:14 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-758e6961-e187-4532-a7b3-cc3cdd6299c8 tempest-GroupSnapshotsV319Test-920302355 None] Creating volume a0e1a1e0-7869-4f1e-b977-b39d5b84d759 {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:21:14 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-758e6961-e187-4532-a7b3-cc3cdd6299c8 tempest-GroupSnapshotsV319Test-920302355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:21:14 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-758e6961-e187-4532-a7b3-cc3cdd6299c8 tempest-GroupSnapshotsV319Test-920302355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:21:14 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-758e6961-e187-4532-a7b3-cc3cdd6299c8 tempest-GroupSnapshotsV319Test-920302355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:21:14 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-758e6961-e187-4532-a7b3-cc3cdd6299c8 tempest-GroupSnapshotsV319Test-920302355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:21:14 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-758e6961-e187-4532-a7b3-cc3cdd6299c8 tempest-GroupSnapshotsV319Test-920302355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:21:14 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-758e6961-e187-4532-a7b3-cc3cdd6299c8 tempest-GroupSnapshotsV319Test-920302355 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:21:14 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-758e6961-e187-4532-a7b3-cc3cdd6299c8 tempest-GroupSnapshotsV319Test-920302355 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:21:14 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-758e6961-e187-4532-a7b3-cc3cdd6299c8 tempest-GroupSnapshotsV319Test-920302355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a0e1a1e0-7869-4f1e-b977-b39d5b84d759 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:21:14 devstack sudo[99183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a0e1a1e0-7869-4f1e-b977-b39d5b84d759 1073741824 Aug 29 01:21:14 devstack sudo[99183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:21:15 devstack sudo[99183]: pam_unix(sudo:session): session closed for user root Aug 29 01:21:15 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-758e6961-e187-4532-a7b3-cc3cdd6299c8 tempest-GroupSnapshotsV319Test-920302355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a0e1a1e0-7869-4f1e-b977-b39d5b84d759 1073741824" returned: 0 in 0.508s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:21:15 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-758e6961-e187-4532-a7b3-cc3cdd6299c8 tempest-GroupSnapshotsV319Test-920302355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a0e1a1e0-7869-4f1e-b977-b39d5b84d759 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:21:15 devstack sudo[99202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a0e1a1e0-7869-4f1e-b977-b39d5b84d759 Aug 29 01:21:15 devstack sudo[99202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:21:15 devstack sudo[99202]: pam_unix(sudo:session): session closed for user root Aug 29 01:21:15 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-758e6961-e187-4532-a7b3-cc3cdd6299c8 tempest-GroupSnapshotsV319Test-920302355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a0e1a1e0-7869-4f1e-b977-b39d5b84d759" returned: 0 in 0.398s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:21:15 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-758e6961-e187-4532-a7b3-cc3cdd6299c8 tempest-GroupSnapshotsV319Test-920302355 None] <== create_volume: return (969ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:21:15 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-758e6961-e187-4532-a7b3-cc3cdd6299c8 tempest-GroupSnapshotsV319Test-920302355 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.973s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:21:15 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-758e6961-e187-4532-a7b3-cc3cdd6299c8 tempest-GroupSnapshotsV319Test-920302355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c62ef0b-aa60-46a7-bfc4-45ee8cada45f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0e1a1e0-7869-4f1e-b977-b39d5b84d759', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:21:15 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-758e6961-e187-4532-a7b3-cc3cdd6299c8 tempest-GroupSnapshotsV319Test-920302355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c63ac6e-f550-4d83-acd6-ae5b3ecafe73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:21:15 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-758e6961-e187-4532-a7b3-cc3cdd6299c8 tempest-GroupSnapshotsV319Test-920302355 None] Volume volume-a0e1a1e0-7869-4f1e-b977-b39d5b84d759 (a0e1a1e0-7869-4f1e-b977-b39d5b84d759): created successfully Aug 29 01:21:15 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-758e6961-e187-4532-a7b3-cc3cdd6299c8 tempest-GroupSnapshotsV319Test-920302355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c63ac6e-f550-4d83-acd6-ae5b3ecafe73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:21:15 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-758e6961-e187-4532-a7b3-cc3cdd6299c8 tempest-GroupSnapshotsV319Test-920302355 None] Flow 'volume_create_manager' (6f54b030-11f6-4159-9cd5-90406f08aff9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:21:15 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-758e6961-e187-4532-a7b3-cc3cdd6299c8 tempest-GroupSnapshotsV319Test-920302355 None] Created volume successfully. Aug 29 01:21:16 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-6be0626c-f45d-434e-b100-b90fc533af3e tempest-TestServerVolumeAttachScenarioOldVersion-1296187398 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:21:16 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6be0626c-f45d-434e-b100-b90fc533af3e tempest-TestServerVolumeAttachScenarioOldVersion-1296187398 None] Flow 'volume_create_manager' (312815cf-0096-4df0-b1ff-57e179df4022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:21:16 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6be0626c-f45d-434e-b100-b90fc533af3e tempest-TestServerVolumeAttachScenarioOldVersion-1296187398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c25df2c3-505f-46eb-a679-eb01960ed394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:21:16 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6be0626c-f45d-434e-b100-b90fc533af3e tempest-TestServerVolumeAttachScenarioOldVersion-1296187398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c25df2c3-505f-46eb-a679-eb01960ed394) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:21:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-77971679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=662187d8-d348-452f-890a-3e8bbec83fe7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa2d836ece324812aac518ea0bbb746f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:21:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:21:16Z,use_quota=True,user_id='1e1b86ce082e458b859d5ec47b87036d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:21:16 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6be0626c-f45d-434e-b100-b90fc533af3e tempest-TestServerVolumeAttachScenarioOldVersion-1296187398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dfc3540-f0c0-4d17-a298-74a1898e85c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:21:16 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6be0626c-f45d-434e-b100-b90fc533af3e tempest-TestServerVolumeAttachScenarioOldVersion-1296187398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dfc3540-f0c0-4d17-a298-74a1898e85c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:21:16 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6be0626c-f45d-434e-b100-b90fc533af3e tempest-TestServerVolumeAttachScenarioOldVersion-1296187398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72be748f-79e9-43c0-8dab-3ba366d81145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:21:16 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6be0626c-f45d-434e-b100-b90fc533af3e tempest-TestServerVolumeAttachScenarioOldVersion-1296187398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72be748f-79e9-43c0-8dab-3ba366d81145) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '662187d8-d348-452f-890a-3e8bbec83fe7', 'volume_name': 'volume-662187d8-d348-452f-890a-3e8bbec83fe7', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:21:16 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6be0626c-f45d-434e-b100-b90fc533af3e tempest-TestServerVolumeAttachScenarioOldVersion-1296187398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4cb614b-b9f4-4cf2-bc5e-f3d3f95db2c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:21:16 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6be0626c-f45d-434e-b100-b90fc533af3e tempest-TestServerVolumeAttachScenarioOldVersion-1296187398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4cb614b-b9f4-4cf2-bc5e-f3d3f95db2c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:21:16 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6be0626c-f45d-434e-b100-b90fc533af3e tempest-TestServerVolumeAttachScenarioOldVersion-1296187398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f74b6c91-eb60-4965-8a20-1ef2d1bc5d8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:21:16 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-6be0626c-f45d-434e-b100-b90fc533af3e tempest-TestServerVolumeAttachScenarioOldVersion-1296187398 None] Volume 662187d8-d348-452f-890a-3e8bbec83fe7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-662187d8-d348-452f-890a-3e8bbec83fe7', 'volume_size': 1} Aug 29 01:21:16 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-6be0626c-f45d-434e-b100-b90fc533af3e tempest-TestServerVolumeAttachScenarioOldVersion-1296187398 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:21:16 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-6be0626c-f45d-434e-b100-b90fc533af3e tempest-TestServerVolumeAttachScenarioOldVersion-1296187398 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:21:16 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-6be0626c-f45d-434e-b100-b90fc533af3e tempest-TestServerVolumeAttachScenarioOldVersion-1296187398 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:21:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-77971679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=662187d8-d348-452f-890a-3e8bbec83fe7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa2d836ece324812aac518ea0bbb746f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:21:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:21:16Z,use_quota=True,user_id='1e1b86ce082e458b859d5ec47b87036d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:21:16 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-6be0626c-f45d-434e-b100-b90fc533af3e tempest-TestServerVolumeAttachScenarioOldVersion-1296187398 None] Creating volume 662187d8-d348-452f-890a-3e8bbec83fe7 {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:21:16 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-6be0626c-f45d-434e-b100-b90fc533af3e tempest-TestServerVolumeAttachScenarioOldVersion-1296187398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:21:16 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-6be0626c-f45d-434e-b100-b90fc533af3e tempest-TestServerVolumeAttachScenarioOldVersion-1296187398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:21:16 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-6be0626c-f45d-434e-b100-b90fc533af3e tempest-TestServerVolumeAttachScenarioOldVersion-1296187398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:21:16 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-6be0626c-f45d-434e-b100-b90fc533af3e tempest-TestServerVolumeAttachScenarioOldVersion-1296187398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:21:16 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-6be0626c-f45d-434e-b100-b90fc533af3e tempest-TestServerVolumeAttachScenarioOldVersion-1296187398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:21:16 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-6be0626c-f45d-434e-b100-b90fc533af3e tempest-TestServerVolumeAttachScenarioOldVersion-1296187398 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:21:16 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-6be0626c-f45d-434e-b100-b90fc533af3e tempest-TestServerVolumeAttachScenarioOldVersion-1296187398 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:21:16 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-6be0626c-f45d-434e-b100-b90fc533af3e tempest-TestServerVolumeAttachScenarioOldVersion-1296187398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-662187d8-d348-452f-890a-3e8bbec83fe7 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:21:16 devstack sudo[99235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-662187d8-d348-452f-890a-3e8bbec83fe7 1073741824 Aug 29 01:21:16 devstack sudo[99235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:21:17 devstack sudo[99235]: pam_unix(sudo:session): session closed for user root Aug 29 01:21:17 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-6be0626c-f45d-434e-b100-b90fc533af3e tempest-TestServerVolumeAttachScenarioOldVersion-1296187398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-662187d8-d348-452f-890a-3e8bbec83fe7 1073741824" returned: 0 in 0.647s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:21:17 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-6b02655d-4b77-4875-8e46-19b2e1561cf3 tempest-GroupSnapshotsV319Test-920302355 None] GroupSnapshot 817c0e16-1429-4726-ba8e-c9232b4fee17: creating. Aug 29 01:21:17 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6b02655d-4b77-4875-8e46-19b2e1561cf3 tempest-GroupSnapshotsV319Test-920302355 None] Group snapshot 817c0e16-1429-4726-ba8e-c9232b4fee17: creating. {{(pid=86111) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Aug 29 01:21:17 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-6be0626c-f45d-434e-b100-b90fc533af3e tempest-TestServerVolumeAttachScenarioOldVersion-1296187398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-662187d8-d348-452f-890a-3e8bbec83fe7 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:21:17 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-6b02655d-4b77-4875-8e46-19b2e1561cf3 tempest-GroupSnapshotsV319Test-920302355 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:21:17 devstack sudo[99242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-662187d8-d348-452f-890a-3e8bbec83fe7 Aug 29 01:21:17 devstack sudo[99242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:21:17 devstack sudo[99242]: pam_unix(sudo:session): session closed for user root Aug 29 01:21:17 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-6be0626c-f45d-434e-b100-b90fc533af3e tempest-TestServerVolumeAttachScenarioOldVersion-1296187398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-662187d8-d348-452f-890a-3e8bbec83fe7" returned: 0 in 0.395s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:21:17 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-6be0626c-f45d-434e-b100-b90fc533af3e tempest-TestServerVolumeAttachScenarioOldVersion-1296187398 None] <== create_volume: return (1132ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:21:17 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-6be0626c-f45d-434e-b100-b90fc533af3e tempest-TestServerVolumeAttachScenarioOldVersion-1296187398 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.135s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:21:17 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-6b02655d-4b77-4875-8e46-19b2e1561cf3 tempest-GroupSnapshotsV319Test-920302355 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.383s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:21:17 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-6b02655d-4b77-4875-8e46-19b2e1561cf3 tempest-GroupSnapshotsV319Test-920302355 None] Creating offline snapshot 23a9c055-348e-4b89-ae64-a94e4b57c014 of volume a0e1a1e0-7869-4f1e-b977-b39d5b84d759 {{(pid=86111) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 29 01:21:17 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6be0626c-f45d-434e-b100-b90fc533af3e tempest-TestServerVolumeAttachScenarioOldVersion-1296187398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f74b6c91-eb60-4965-8a20-1ef2d1bc5d8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-662187d8-d348-452f-890a-3e8bbec83fe7', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:21:17 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6be0626c-f45d-434e-b100-b90fc533af3e tempest-TestServerVolumeAttachScenarioOldVersion-1296187398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bde5425d-801d-4b96-ba37-e2cad551d027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:21:17 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[f68b773d-6af5-475e-9ef8-8b2e58a5398a]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:21:17 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-6b02655d-4b77-4875-8e46-19b2e1561cf3 tempest-GroupSnapshotsV319Test-920302355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a0e1a1e0-7869-4f1e-b977-b39d5b84d759 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:21:17 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-6be0626c-f45d-434e-b100-b90fc533af3e tempest-TestServerVolumeAttachScenarioOldVersion-1296187398 None] Volume volume-662187d8-d348-452f-890a-3e8bbec83fe7 (662187d8-d348-452f-890a-3e8bbec83fe7): created successfully Aug 29 01:21:17 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6be0626c-f45d-434e-b100-b90fc533af3e tempest-TestServerVolumeAttachScenarioOldVersion-1296187398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bde5425d-801d-4b96-ba37-e2cad551d027) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:21:17 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6be0626c-f45d-434e-b100-b90fc533af3e tempest-TestServerVolumeAttachScenarioOldVersion-1296187398 None] Flow 'volume_create_manager' (312815cf-0096-4df0-b1ff-57e179df4022) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:21:17 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-6be0626c-f45d-434e-b100-b90fc533af3e tempest-TestServerVolumeAttachScenarioOldVersion-1296187398 None] Created volume successfully. Aug 29 01:21:17 devstack sudo[99245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a0e1a1e0-7869-4f1e-b977-b39d5b84d759 Aug 29 01:21:17 devstack sudo[99245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:21:18 devstack sudo[99245]: pam_unix(sudo:session): session closed for user root Aug 29 01:21:18 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-6b02655d-4b77-4875-8e46-19b2e1561cf3 tempest-GroupSnapshotsV319Test-920302355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a0e1a1e0-7869-4f1e-b977-b39d5b84d759" returned: 0 in 0.631s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:21:18 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-6b02655d-4b77-4875-8e46-19b2e1561cf3 tempest-GroupSnapshotsV319Test-920302355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a0e1a1e0-7869-4f1e-b977-b39d5b84d759,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a0e1a1e0-7869-4f1e-b977-b39d5b84d759.23a9c055-348e-4b89-ae64-a94e4b57c014 1G {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:21:18 devstack sudo[99296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a0e1a1e0-7869-4f1e-b977-b39d5b84d759,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a0e1a1e0-7869-4f1e-b977-b39d5b84d759.23a9c055-348e-4b89-ae64-a94e4b57c014 1G Aug 29 01:21:18 devstack sudo[99296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:21:19 devstack sudo[99296]: pam_unix(sudo:session): session closed for user root Aug 29 01:21:19 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-6b02655d-4b77-4875-8e46-19b2e1561cf3 tempest-GroupSnapshotsV319Test-920302355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a0e1a1e0-7869-4f1e-b977-b39d5b84d759,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a0e1a1e0-7869-4f1e-b977-b39d5b84d759.23a9c055-348e-4b89-ae64-a94e4b57c014 1G" returned: 0 in 0.838s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:21:19 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-6b02655d-4b77-4875-8e46-19b2e1561cf3 tempest-GroupSnapshotsV319Test-920302355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0e1a1e0-7869-4f1e-b977-b39d5b84d759 -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a0e1a1e0-7869-4f1e-b977-b39d5b84d759.23a9c055-348e-4b89-ae64-a94e4b57c014 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:21:19 devstack sudo[99324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0e1a1e0-7869-4f1e-b977-b39d5b84d759 -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a0e1a1e0-7869-4f1e-b977-b39d5b84d759.23a9c055-348e-4b89-ae64-a94e4b57c014 Aug 29 01:21:19 devstack sudo[99324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:21:19 devstack sudo[99324]: pam_unix(sudo:session): session closed for user root Aug 29 01:21:19 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-6b02655d-4b77-4875-8e46-19b2e1561cf3 tempest-GroupSnapshotsV319Test-920302355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0e1a1e0-7869-4f1e-b977-b39d5b84d759 -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a0e1a1e0-7869-4f1e-b977-b39d5b84d759.23a9c055-348e-4b89-ae64-a94e4b57c014" returned: 0 in 0.734s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:21:19 devstack cinder-volume[86111]: WARNING cinder.volume.drivers.remotefs [None req-6b02655d-4b77-4875-8e46-19b2e1561cf3 tempest-GroupSnapshotsV319Test-920302355 None] /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a0e1a1e0-7869-4f1e-b977-b39d5b84d759.23a9c055-348e-4b89-ae64-a94e4b57c014 is being set with open permissions: ugo+rw: NotImplementedError Aug 29 01:21:19 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-6b02655d-4b77-4875-8e46-19b2e1561cf3 tempest-GroupSnapshotsV319Test-920302355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a0e1a1e0-7869-4f1e-b977-b39d5b84d759.23a9c055-348e-4b89-ae64-a94e4b57c014 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:21:20 devstack sudo[99341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a0e1a1e0-7869-4f1e-b977-b39d5b84d759.23a9c055-348e-4b89-ae64-a94e4b57c014 Aug 29 01:21:20 devstack sudo[99341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:21:20 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [req-eada5eaa-5743-4592-a6f3-fa7cd01e8523 req-86fd85f8-f40c-46e8-a39e-a77fb3120f5e tempest-TestServerVolumeAttachScenarioOldVersion-1296187398 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:21:20 devstack sudo[99341]: pam_unix(sudo:session): session closed for user root Aug 29 01:21:20 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-6b02655d-4b77-4875-8e46-19b2e1561cf3 tempest-GroupSnapshotsV319Test-920302355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a0e1a1e0-7869-4f1e-b977-b39d5b84d759.23a9c055-348e-4b89-ae64-a94e4b57c014" returned: 0 in 0.420s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:21:20 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-6b02655d-4b77-4875-8e46-19b2e1561cf3 tempest-GroupSnapshotsV319Test-920302355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a0e1a1e0-7869-4f1e-b977-b39d5b84d759.info {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:21:20 devstack sudo[99354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a0e1a1e0-7869-4f1e-b977-b39d5b84d759.info Aug 29 01:21:20 devstack sudo[99354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:21:20 devstack sudo[99354]: pam_unix(sudo:session): session closed for user root Aug 29 01:21:20 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-6b02655d-4b77-4875-8e46-19b2e1561cf3 tempest-GroupSnapshotsV319Test-920302355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a0e1a1e0-7869-4f1e-b977-b39d5b84d759.info" returned: 0 in 0.333s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:21:20 devstack cinder-volume[86111]: WARNING cinder.volume.drivers.remotefs [None req-6b02655d-4b77-4875-8e46-19b2e1561cf3 tempest-GroupSnapshotsV319Test-920302355 None] /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a0e1a1e0-7869-4f1e-b977-b39d5b84d759.info is being set with open permissions: ugo+rw: NotImplementedError Aug 29 01:21:20 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-6b02655d-4b77-4875-8e46-19b2e1561cf3 tempest-GroupSnapshotsV319Test-920302355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a0e1a1e0-7869-4f1e-b977-b39d5b84d759.info {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:21:20 devstack sudo[99371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a0e1a1e0-7869-4f1e-b977-b39d5b84d759.info Aug 29 01:21:20 devstack sudo[99371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:21:21 devstack sudo[99371]: pam_unix(sudo:session): session closed for user root Aug 29 01:21:21 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-6b02655d-4b77-4875-8e46-19b2e1561cf3 tempest-GroupSnapshotsV319Test-920302355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a0e1a1e0-7869-4f1e-b977-b39d5b84d759.info" returned: 0 in 0.310s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:21:21 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-6b02655d-4b77-4875-8e46-19b2e1561cf3 tempest-GroupSnapshotsV319Test-920302355 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.403s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:21:21 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [req-eada5eaa-5743-4592-a6f3-fa7cd01e8523 req-86fd85f8-f40c-46e8-a39e-a77fb3120f5e tempest-TestServerVolumeAttachScenarioOldVersion-1296187398 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.931s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:21:21 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [req-eada5eaa-5743-4592-a6f3-fa7cd01e8523 req-86fd85f8-f40c-46e8-a39e-a77fb3120f5e tempest-TestServerVolumeAttachScenarioOldVersion-1296187398 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.029s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:21:21 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [req-eada5eaa-5743-4592-a6f3-fa7cd01e8523 req-86fd85f8-f40c-46e8-a39e-a77fb3120f5e tempest-TestServerVolumeAttachScenarioOldVersion-1296187398 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630', 'name': 'volume-662187d8-d348-452f-890a-3e8bbec83fe7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b1e7a485-df2b-4b97-866c-597d138620dd', 'enforce_multipath': True} {{(pid=86111) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 29 01:21:21 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-6b02655d-4b77-4875-8e46-19b2e1561cf3 tempest-GroupSnapshotsV319Test-920302355 None] group_snapshot 817c0e16-1429-4726-ba8e-c9232b4fee17: created successfully Aug 29 01:21:21 devstack cinder-volume[86111]: INFO cinder.volume.manager [req-eada5eaa-5743-4592-a6f3-fa7cd01e8523 req-86fd85f8-f40c-46e8-a39e-a77fb3120f5e tempest-TestServerVolumeAttachScenarioOldVersion-1296187398 None] attachment_update completed successfully. Aug 29 01:21:22 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-d024212a-a628-4b7c-98fc-f4ec648c80d3 tempest-GroupSnapshotsV319Test-920302355 None] group_snapshot 817c0e16-1429-4726-ba8e-c9232b4fee17: deleting Aug 29 01:21:22 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-d024212a-a628-4b7c-98fc-f4ec648c80d3 tempest-GroupSnapshotsV319Test-920302355 None] group_snapshot 817c0e16-1429-4726-ba8e-c9232b4fee17: deleting {{(pid=86111) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Aug 29 01:21:22 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-d024212a-a628-4b7c-98fc-f4ec648c80d3 tempest-GroupSnapshotsV319Test-920302355 None] Acquiring lock "cinder-quobyte-a0e1a1e0-7869-4f1e-b977-b39d5b84d759" by "delete_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:21:22 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-d024212a-a628-4b7c-98fc-f4ec648c80d3 tempest-GroupSnapshotsV319Test-920302355 None] Lock "cinder-quobyte-a0e1a1e0-7869-4f1e-b977-b39d5b84d759" acquired by "delete_snapshot" :: waited 0.049s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:21:22 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-d024212a-a628-4b7c-98fc-f4ec648c80d3 tempest-GroupSnapshotsV319Test-920302355 None] Acquiring lock "cinder-quobyte-23a9c055-348e-4b89-ae64-a94e4b57c014" by "_delete_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:21:22 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-d024212a-a628-4b7c-98fc-f4ec648c80d3 tempest-GroupSnapshotsV319Test-920302355 None] Lock "cinder-quobyte-23a9c055-348e-4b89-ae64-a94e4b57c014" acquired by "_delete_snapshot" :: waited 0.048s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:21:22 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-d024212a-a628-4b7c-98fc-f4ec648c80d3 tempest-GroupSnapshotsV319Test-920302355 None] Deleting offline snapshot 23a9c055-348e-4b89-ae64-a94e4b57c014 of volume a0e1a1e0-7869-4f1e-b977-b39d5b84d759 {{(pid=86111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 29 01:21:22 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-d024212a-a628-4b7c-98fc-f4ec648c80d3 tempest-GroupSnapshotsV319Test-920302355 None] snapshot_file for this snap is: volume-a0e1a1e0-7869-4f1e-b977-b39d5b84d759.23a9c055-348e-4b89-ae64-a94e4b57c014 {{(pid=86111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 29 01:21:22 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[232776b2-7a99-4a34-9412-c11deabeacba]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:21:22 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d024212a-a628-4b7c-98fc-f4ec648c80d3 tempest-GroupSnapshotsV319Test-920302355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a0e1a1e0-7869-4f1e-b977-b39d5b84d759.23a9c055-348e-4b89-ae64-a94e4b57c014 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:21:22 devstack sudo[99406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a0e1a1e0-7869-4f1e-b977-b39d5b84d759.23a9c055-348e-4b89-ae64-a94e4b57c014 Aug 29 01:21:22 devstack sudo[99406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:21:23 devstack sudo[99406]: pam_unix(sudo:session): session closed for user root Aug 29 01:21:23 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d024212a-a628-4b7c-98fc-f4ec648c80d3 tempest-GroupSnapshotsV319Test-920302355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a0e1a1e0-7869-4f1e-b977-b39d5b84d759.23a9c055-348e-4b89-ae64-a94e4b57c014" returned: 0 in 0.746s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:21:23 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-d024212a-a628-4b7c-98fc-f4ec648c80d3 tempest-GroupSnapshotsV319Test-920302355 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a0e1a1e0-7869-4f1e-b977-b39d5b84d759(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 29 01:21:23 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[13ad8b02-046d-43f2-aa5e-c07f548053b9]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:21:23 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d024212a-a628-4b7c-98fc-f4ec648c80d3 tempest-GroupSnapshotsV319Test-920302355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a0e1a1e0-7869-4f1e-b977-b39d5b84d759 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:21:23 devstack sudo[99415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a0e1a1e0-7869-4f1e-b977-b39d5b84d759 Aug 29 01:21:23 devstack sudo[99415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:21:24 devstack sudo[99415]: pam_unix(sudo:session): session closed for user root Aug 29 01:21:24 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d024212a-a628-4b7c-98fc-f4ec648c80d3 tempest-GroupSnapshotsV319Test-920302355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a0e1a1e0-7869-4f1e-b977-b39d5b84d759" returned: 0 in 0.509s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:21:24 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d024212a-a628-4b7c-98fc-f4ec648c80d3 tempest-GroupSnapshotsV319Test-920302355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a0e1a1e0-7869-4f1e-b977-b39d5b84d759.23a9c055-348e-4b89-ae64-a94e4b57c014 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:21:24 devstack sudo[99422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a0e1a1e0-7869-4f1e-b977-b39d5b84d759.23a9c055-348e-4b89-ae64-a94e4b57c014 Aug 29 01:21:24 devstack sudo[99422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:21:24 devstack sudo[99422]: pam_unix(sudo:session): session closed for user root Aug 29 01:21:24 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d024212a-a628-4b7c-98fc-f4ec648c80d3 tempest-GroupSnapshotsV319Test-920302355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a0e1a1e0-7869-4f1e-b977-b39d5b84d759.23a9c055-348e-4b89-ae64-a94e4b57c014" returned: 0 in 0.454s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:21:24 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d024212a-a628-4b7c-98fc-f4ec648c80d3 tempest-GroupSnapshotsV319Test-920302355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a0e1a1e0-7869-4f1e-b977-b39d5b84d759.23a9c055-348e-4b89-ae64-a94e4b57c014 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:21:24 devstack sudo[99429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a0e1a1e0-7869-4f1e-b977-b39d5b84d759.23a9c055-348e-4b89-ae64-a94e4b57c014 Aug 29 01:21:24 devstack sudo[99429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:21:24 devstack sudo[99429]: pam_unix(sudo:session): session closed for user root Aug 29 01:21:24 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d024212a-a628-4b7c-98fc-f4ec648c80d3 tempest-GroupSnapshotsV319Test-920302355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a0e1a1e0-7869-4f1e-b977-b39d5b84d759.23a9c055-348e-4b89-ae64-a94e4b57c014" returned: 0 in 0.342s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:21:24 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-d024212a-a628-4b7c-98fc-f4ec648c80d3 tempest-GroupSnapshotsV319Test-920302355 None] Lock "cinder-quobyte-23a9c055-348e-4b89-ae64-a94e4b57c014" released by "_delete_snapshot" :: held 2.332s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:21:24 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-d024212a-a628-4b7c-98fc-f4ec648c80d3 tempest-GroupSnapshotsV319Test-920302355 None] Lock "cinder-quobyte-a0e1a1e0-7869-4f1e-b977-b39d5b84d759" released by "delete_snapshot" :: held 2.393s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:21:25 devstack cinder-volume[86111]: WARNING cinder.quota [None req-d024212a-a628-4b7c-98fc-f4ec648c80d3 tempest-GroupSnapshotsV319Test-920302355 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-534014971 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-534014971, it is now deprecated. Please use the default quota class for default quota. Aug 29 01:21:25 devstack cinder-volume[86111]: WARNING cinder.quota [None req-d024212a-a628-4b7c-98fc-f4ec648c80d3 tempest-GroupSnapshotsV319Test-920302355 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-534014971 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-534014971, it is now deprecated. Please use the default quota class for default quota. Aug 29 01:21:25 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-d024212a-a628-4b7c-98fc-f4ec648c80d3 tempest-GroupSnapshotsV319Test-920302355 None] Created reservations ['7590abd8-d25e-4f86-aa4a-47265657f4b7', '3ef47654-8243-45b6-b576-c3d04c8372ba', '2015509d-ace7-4dd0-b1bb-ed5148782a68', 'd73cf4a0-63a7-4ffd-a7a8-f9f77f688ca6'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:21:25 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-d024212a-a628-4b7c-98fc-f4ec648c80d3 tempest-GroupSnapshotsV319Test-920302355 None] group_snapshot 817c0e16-1429-4726-ba8e-c9232b4fee17: deleted successfully Aug 29 01:21:25 devstack cinder-volume[86111]: INFO cinder.volume.manager [req-c93de497-8219-44ef-873e-d4233b26b9f5 req-91b14d8a-b1be-44a1-bd56-05eabb18928b tempest-TestServerVolumeAttachScenarioOldVersion-1296187398 None] Terminate volume connection completed successfully. Aug 29 01:21:25 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [req-c93de497-8219-44ef-873e-d4233b26b9f5 req-91b14d8a-b1be-44a1-bd56-05eabb18928b tempest-TestServerVolumeAttachScenarioOldVersion-1296187398 None] Deleting attachment b1e7a485-df2b-4b97-866c-597d138620dd. {{(pid=86111) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 29 01:21:26 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-f9edf552-f122-40fa-b620-5c419d2b0d8a tempest-GroupSnapshotsV319Test-920302355 None] Acquiring lock "cinder-quobyte-a0e1a1e0-7869-4f1e-b977-b39d5b84d759" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:21:26 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-f9edf552-f122-40fa-b620-5c419d2b0d8a tempest-GroupSnapshotsV319Test-920302355 None] Lock "cinder-quobyte-a0e1a1e0-7869-4f1e-b977-b39d5b84d759" acquired by "delete_volume" :: waited 0.035s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:21:26 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[12ead8cb-d26c-4958-b3b2-dfce08844849]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:21:26 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-f9edf552-f122-40fa-b620-5c419d2b0d8a tempest-GroupSnapshotsV319Test-920302355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a0e1a1e0-7869-4f1e-b977-b39d5b84d759 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:21:26 devstack sudo[99434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a0e1a1e0-7869-4f1e-b977-b39d5b84d759 Aug 29 01:21:26 devstack sudo[99434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:21:26 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-f676e4dd-2ae7-468f-9bab-6b20b38b75b2 tempest-TestServerVolumeAttachScenarioOldVersion-1296187398 None] Acquiring lock "cinder-662187d8-d348-452f-890a-3e8bbec83fe7-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:21:26 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-f676e4dd-2ae7-468f-9bab-6b20b38b75b2 tempest-TestServerVolumeAttachScenarioOldVersion-1296187398 None] Lock "cinder-662187d8-d348-452f-890a-3e8bbec83fe7-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:21:26 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-f676e4dd-2ae7-468f-9bab-6b20b38b75b2 tempest-TestServerVolumeAttachScenarioOldVersion-1296187398 None] Acquiring lock "cinder-quobyte-662187d8-d348-452f-890a-3e8bbec83fe7" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:21:26 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-f676e4dd-2ae7-468f-9bab-6b20b38b75b2 tempest-TestServerVolumeAttachScenarioOldVersion-1296187398 None] Lock "cinder-quobyte-662187d8-d348-452f-890a-3e8bbec83fe7" acquired by "delete_volume" :: waited 0.021s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:21:26 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfc17ad4-26c1-4cbe-ac20-a8ab3a06f2d1]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:21:26 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-f676e4dd-2ae7-468f-9bab-6b20b38b75b2 tempest-TestServerVolumeAttachScenarioOldVersion-1296187398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-662187d8-d348-452f-890a-3e8bbec83fe7 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:21:27 devstack sudo[99436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-662187d8-d348-452f-890a-3e8bbec83fe7 Aug 29 01:21:27 devstack sudo[99436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:21:27 devstack sudo[99434]: pam_unix(sudo:session): session closed for user root Aug 29 01:21:27 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-f9edf552-f122-40fa-b620-5c419d2b0d8a tempest-GroupSnapshotsV319Test-920302355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a0e1a1e0-7869-4f1e-b977-b39d5b84d759" returned: 0 in 0.523s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:21:27 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-f9edf552-f122-40fa-b620-5c419d2b0d8a tempest-GroupSnapshotsV319Test-920302355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a0e1a1e0-7869-4f1e-b977-b39d5b84d759 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:21:27 devstack sudo[99442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a0e1a1e0-7869-4f1e-b977-b39d5b84d759 Aug 29 01:21:27 devstack sudo[99442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:21:27 devstack sudo[99436]: pam_unix(sudo:session): session closed for user root Aug 29 01:21:27 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-f676e4dd-2ae7-468f-9bab-6b20b38b75b2 tempest-TestServerVolumeAttachScenarioOldVersion-1296187398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-662187d8-d348-452f-890a-3e8bbec83fe7" returned: 0 in 0.553s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:21:27 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-f676e4dd-2ae7-468f-9bab-6b20b38b75b2 tempest-TestServerVolumeAttachScenarioOldVersion-1296187398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-662187d8-d348-452f-890a-3e8bbec83fe7 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:21:27 devstack sudo[99448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-662187d8-d348-452f-890a-3e8bbec83fe7 Aug 29 01:21:27 devstack sudo[99448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:21:27 devstack sudo[99442]: pam_unix(sudo:session): session closed for user root Aug 29 01:21:27 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-f9edf552-f122-40fa-b620-5c419d2b0d8a tempest-GroupSnapshotsV319Test-920302355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a0e1a1e0-7869-4f1e-b977-b39d5b84d759" returned: 0 in 0.431s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:21:27 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-f9edf552-f122-40fa-b620-5c419d2b0d8a tempest-GroupSnapshotsV319Test-920302355 None] Lock "cinder-quobyte-a0e1a1e0-7869-4f1e-b977-b39d5b84d759" released by "delete_volume" :: held 1.022s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:21:27 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-f9edf552-f122-40fa-b620-5c419d2b0d8a tempest-GroupSnapshotsV319Test-920302355 None] Created reservations ['52fecd87-6d40-4966-8caa-083a50785e53'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:21:27 devstack cinder-volume[86111]: WARNING cinder.quota [None req-f9edf552-f122-40fa-b620-5c419d2b0d8a tempest-GroupSnapshotsV319Test-920302355 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-534014971 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-534014971, it is now deprecated. Please use the default quota class for default quota. Aug 29 01:21:27 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-f9edf552-f122-40fa-b620-5c419d2b0d8a tempest-GroupSnapshotsV319Test-920302355 None] Created reservations ['aa8d5624-838d-440e-9119-087a6ed07022', '671e1f3b-01cc-45ae-8139-3b47b910c9ff', '164802c1-716f-475b-9d3b-d5a6d017b840', 'a960e350-c21f-47ed-bf2e-7afe54362c68'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:21:27 devstack sudo[99448]: pam_unix(sudo:session): session closed for user root Aug 29 01:21:27 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-f676e4dd-2ae7-468f-9bab-6b20b38b75b2 tempest-TestServerVolumeAttachScenarioOldVersion-1296187398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-662187d8-d348-452f-890a-3e8bbec83fe7" returned: 0 in 0.397s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:21:27 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-f676e4dd-2ae7-468f-9bab-6b20b38b75b2 tempest-TestServerVolumeAttachScenarioOldVersion-1296187398 None] Lock "cinder-quobyte-662187d8-d348-452f-890a-3e8bbec83fe7" released by "delete_volume" :: held 1.012s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:21:27 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-f9edf552-f122-40fa-b620-5c419d2b0d8a tempest-GroupSnapshotsV319Test-920302355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:21:27 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-f9edf552-f122-40fa-b620-5c419d2b0d8a tempest-GroupSnapshotsV319Test-920302355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:21:27 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-f9edf552-f122-40fa-b620-5c419d2b0d8a tempest-GroupSnapshotsV319Test-920302355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:21:27 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-f9edf552-f122-40fa-b620-5c419d2b0d8a tempest-GroupSnapshotsV319Test-920302355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:21:27 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-f9edf552-f122-40fa-b620-5c419d2b0d8a tempest-GroupSnapshotsV319Test-920302355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:21:27 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-f9edf552-f122-40fa-b620-5c419d2b0d8a tempest-GroupSnapshotsV319Test-920302355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:21:28 devstack sudo[99452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:21:28 devstack sudo[99452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:21:28 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-f676e4dd-2ae7-468f-9bab-6b20b38b75b2 tempest-TestServerVolumeAttachScenarioOldVersion-1296187398 None] Created reservations ['ea91b1be-9c1f-4cd7-a769-cd2c4f3b152b', '8fea7767-f3d9-43f4-b457-1377e90dbeb5', 'd925c387-dd44-4fd3-b907-976805a40217', 'c67f9e22-3cd6-4016-b411-c9441c0e4bc7'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:21:28 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-f676e4dd-2ae7-468f-9bab-6b20b38b75b2 tempest-TestServerVolumeAttachScenarioOldVersion-1296187398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:21:28 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-f676e4dd-2ae7-468f-9bab-6b20b38b75b2 tempest-TestServerVolumeAttachScenarioOldVersion-1296187398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:21:28 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-f676e4dd-2ae7-468f-9bab-6b20b38b75b2 tempest-TestServerVolumeAttachScenarioOldVersion-1296187398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:21:28 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-f676e4dd-2ae7-468f-9bab-6b20b38b75b2 tempest-TestServerVolumeAttachScenarioOldVersion-1296187398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:21:28 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-f676e4dd-2ae7-468f-9bab-6b20b38b75b2 tempest-TestServerVolumeAttachScenarioOldVersion-1296187398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:21:28 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-f676e4dd-2ae7-468f-9bab-6b20b38b75b2 tempest-TestServerVolumeAttachScenarioOldVersion-1296187398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:21:28 devstack sudo[99455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:21:28 devstack sudo[99455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:21:28 devstack sudo[99452]: pam_unix(sudo:session): session closed for user root Aug 29 01:21:28 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-f9edf552-f122-40fa-b620-5c419d2b0d8a tempest-GroupSnapshotsV319Test-920302355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.333s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:21:28 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-f9edf552-f122-40fa-b620-5c419d2b0d8a tempest-GroupSnapshotsV319Test-920302355 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:21:28 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-f9edf552-f122-40fa-b620-5c419d2b0d8a tempest-GroupSnapshotsV319Test-920302355 None] Delete group completed successfully. Aug 29 01:21:28 devstack sudo[99455]: pam_unix(sudo:session): session closed for user root Aug 29 01:21:28 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-f676e4dd-2ae7-468f-9bab-6b20b38b75b2 tempest-TestServerVolumeAttachScenarioOldVersion-1296187398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.338s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:21:28 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-f676e4dd-2ae7-468f-9bab-6b20b38b75b2 tempest-TestServerVolumeAttachScenarioOldVersion-1296187398 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:21:28 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-f676e4dd-2ae7-468f-9bab-6b20b38b75b2 tempest-TestServerVolumeAttachScenarioOldVersion-1296187398 None] Deleted volume successfully. Aug 29 01:21:28 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-f676e4dd-2ae7-468f-9bab-6b20b38b75b2 tempest-TestServerVolumeAttachScenarioOldVersion-1296187398 None] Lock "cinder-662187d8-d348-452f-890a-3e8bbec83fe7-delete_volume" released by "delete_volume" :: held 1.767s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:21:33 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-9574b30d-49a8-4056-80a6-beafed8b316a tempest-VolumesNegativeTest-625938978 None] Acquiring lock "cinder-18095f63-7e49-4fa9-9e9e-57f400f303b9-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:21:33 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-9574b30d-49a8-4056-80a6-beafed8b316a tempest-VolumesNegativeTest-625938978 None] Lock "cinder-18095f63-7e49-4fa9-9e9e-57f400f303b9-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:21:33 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-9574b30d-49a8-4056-80a6-beafed8b316a tempest-VolumesNegativeTest-625938978 None] Acquiring lock "cinder-quobyte-18095f63-7e49-4fa9-9e9e-57f400f303b9" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:21:33 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-9574b30d-49a8-4056-80a6-beafed8b316a tempest-VolumesNegativeTest-625938978 None] Lock "cinder-quobyte-18095f63-7e49-4fa9-9e9e-57f400f303b9" acquired by "delete_volume" :: waited 0.025s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:21:33 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf2d74bc-62cb-417a-8d16-fdbe00e996fe]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:21:33 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-9574b30d-49a8-4056-80a6-beafed8b316a tempest-VolumesNegativeTest-625938978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-18095f63-7e49-4fa9-9e9e-57f400f303b9 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:21:34 devstack sudo[99520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-18095f63-7e49-4fa9-9e9e-57f400f303b9 Aug 29 01:21:34 devstack sudo[99520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:21:34 devstack sudo[99520]: pam_unix(sudo:session): session closed for user root Aug 29 01:21:34 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-9574b30d-49a8-4056-80a6-beafed8b316a tempest-VolumesNegativeTest-625938978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-18095f63-7e49-4fa9-9e9e-57f400f303b9" returned: 0 in 0.548s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:21:34 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-9574b30d-49a8-4056-80a6-beafed8b316a tempest-VolumesNegativeTest-625938978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-18095f63-7e49-4fa9-9e9e-57f400f303b9 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:21:34 devstack sudo[99525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-18095f63-7e49-4fa9-9e9e-57f400f303b9 Aug 29 01:21:34 devstack sudo[99525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:21:34 devstack sudo[99525]: pam_unix(sudo:session): session closed for user root Aug 29 01:21:34 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-9574b30d-49a8-4056-80a6-beafed8b316a tempest-VolumesNegativeTest-625938978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-18095f63-7e49-4fa9-9e9e-57f400f303b9" returned: 0 in 0.305s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:21:34 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-9574b30d-49a8-4056-80a6-beafed8b316a tempest-VolumesNegativeTest-625938978 None] Lock "cinder-quobyte-18095f63-7e49-4fa9-9e9e-57f400f303b9" released by "delete_volume" :: held 0.922s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:21:34 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-9574b30d-49a8-4056-80a6-beafed8b316a tempest-VolumesNegativeTest-625938978 None] Created reservations ['0e4b8079-f621-472e-9b2d-8cc362f84403', '7d8db711-d2f3-4348-918d-b3b838f8a6b6', '25a593d2-f52d-466d-9140-a6603180a1b3', '88dc4fbf-165d-4d9b-8fb8-9407b193de43'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:21:35 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-9574b30d-49a8-4056-80a6-beafed8b316a tempest-VolumesNegativeTest-625938978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:21:35 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-9574b30d-49a8-4056-80a6-beafed8b316a tempest-VolumesNegativeTest-625938978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:21:35 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-9574b30d-49a8-4056-80a6-beafed8b316a tempest-VolumesNegativeTest-625938978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:21:35 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-9574b30d-49a8-4056-80a6-beafed8b316a tempest-VolumesNegativeTest-625938978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:21:35 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-9574b30d-49a8-4056-80a6-beafed8b316a tempest-VolumesNegativeTest-625938978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:21:35 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-9574b30d-49a8-4056-80a6-beafed8b316a tempest-VolumesNegativeTest-625938978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:21:35 devstack sudo[99529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:21:35 devstack sudo[99529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:21:35 devstack sudo[99529]: pam_unix(sudo:session): session closed for user root Aug 29 01:21:35 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-9574b30d-49a8-4056-80a6-beafed8b316a tempest-VolumesNegativeTest-625938978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.354s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:21:35 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-9574b30d-49a8-4056-80a6-beafed8b316a tempest-VolumesNegativeTest-625938978 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:21:35 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-9574b30d-49a8-4056-80a6-beafed8b316a tempest-VolumesNegativeTest-625938978 None] Deleted volume successfully. Aug 29 01:21:35 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-9574b30d-49a8-4056-80a6-beafed8b316a tempest-VolumesNegativeTest-625938978 None] Lock "cinder-18095f63-7e49-4fa9-9e9e-57f400f303b9-delete_volume" released by "delete_volume" :: held 1.654s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:21:40 devstack cinder-volume[86111]: DEBUG oslo_service.periodic_task [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86111) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 29 01:21:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:21:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:21:40 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:21:40 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:21:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:21:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:21:40 devstack sudo[99539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:21:40 devstack sudo[99539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:21:41 devstack sudo[99539]: pam_unix(sudo:session): session closed for user root Aug 29 01:21:41 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-de752545-d617-440e-8362-d04fae0901a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.274s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:21:41 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:21:41 devstack cinder-volume[86111]: DEBUG oslo_service.periodic_task [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Running periodic task VolumeManager._thread_info {{(pid=86111) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 29 01:21:41 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-de752545-d617-440e-8362-d04fae0901a5 None None] thread count: 28 {{(pid=86111) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 29 01:21:41 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-de752545-d617-440e-8362-d04fae0901a5 None None] thread info: [<_MainThread(MainThread, started 129173440548992)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86111) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 29 01:21:45 devstack cinder-volume[86111]: DEBUG dbcounter [-] [86111] Writing DB stats cinder:UPDATE=47,cinder:SELECT=45,cinder:INSERT=10,cinder:DELETE=1 {{(pid=86111) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 29 01:21:45 devstack cinder-volume[86111]: DEBUG dbcounter [-] [86111] Writing DB stats cinder:SELECT=44,cinder:INSERT=11,cinder:UPDATE=44,cinder:DELETE=4 {{(pid=86111) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 29 01:21:53 devstack cinder-volume[86111]: INFO cinder.volume.manager [req-e599c6f3-a691-4b83-8c70-a26c63f8e2b3 req-6bb6f3b9-f113-44b3-b803-b32852ce2b31 tempest-TestMinimumBasicScenario-220803035 None] Terminate volume connection completed successfully. Aug 29 01:21:53 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [req-e599c6f3-a691-4b83-8c70-a26c63f8e2b3 req-6bb6f3b9-f113-44b3-b803-b32852ce2b31 tempest-TestMinimumBasicScenario-220803035 None] Deleting attachment af02a8a8-7007-4a9a-ae26-c02f3243bd9d. {{(pid=86111) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 29 01:21:54 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-0e038ae3-b350-452c-8821-168da1f52eab tempest-TestMinimumBasicScenario-220803035 None] Acquiring lock "cinder-53f75ed2-1fc9-4753-b665-b370fa5b51bf-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:21:54 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-0e038ae3-b350-452c-8821-168da1f52eab tempest-TestMinimumBasicScenario-220803035 None] Lock "cinder-53f75ed2-1fc9-4753-b665-b370fa5b51bf-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:21:54 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-0e038ae3-b350-452c-8821-168da1f52eab tempest-TestMinimumBasicScenario-220803035 None] Acquiring lock "cinder-quobyte-53f75ed2-1fc9-4753-b665-b370fa5b51bf" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:21:54 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-0e038ae3-b350-452c-8821-168da1f52eab tempest-TestMinimumBasicScenario-220803035 None] Lock "cinder-quobyte-53f75ed2-1fc9-4753-b665-b370fa5b51bf" acquired by "delete_volume" :: waited 0.029s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:21:55 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[56b4f6e2-c5f2-45d3-94e9-42cd0fb1c130]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:21:55 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-0e038ae3-b350-452c-8821-168da1f52eab tempest-TestMinimumBasicScenario-220803035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-53f75ed2-1fc9-4753-b665-b370fa5b51bf {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:21:55 devstack sudo[99564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-53f75ed2-1fc9-4753-b665-b370fa5b51bf Aug 29 01:21:55 devstack sudo[99564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:21:55 devstack sudo[99564]: pam_unix(sudo:session): session closed for user root Aug 29 01:21:55 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-0e038ae3-b350-452c-8821-168da1f52eab tempest-TestMinimumBasicScenario-220803035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-53f75ed2-1fc9-4753-b665-b370fa5b51bf" returned: 0 in 0.680s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:21:55 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-0e038ae3-b350-452c-8821-168da1f52eab tempest-TestMinimumBasicScenario-220803035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-53f75ed2-1fc9-4753-b665-b370fa5b51bf {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:21:55 devstack sudo[99569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-53f75ed2-1fc9-4753-b665-b370fa5b51bf Aug 29 01:21:55 devstack sudo[99569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:21:56 devstack sudo[99569]: pam_unix(sudo:session): session closed for user root Aug 29 01:21:56 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-0e038ae3-b350-452c-8821-168da1f52eab tempest-TestMinimumBasicScenario-220803035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-53f75ed2-1fc9-4753-b665-b370fa5b51bf" returned: 0 in 0.525s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:21:56 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-0e038ae3-b350-452c-8821-168da1f52eab tempest-TestMinimumBasicScenario-220803035 None] Lock "cinder-quobyte-53f75ed2-1fc9-4753-b665-b370fa5b51bf" released by "delete_volume" :: held 1.275s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:21:56 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-0e038ae3-b350-452c-8821-168da1f52eab tempest-TestMinimumBasicScenario-220803035 None] Created reservations ['9cfd1cd6-67ff-481b-b628-1c1095eafcd9', '3856f4c1-f929-4314-8c66-5e3526471294', '46b794c3-d675-4c6d-9835-90407b9385a3', 'd089d792-7775-42c2-864f-24fac9804e69'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:21:56 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-0e038ae3-b350-452c-8821-168da1f52eab tempest-TestMinimumBasicScenario-220803035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:21:56 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-0e038ae3-b350-452c-8821-168da1f52eab tempest-TestMinimumBasicScenario-220803035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:21:56 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-0e038ae3-b350-452c-8821-168da1f52eab tempest-TestMinimumBasicScenario-220803035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:21:56 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-0e038ae3-b350-452c-8821-168da1f52eab tempest-TestMinimumBasicScenario-220803035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:21:56 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-0e038ae3-b350-452c-8821-168da1f52eab tempest-TestMinimumBasicScenario-220803035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:21:56 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-0e038ae3-b350-452c-8821-168da1f52eab tempest-TestMinimumBasicScenario-220803035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:21:56 devstack sudo[99572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:21:56 devstack sudo[99572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:21:56 devstack sudo[99572]: pam_unix(sudo:session): session closed for user root Aug 29 01:21:56 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-0e038ae3-b350-452c-8821-168da1f52eab tempest-TestMinimumBasicScenario-220803035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.329s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:21:56 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-0e038ae3-b350-452c-8821-168da1f52eab tempest-TestMinimumBasicScenario-220803035 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:21:56 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-0e038ae3-b350-452c-8821-168da1f52eab tempest-TestMinimumBasicScenario-220803035 None] Deleted volume successfully. Aug 29 01:21:56 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-0e038ae3-b350-452c-8821-168da1f52eab tempest-TestMinimumBasicScenario-220803035 None] Lock "cinder-53f75ed2-1fc9-4753-b665-b370fa5b51bf-delete_volume" released by "delete_volume" :: held 1.995s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:21:57 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd755bfc-f8ae-48a5-a72f-dd8ee3e70bd4 tempest-VolumesCloneTest-1077476834 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:21:57 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-bd755bfc-f8ae-48a5-a72f-dd8ee3e70bd4 tempest-VolumesCloneTest-1077476834 None] Flow 'volume_create_manager' (a7f44b82-04c9-48df-8989-a58c5fd2911a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:21:57 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-bd755bfc-f8ae-48a5-a72f-dd8ee3e70bd4 tempest-VolumesCloneTest-1077476834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39a2c1d5-02ef-4550-a3dc-b0c042a0f382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:21:57 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-bd755bfc-f8ae-48a5-a72f-dd8ee3e70bd4 tempest-VolumesCloneTest-1077476834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39a2c1d5-02ef-4550-a3dc-b0c042a0f382) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:21:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1158979259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65fce528-98d5-4fa2-969c-fbaeb4a8118e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d448a83a82bc43d293fd8f9542092372',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:21:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:21:57Z,use_quota=True,user_id='49e25a0a19ae4d0f8231973c79457f99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:21:57 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-bd755bfc-f8ae-48a5-a72f-dd8ee3e70bd4 tempest-VolumesCloneTest-1077476834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c141703-947a-4440-8bb3-23f12a712a2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:21:57 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-bd755bfc-f8ae-48a5-a72f-dd8ee3e70bd4 tempest-VolumesCloneTest-1077476834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c141703-947a-4440-8bb3-23f12a712a2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:21:57 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-bd755bfc-f8ae-48a5-a72f-dd8ee3e70bd4 tempest-VolumesCloneTest-1077476834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d190efa-4496-499c-8b9e-3926bf23ca5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:21:57 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-bd755bfc-f8ae-48a5-a72f-dd8ee3e70bd4 tempest-VolumesCloneTest-1077476834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d190efa-4496-499c-8b9e-3926bf23ca5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65fce528-98d5-4fa2-969c-fbaeb4a8118e', 'volume_name': 'volume-65fce528-98d5-4fa2-969c-fbaeb4a8118e', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:21:57 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-bd755bfc-f8ae-48a5-a72f-dd8ee3e70bd4 tempest-VolumesCloneTest-1077476834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f2fece3-fb3d-43a1-8f45-7afcb4b65c71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:21:57 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-bd755bfc-f8ae-48a5-a72f-dd8ee3e70bd4 tempest-VolumesCloneTest-1077476834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f2fece3-fb3d-43a1-8f45-7afcb4b65c71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:21:57 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-bd755bfc-f8ae-48a5-a72f-dd8ee3e70bd4 tempest-VolumesCloneTest-1077476834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1087261-ace8-4c2b-a1cd-e05172d9f7ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:21:57 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-bd755bfc-f8ae-48a5-a72f-dd8ee3e70bd4 tempest-VolumesCloneTest-1077476834 None] Volume 65fce528-98d5-4fa2-969c-fbaeb4a8118e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65fce528-98d5-4fa2-969c-fbaeb4a8118e', 'volume_size': 1} Aug 29 01:21:57 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-bd755bfc-f8ae-48a5-a72f-dd8ee3e70bd4 tempest-VolumesCloneTest-1077476834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:21:57 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-bd755bfc-f8ae-48a5-a72f-dd8ee3e70bd4 tempest-VolumesCloneTest-1077476834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:21:57 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-bd755bfc-f8ae-48a5-a72f-dd8ee3e70bd4 tempest-VolumesCloneTest-1077476834 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:21:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1158979259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65fce528-98d5-4fa2-969c-fbaeb4a8118e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d448a83a82bc43d293fd8f9542092372',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:21:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:21:57Z,use_quota=True,user_id='49e25a0a19ae4d0f8231973c79457f99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:21:57 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-bd755bfc-f8ae-48a5-a72f-dd8ee3e70bd4 tempest-VolumesCloneTest-1077476834 None] Creating volume 65fce528-98d5-4fa2-969c-fbaeb4a8118e {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:21:57 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-bd755bfc-f8ae-48a5-a72f-dd8ee3e70bd4 tempest-VolumesCloneTest-1077476834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:21:57 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-bd755bfc-f8ae-48a5-a72f-dd8ee3e70bd4 tempest-VolumesCloneTest-1077476834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:21:57 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-bd755bfc-f8ae-48a5-a72f-dd8ee3e70bd4 tempest-VolumesCloneTest-1077476834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:21:57 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-bd755bfc-f8ae-48a5-a72f-dd8ee3e70bd4 tempest-VolumesCloneTest-1077476834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:21:57 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-bd755bfc-f8ae-48a5-a72f-dd8ee3e70bd4 tempest-VolumesCloneTest-1077476834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:21:57 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-bd755bfc-f8ae-48a5-a72f-dd8ee3e70bd4 tempest-VolumesCloneTest-1077476834 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:21:57 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-bd755bfc-f8ae-48a5-a72f-dd8ee3e70bd4 tempest-VolumesCloneTest-1077476834 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:21:57 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-bd755bfc-f8ae-48a5-a72f-dd8ee3e70bd4 tempest-VolumesCloneTest-1077476834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-65fce528-98d5-4fa2-969c-fbaeb4a8118e 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:21:57 devstack sudo[99575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-65fce528-98d5-4fa2-969c-fbaeb4a8118e 1073741824 Aug 29 01:21:57 devstack sudo[99575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:21:58 devstack sudo[99575]: pam_unix(sudo:session): session closed for user root Aug 29 01:21:58 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-bd755bfc-f8ae-48a5-a72f-dd8ee3e70bd4 tempest-VolumesCloneTest-1077476834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-65fce528-98d5-4fa2-969c-fbaeb4a8118e 1073741824" returned: 0 in 0.927s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:21:58 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-bd755bfc-f8ae-48a5-a72f-dd8ee3e70bd4 tempest-VolumesCloneTest-1077476834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-65fce528-98d5-4fa2-969c-fbaeb4a8118e {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:21:58 devstack sudo[99601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-65fce528-98d5-4fa2-969c-fbaeb4a8118e Aug 29 01:21:58 devstack sudo[99601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:21:58 devstack sudo[99601]: pam_unix(sudo:session): session closed for user root Aug 29 01:21:58 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-bd755bfc-f8ae-48a5-a72f-dd8ee3e70bd4 tempest-VolumesCloneTest-1077476834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-65fce528-98d5-4fa2-969c-fbaeb4a8118e" returned: 0 in 0.480s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:21:58 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-bd755bfc-f8ae-48a5-a72f-dd8ee3e70bd4 tempest-VolumesCloneTest-1077476834 None] <== create_volume: return (1512ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:21:58 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-bd755bfc-f8ae-48a5-a72f-dd8ee3e70bd4 tempest-VolumesCloneTest-1077476834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.515s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:21:58 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-bd755bfc-f8ae-48a5-a72f-dd8ee3e70bd4 tempest-VolumesCloneTest-1077476834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1087261-ace8-4c2b-a1cd-e05172d9f7ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65fce528-98d5-4fa2-969c-fbaeb4a8118e', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:21:58 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-bd755bfc-f8ae-48a5-a72f-dd8ee3e70bd4 tempest-VolumesCloneTest-1077476834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (922439ab-5073-478d-b1e6-45d1c8f0b215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:21:58 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-bd755bfc-f8ae-48a5-a72f-dd8ee3e70bd4 tempest-VolumesCloneTest-1077476834 None] Volume volume-65fce528-98d5-4fa2-969c-fbaeb4a8118e (65fce528-98d5-4fa2-969c-fbaeb4a8118e): created successfully Aug 29 01:21:58 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-bd755bfc-f8ae-48a5-a72f-dd8ee3e70bd4 tempest-VolumesCloneTest-1077476834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (922439ab-5073-478d-b1e6-45d1c8f0b215) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:21:58 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-bd755bfc-f8ae-48a5-a72f-dd8ee3e70bd4 tempest-VolumesCloneTest-1077476834 None] Flow 'volume_create_manager' (a7f44b82-04c9-48df-8989-a58c5fd2911a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:21:58 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-bd755bfc-f8ae-48a5-a72f-dd8ee3e70bd4 tempest-VolumesCloneTest-1077476834 None] Created volume successfully. Aug 29 01:21:59 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e5c2daa-6333-459f-ba01-52fc4bc40228 tempest-VolumeAndVolumeTypeFromImageTest-131665667 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:21:59 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-5e5c2daa-6333-459f-ba01-52fc4bc40228 tempest-VolumeAndVolumeTypeFromImageTest-131665667 None] Flow 'volume_create_manager' (ecd41158-c3fe-414d-a2c1-7700f43018e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:21:59 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-5e5c2daa-6333-459f-ba01-52fc4bc40228 tempest-VolumeAndVolumeTypeFromImageTest-131665667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6040a18-4ef2-497e-a117-d10899737635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:21:59 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-5e5c2daa-6333-459f-ba01-52fc4bc40228 tempest-VolumeAndVolumeTypeFromImageTest-131665667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6040a18-4ef2-497e-a117-d10899737635) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:21:59Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63d6666d-2542-4aa4-afdc-139b12716c76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4491918490af4e3282de0211fb04b07c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:21:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:21:59Z,use_quota=True,user_id='accc1f2ece684ad7aaba3da61963252a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a9cd012-c634-4abd-ac9d-f5c1bcf8bc31),volume_type_id=3a9cd012-c634-4abd-ac9d-f5c1bcf8bc31)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:21:59 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-5e5c2daa-6333-459f-ba01-52fc4bc40228 tempest-VolumeAndVolumeTypeFromImageTest-131665667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85d052e6-debe-4efe-abc6-f29c666fbf25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:21:59 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-5e5c2daa-6333-459f-ba01-52fc4bc40228 tempest-VolumeAndVolumeTypeFromImageTest-131665667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85d052e6-debe-4efe-abc6-f29c666fbf25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:21:59 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-5e5c2daa-6333-459f-ba01-52fc4bc40228 tempest-VolumeAndVolumeTypeFromImageTest-131665667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b0d0301-6b7a-4576-8a2b-0cc3319de9a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:21:59 devstack cinder-volume[86111]: DEBUG cinder.image.glance [None req-5e5c2daa-6333-459f-ba01-52fc4bc40228 tempest-VolumeAndVolumeTypeFromImageTest-131665667 None] Creating Keystone auth plugin from conf {{(pid=86111) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 29 01:22:00 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f2300a8-ce2e-4076-b24f-f3543482f7c3 tempest-VolumesCloneTest-1077476834 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:22:00 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-8f2300a8-ce2e-4076-b24f-f3543482f7c3 tempest-VolumesCloneTest-1077476834 None] Flow 'volume_create_manager' (dafe71d8-03f0-4355-b01c-2480f83183aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:22:00 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-8f2300a8-ce2e-4076-b24f-f3543482f7c3 tempest-VolumesCloneTest-1077476834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90a7a3c2-cf0e-415f-bae6-796ad2490882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:22:00 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-5e5c2daa-6333-459f-ba01-52fc4bc40228 tempest-VolumeAndVolumeTypeFromImageTest-131665667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b0d0301-6b7a-4576-8a2b-0cc3319de9a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '63d6666d-2542-4aa4-afdc-139b12716c76', 'volume_name': 'volume-63d6666d-2542-4aa4-afdc-139b12716c76', 'volume_size': 1, 'image_id': '150ca1e6-83ca-4c33-8657-d2bf2e612206', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/150ca1e6-83ca-4c33-8657-d2bf2e612206', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd36e0cd7b8d8717a915b19b269279945', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4491918490af4e3282de0211fb04b07c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '02419cb373a09c9940e68080823b6064e36a0eaafab567938f5272b0f60fe37ff5d362f9dd1da44edeca28adb0d3cfd21bf25822df290b0dc53d91b47b3981a5', 'id': '150ca1e6-83ca-4c33-8657-d2bf2e612206', 'created_at': datetime.datetime(2026, 8, 28, 23, 21, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 23, 21, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/150ca1e6-83ca-4c33-8657-d2bf2e612206/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:22:00 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-5e5c2daa-6333-459f-ba01-52fc4bc40228 tempest-VolumeAndVolumeTypeFromImageTest-131665667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a1aa4eb-7d20-4ec3-ac84-7dcbc5b18b1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:22:00 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-5e5c2daa-6333-459f-ba01-52fc4bc40228 tempest-VolumeAndVolumeTypeFromImageTest-131665667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a1aa4eb-7d20-4ec3-ac84-7dcbc5b18b1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:22:00 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-5e5c2daa-6333-459f-ba01-52fc4bc40228 tempest-VolumeAndVolumeTypeFromImageTest-131665667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd3fc988-9926-461d-96ef-3589d9684c48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:22:00 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-5e5c2daa-6333-459f-ba01-52fc4bc40228 tempest-VolumeAndVolumeTypeFromImageTest-131665667 None] Volume 63d6666d-2542-4aa4-afdc-139b12716c76: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-63d6666d-2542-4aa4-afdc-139b12716c76', 'volume_size': 1, 'image_id': '150ca1e6-83ca-4c33-8657-d2bf2e612206', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/150ca1e6-83ca-4c33-8657-d2bf2e612206', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd36e0cd7b8d8717a915b19b269279945', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4491918490af4e3282de0211fb04b07c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '02419cb373a09c9940e68080823b6064e36a0eaafab567938f5272b0f60fe37ff5d362f9dd1da44edeca28adb0d3cfd21bf25822df290b0dc53d91b47b3981a5', 'id': '150ca1e6-83ca-4c33-8657-d2bf2e612206', 'created_at': datetime.datetime(2026, 8, 28, 23, 21, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 23, 21, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/150ca1e6-83ca-4c33-8657-d2bf2e612206/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Aug 29 01:22:00 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e5c2daa-6333-459f-ba01-52fc4bc40228 tempest-VolumeAndVolumeTypeFromImageTest-131665667 None] Trying to clone 63d6666d-2542-4aa4-afdc-139b12716c76 from image 150ca1e6-83ca-4c33-8657-d2bf2e612206 at location (None, [{'url': 'file:///opt/stack/data/glance/images/150ca1e6-83ca-4c33-8657-d2bf2e612206', 'metadata': {}}]). {{(pid=86111) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 29 01:22:00 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-8f2300a8-ce2e-4076-b24f-f3543482f7c3 tempest-VolumesCloneTest-1077476834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90a7a3c2-cf0e-415f-bae6-796ad2490882) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:22:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1386739154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb57a56d-3b73-4449-8d5b-af3f3776fbb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d448a83a82bc43d293fd8f9542092372',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:22:00Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=65fce528-98d5-4fa2-969c-fbaeb4a8118e,status='creating',terminated_at=None,updated_at=2026-08-28T23:22:00Z,use_quota=True,user_id='49e25a0a19ae4d0f8231973c79457f99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:22:00 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-8f2300a8-ce2e-4076-b24f-f3543482f7c3 tempest-VolumesCloneTest-1077476834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90ee971c-f26c-4705-a145-0a23800c9e2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:22:00 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-8f2300a8-ce2e-4076-b24f-f3543482f7c3 tempest-VolumesCloneTest-1077476834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90ee971c-f26c-4705-a145-0a23800c9e2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:22:00 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-8f2300a8-ce2e-4076-b24f-f3543482f7c3 tempest-VolumesCloneTest-1077476834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e80fc424-3371-412d-a526-260623684824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:22:00 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-8f2300a8-ce2e-4076-b24f-f3543482f7c3 tempest-VolumesCloneTest-1077476834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e80fc424-3371-412d-a526-260623684824) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'eb57a56d-3b73-4449-8d5b-af3f3776fbb7', 'volume_name': 'volume-eb57a56d-3b73-4449-8d5b-af3f3776fbb7', 'volume_size': 2, 'source_volid': '65fce528-98d5-4fa2-969c-fbaeb4a8118e', 'source_volstatus': 'available'}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:22:00 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-8f2300a8-ce2e-4076-b24f-f3543482f7c3 tempest-VolumesCloneTest-1077476834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (380986f4-7cfc-4529-a566-486bc04cc2bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:22:00 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-8f2300a8-ce2e-4076-b24f-f3543482f7c3 tempest-VolumesCloneTest-1077476834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (380986f4-7cfc-4529-a566-486bc04cc2bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:22:00 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-8f2300a8-ce2e-4076-b24f-f3543482f7c3 tempest-VolumesCloneTest-1077476834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33eaed91-7a56-4aeb-8cd3-8fd44bed6d37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:22:00 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-8f2300a8-ce2e-4076-b24f-f3543482f7c3 tempest-VolumesCloneTest-1077476834 None] Volume eb57a56d-3b73-4449-8d5b-af3f3776fbb7: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-eb57a56d-3b73-4449-8d5b-af3f3776fbb7', 'volume_size': 2, 'source_volid': '65fce528-98d5-4fa2-969c-fbaeb4a8118e', 'source_volstatus': 'available'} Aug 29 01:22:00 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-8f2300a8-ce2e-4076-b24f-f3543482f7c3 tempest-VolumesCloneTest-1077476834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:22:00 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-8f2300a8-ce2e-4076-b24f-f3543482f7c3 tempest-VolumesCloneTest-1077476834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:22:00 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-8f2300a8-ce2e-4076-b24f-f3543482f7c3 tempest-VolumesCloneTest-1077476834 None] Cloning volume 65fce528-98d5-4fa2-969c-fbaeb4a8118e to volume eb57a56d-3b73-4449-8d5b-af3f3776fbb7 Aug 29 01:22:00 devstack cinder-volume[86111]: DEBUG cinder.image.image_utils [None req-5e5c2daa-6333-459f-ba01-52fc4bc40228 tempest-VolumeAndVolumeTypeFromImageTest-131665667 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_150ca1e6-83ca-4c33-8657-d2bf2e612206_1u4q83tidevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86111) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 29 01:22:00 devstack cinder-volume[86111]: INFO cinder.image.image_utils [None req-5e5c2daa-6333-459f-ba01-52fc4bc40228 tempest-VolumeAndVolumeTypeFromImageTest-131665667 None] Image download 0.00 MB at 0.00 MB/s Aug 29 01:22:00 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-8f2300a8-ce2e-4076-b24f-f3543482f7c3 tempest-VolumesCloneTest-1077476834 None] Creating offline snapshot ee013eb1-d22b-4158-a858-2b05001d0d27 of volume 65fce528-98d5-4fa2-969c-fbaeb4a8118e {{(pid=86111) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 29 01:22:00 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[fffb4271-8dcf-454d-8c4c-034ed7e65282]: (4, 'raw') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:22:00 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[f18f7158-9d12-4c9a-ab51-4d8991b9d636]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:22:00 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-5e5c2daa-6333-459f-ba01-52fc4bc40228 tempest-VolumeAndVolumeTypeFromImageTest-131665667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_150ca1e6-83ca-4c33-8657-d2bf2e612206_1u4q83tidevstack@QuobyteHD {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:22:00 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8f2300a8-ce2e-4076-b24f-f3543482f7c3 tempest-VolumesCloneTest-1077476834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-65fce528-98d5-4fa2-969c-fbaeb4a8118e {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:22:01 devstack sudo[99606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_150ca1e6-83ca-4c33-8657-d2bf2e612206_1u4q83tidevstack@QuobyteHD Aug 29 01:22:01 devstack sudo[99606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:22:01 devstack sudo[99607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-65fce528-98d5-4fa2-969c-fbaeb4a8118e Aug 29 01:22:01 devstack sudo[99607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:22:01 devstack sudo[99606]: pam_unix(sudo:session): session closed for user root Aug 29 01:22:01 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-5e5c2daa-6333-459f-ba01-52fc4bc40228 tempest-VolumeAndVolumeTypeFromImageTest-131665667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_150ca1e6-83ca-4c33-8657-d2bf2e612206_1u4q83tidevstack@QuobyteHD" returned: 0 in 0.454s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:22:01 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-5e5c2daa-6333-459f-ba01-52fc4bc40228 tempest-VolumeAndVolumeTypeFromImageTest-131665667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_150ca1e6-83ca-4c33-8657-d2bf2e612206_1u4q83tidevstack@QuobyteHD {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:22:01 devstack sudo[99607]: pam_unix(sudo:session): session closed for user root Aug 29 01:22:01 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8f2300a8-ce2e-4076-b24f-f3543482f7c3 tempest-VolumesCloneTest-1077476834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-65fce528-98d5-4fa2-969c-fbaeb4a8118e" returned: 0 in 0.544s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:22:01 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8f2300a8-ce2e-4076-b24f-f3543482f7c3 tempest-VolumesCloneTest-1077476834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-65fce528-98d5-4fa2-969c-fbaeb4a8118e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-65fce528-98d5-4fa2-969c-fbaeb4a8118e.ee013eb1-d22b-4158-a858-2b05001d0d27 1G {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:22:01 devstack sudo[99616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-65fce528-98d5-4fa2-969c-fbaeb4a8118e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-65fce528-98d5-4fa2-969c-fbaeb4a8118e.ee013eb1-d22b-4158-a858-2b05001d0d27 1G Aug 29 01:22:01 devstack sudo[99616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:22:01 devstack sudo[99615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_150ca1e6-83ca-4c33-8657-d2bf2e612206_1u4q83tidevstack@QuobyteHD Aug 29 01:22:01 devstack sudo[99615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:22:01 devstack sudo[99615]: pam_unix(sudo:session): session closed for user root Aug 29 01:22:01 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-5e5c2daa-6333-459f-ba01-52fc4bc40228 tempest-VolumeAndVolumeTypeFromImageTest-131665667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_150ca1e6-83ca-4c33-8657-d2bf2e612206_1u4q83tidevstack@QuobyteHD" returned: 1 in 0.419s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:22:01 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-5e5c2daa-6333-459f-ba01-52fc4bc40228 tempest-VolumeAndVolumeTypeFromImageTest-131665667 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_150ca1e6-83ca-4c33-8657-d2bf2e612206_1u4q83tidevstack@QuobyteHD' failed. Not Retrying. {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 29 01:22:01 devstack cinder-volume[86111]: DEBUG cinder.image.image_utils [None req-5e5c2daa-6333-459f-ba01-52fc4bc40228 tempest-VolumeAndVolumeTypeFromImageTest-131665667 None] Temporary image 150ca1e6-83ca-4c33-8657-d2bf2e612206 is fetched for user accc1f2ece684ad7aaba3da61963252a. {{(pid=86111) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 29 01:22:01 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[67512dcf-ccd8-4b6d-a920-5fb339e811ab]: (4, 'raw') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:22:01 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-5e5c2daa-6333-459f-ba01-52fc4bc40228 tempest-VolumeAndVolumeTypeFromImageTest-131665667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_150ca1e6-83ca-4c33-8657-d2bf2e612206_1u4q83tidevstack@QuobyteHD {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:22:01 devstack sudo[99616]: pam_unix(sudo:session): session closed for user root Aug 29 01:22:01 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8f2300a8-ce2e-4076-b24f-f3543482f7c3 tempest-VolumesCloneTest-1077476834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-65fce528-98d5-4fa2-969c-fbaeb4a8118e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-65fce528-98d5-4fa2-969c-fbaeb4a8118e.ee013eb1-d22b-4158-a858-2b05001d0d27 1G" returned: 0 in 0.539s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:22:02 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8f2300a8-ce2e-4076-b24f-f3543482f7c3 tempest-VolumesCloneTest-1077476834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65fce528-98d5-4fa2-969c-fbaeb4a8118e -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-65fce528-98d5-4fa2-969c-fbaeb4a8118e.ee013eb1-d22b-4158-a858-2b05001d0d27 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:22:02 devstack sudo[99628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65fce528-98d5-4fa2-969c-fbaeb4a8118e -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-65fce528-98d5-4fa2-969c-fbaeb4a8118e.ee013eb1-d22b-4158-a858-2b05001d0d27 Aug 29 01:22:02 devstack sudo[99628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:22:02 devstack sudo[99626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_150ca1e6-83ca-4c33-8657-d2bf2e612206_1u4q83tidevstack@QuobyteHD Aug 29 01:22:02 devstack sudo[99626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:22:02 devstack sudo[99626]: pam_unix(sudo:session): session closed for user root Aug 29 01:22:02 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-5e5c2daa-6333-459f-ba01-52fc4bc40228 tempest-VolumeAndVolumeTypeFromImageTest-131665667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_150ca1e6-83ca-4c33-8657-d2bf2e612206_1u4q83tidevstack@QuobyteHD" returned: 0 in 0.437s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:22:02 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-5e5c2daa-6333-459f-ba01-52fc4bc40228 tempest-VolumeAndVolumeTypeFromImageTest-131665667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_150ca1e6-83ca-4c33-8657-d2bf2e612206_1u4q83tidevstack@QuobyteHD {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:22:02 devstack sudo[99628]: pam_unix(sudo:session): session closed for user root Aug 29 01:22:02 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8f2300a8-ce2e-4076-b24f-f3543482f7c3 tempest-VolumesCloneTest-1077476834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65fce528-98d5-4fa2-969c-fbaeb4a8118e -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-65fce528-98d5-4fa2-969c-fbaeb4a8118e.ee013eb1-d22b-4158-a858-2b05001d0d27" returned: 0 in 0.388s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:22:02 devstack cinder-volume[86111]: WARNING cinder.volume.drivers.remotefs [None req-8f2300a8-ce2e-4076-b24f-f3543482f7c3 tempest-VolumesCloneTest-1077476834 None] /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-65fce528-98d5-4fa2-969c-fbaeb4a8118e.ee013eb1-d22b-4158-a858-2b05001d0d27 is being set with open permissions: ugo+rw Aug 29 01:22:02 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8f2300a8-ce2e-4076-b24f-f3543482f7c3 tempest-VolumesCloneTest-1077476834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-65fce528-98d5-4fa2-969c-fbaeb4a8118e.ee013eb1-d22b-4158-a858-2b05001d0d27 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:22:02 devstack sudo[99638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-65fce528-98d5-4fa2-969c-fbaeb4a8118e.ee013eb1-d22b-4158-a858-2b05001d0d27 Aug 29 01:22:02 devstack sudo[99638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:22:02 devstack sudo[99637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_150ca1e6-83ca-4c33-8657-d2bf2e612206_1u4q83tidevstack@QuobyteHD Aug 29 01:22:02 devstack sudo[99637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:22:02 devstack sudo[99637]: pam_unix(sudo:session): session closed for user root Aug 29 01:22:02 devstack sudo[99638]: pam_unix(sudo:session): session closed for user root Aug 29 01:22:02 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-5e5c2daa-6333-459f-ba01-52fc4bc40228 tempest-VolumeAndVolumeTypeFromImageTest-131665667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_150ca1e6-83ca-4c33-8657-d2bf2e612206_1u4q83tidevstack@QuobyteHD" returned: 1 in 0.474s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:22:02 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-5e5c2daa-6333-459f-ba01-52fc4bc40228 tempest-VolumeAndVolumeTypeFromImageTest-131665667 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_150ca1e6-83ca-4c33-8657-d2bf2e612206_1u4q83tidevstack@QuobyteHD' failed. Not Retrying. {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 29 01:22:02 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-5e5c2daa-6333-459f-ba01-52fc4bc40228 tempest-VolumeAndVolumeTypeFromImageTest-131665667 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:22:02 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8f2300a8-ce2e-4076-b24f-f3543482f7c3 tempest-VolumesCloneTest-1077476834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-65fce528-98d5-4fa2-969c-fbaeb4a8118e.ee013eb1-d22b-4158-a858-2b05001d0d27" returned: 0 in 0.425s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:22:02 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8f2300a8-ce2e-4076-b24f-f3543482f7c3 tempest-VolumesCloneTest-1077476834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-65fce528-98d5-4fa2-969c-fbaeb4a8118e.info {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:22:02 devstack sudo[99645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-65fce528-98d5-4fa2-969c-fbaeb4a8118e.info Aug 29 01:22:02 devstack sudo[99645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:22:03 devstack sudo[99645]: pam_unix(sudo:session): session closed for user root Aug 29 01:22:03 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8f2300a8-ce2e-4076-b24f-f3543482f7c3 tempest-VolumesCloneTest-1077476834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-65fce528-98d5-4fa2-969c-fbaeb4a8118e.info" returned: 0 in 0.293s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:22:03 devstack cinder-volume[86111]: WARNING cinder.volume.drivers.remotefs [None req-8f2300a8-ce2e-4076-b24f-f3543482f7c3 tempest-VolumesCloneTest-1077476834 None] /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-65fce528-98d5-4fa2-969c-fbaeb4a8118e.info is being set with open permissions: ugo+rw Aug 29 01:22:03 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8f2300a8-ce2e-4076-b24f-f3543482f7c3 tempest-VolumesCloneTest-1077476834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-65fce528-98d5-4fa2-969c-fbaeb4a8118e.info {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:22:03 devstack sudo[99649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-65fce528-98d5-4fa2-969c-fbaeb4a8118e.info Aug 29 01:22:03 devstack sudo[99649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:22:03 devstack sudo[99649]: pam_unix(sudo:session): session closed for user root Aug 29 01:22:03 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8f2300a8-ce2e-4076-b24f-f3543482f7c3 tempest-VolumesCloneTest-1077476834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-65fce528-98d5-4fa2-969c-fbaeb4a8118e.info" returned: 0 in 0.285s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:22:03 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-8f2300a8-ce2e-4076-b24f-f3543482f7c3 tempest-VolumesCloneTest-1077476834 None] Acquiring lock "cinder-quobyte-eb57a56d-3b73-4449-8d5b-af3f3776fbb7" by "_copy_volume_from_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:22:03 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-8f2300a8-ce2e-4076-b24f-f3543482f7c3 tempest-VolumesCloneTest-1077476834 None] Lock "cinder-quobyte-eb57a56d-3b73-4449-8d5b-af3f3776fbb7" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:22:03 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-8f2300a8-ce2e-4076-b24f-f3543482f7c3 tempest-VolumesCloneTest-1077476834 None] snapshot: ee013eb1-d22b-4158-a858-2b05001d0d27, volume: eb57a56d-3b73-4449-8d5b-af3f3776fbb7, {{(pid=86111) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 29 01:22:03 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-8f2300a8-ce2e-4076-b24f-f3543482f7c3 tempest-VolumesCloneTest-1077476834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:22:03 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-8f2300a8-ce2e-4076-b24f-f3543482f7c3 tempest-VolumesCloneTest-1077476834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:22:03 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-8f2300a8-ce2e-4076-b24f-f3543482f7c3 tempest-VolumesCloneTest-1077476834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:22:03 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-8f2300a8-ce2e-4076-b24f-f3543482f7c3 tempest-VolumesCloneTest-1077476834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:22:03 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-8f2300a8-ce2e-4076-b24f-f3543482f7c3 tempest-VolumesCloneTest-1077476834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:22:03 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[38a0db05-72e0-4aac-831e-6b898d4e4152]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:22:03 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8f2300a8-ce2e-4076-b24f-f3543482f7c3 tempest-VolumesCloneTest-1077476834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-65fce528-98d5-4fa2-969c-fbaeb4a8118e.ee013eb1-d22b-4158-a858-2b05001d0d27 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:22:03 devstack sudo[99652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-65fce528-98d5-4fa2-969c-fbaeb4a8118e.ee013eb1-d22b-4158-a858-2b05001d0d27 Aug 29 01:22:03 devstack sudo[99652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:22:03 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-4378abdd-8003-44c4-8d52-5f610f14238d tempest-TestImageHashVerification-2107162483 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:22:03 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-4378abdd-8003-44c4-8d52-5f610f14238d tempest-TestImageHashVerification-2107162483 None] Flow 'volume_create_manager' (950d3a4f-f0a1-4a4d-b950-7b56af0f8da4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:22:03 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-4378abdd-8003-44c4-8d52-5f610f14238d tempest-TestImageHashVerification-2107162483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edd1820b-a20c-4b35-88fc-d952206679a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:22:03 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-4378abdd-8003-44c4-8d52-5f610f14238d tempest-TestImageHashVerification-2107162483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edd1820b-a20c-4b35-88fc-d952206679a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:22:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1088748604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3b79e2d-0d63-43b5-b0d7-f1d4ad477399,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b3abb908a1644f4acd22efc57bb376b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:22:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:22:04Z,use_quota=True,user_id='98fc67fed2c84d48b5bdeb461f3a0dc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:22:03 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-4378abdd-8003-44c4-8d52-5f610f14238d tempest-TestImageHashVerification-2107162483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d46c51dd-2699-4432-b653-45b5c4f7f041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:22:03 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-4378abdd-8003-44c4-8d52-5f610f14238d tempest-TestImageHashVerification-2107162483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d46c51dd-2699-4432-b653-45b5c4f7f041) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:22:03 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-4378abdd-8003-44c4-8d52-5f610f14238d tempest-TestImageHashVerification-2107162483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (772be87f-8491-43b2-ae83-55d90bb24817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:22:03 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-4378abdd-8003-44c4-8d52-5f610f14238d tempest-TestImageHashVerification-2107162483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (772be87f-8491-43b2-ae83-55d90bb24817) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3b79e2d-0d63-43b5-b0d7-f1d4ad477399', 'volume_name': 'volume-c3b79e2d-0d63-43b5-b0d7-f1d4ad477399', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:22:03 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-4378abdd-8003-44c4-8d52-5f610f14238d tempest-TestImageHashVerification-2107162483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75a4008d-f1ff-4a25-ba85-ab2ed45599df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:22:03 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-4378abdd-8003-44c4-8d52-5f610f14238d tempest-TestImageHashVerification-2107162483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75a4008d-f1ff-4a25-ba85-ab2ed45599df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:22:03 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-4378abdd-8003-44c4-8d52-5f610f14238d tempest-TestImageHashVerification-2107162483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e89ef4f-bfe0-43ef-853b-bfb2f1ac4985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:22:03 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-4378abdd-8003-44c4-8d52-5f610f14238d tempest-TestImageHashVerification-2107162483 None] Volume c3b79e2d-0d63-43b5-b0d7-f1d4ad477399: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3b79e2d-0d63-43b5-b0d7-f1d4ad477399', 'volume_size': 1} Aug 29 01:22:03 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-4378abdd-8003-44c4-8d52-5f610f14238d tempest-TestImageHashVerification-2107162483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:22:04 devstack sudo[99652]: pam_unix(sudo:session): session closed for user root Aug 29 01:22:04 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8f2300a8-ce2e-4076-b24f-f3543482f7c3 tempest-VolumesCloneTest-1077476834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-65fce528-98d5-4fa2-969c-fbaeb4a8118e.ee013eb1-d22b-4158-a858-2b05001d0d27" returned: 0 in 0.484s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:22:04 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-8f2300a8-ce2e-4076-b24f-f3543482f7c3 tempest-VolumesCloneTest-1077476834 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-65fce528-98d5-4fa2-969c-fbaeb4a8118e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 29 01:22:04 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef3ef92c-9d83-4aa5-ab8c-4d4889133aff]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:22:04 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8f2300a8-ce2e-4076-b24f-f3543482f7c3 tempest-VolumesCloneTest-1077476834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-65fce528-98d5-4fa2-969c-fbaeb4a8118e {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:22:04 devstack sudo[99657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-65fce528-98d5-4fa2-969c-fbaeb4a8118e Aug 29 01:22:04 devstack sudo[99657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:22:04 devstack sudo[99657]: pam_unix(sudo:session): session closed for user root Aug 29 01:22:04 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8f2300a8-ce2e-4076-b24f-f3543482f7c3 tempest-VolumesCloneTest-1077476834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-65fce528-98d5-4fa2-969c-fbaeb4a8118e" returned: 0 in 0.413s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:22:04 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-8f2300a8-ce2e-4076-b24f-f3543482f7c3 tempest-VolumesCloneTest-1077476834 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-65fce528-98d5-4fa2-969c-fbaeb4a8118e {{(pid=86111) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 29 01:22:04 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-8f2300a8-ce2e-4076-b24f-f3543482f7c3 tempest-VolumesCloneTest-1077476834 None] Creating direct copy from snapshot {{(pid=86111) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 29 01:22:04 devstack cinder-volume[86111]: DEBUG cinder.utils [None req-8f2300a8-ce2e-4076-b24f-f3543482f7c3 tempest-VolumesCloneTest-1077476834 None] Path /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-eb57a56d-3b73-4449-8d5b-af3f3776fbb7 not found in is_blk_device check {{(pid=86111) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 29 01:22:04 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8f2300a8-ce2e-4076-b24f-f3543482f7c3 tempest-VolumesCloneTest-1077476834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-65fce528-98d5-4fa2-969c-fbaeb4a8118e /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-eb57a56d-3b73-4449-8d5b-af3f3776fbb7 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:22:04 devstack sudo[99663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-65fce528-98d5-4fa2-969c-fbaeb4a8118e /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-eb57a56d-3b73-4449-8d5b-af3f3776fbb7 Aug 29 01:22:04 devstack sudo[99663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:22:09 devstack sudo[99663]: pam_unix(sudo:session): session closed for user root Aug 29 01:22:09 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8f2300a8-ce2e-4076-b24f-f3543482f7c3 tempest-VolumesCloneTest-1077476834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-65fce528-98d5-4fa2-969c-fbaeb4a8118e /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-eb57a56d-3b73-4449-8d5b-af3f3776fbb7" returned: 0 in 5.001s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:22:09 devstack cinder-volume[86111]: DEBUG cinder.image.image_utils [None req-8f2300a8-ce2e-4076-b24f-f3543482f7c3 tempest-VolumesCloneTest-1077476834 None] Image conversion details: src /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-65fce528-98d5-4fa2-969c-fbaeb4a8118e, size 1024.00 MB, duration 5.00 sec, destination /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-eb57a56d-3b73-4449-8d5b-af3f3776fbb7 {{(pid=86111) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 29 01:22:09 devstack cinder-volume[86111]: INFO cinder.image.image_utils [None req-8f2300a8-ce2e-4076-b24f-f3543482f7c3 tempest-VolumesCloneTest-1077476834 None] Converted 1024.00 MB image at 204.70 MB/s Aug 29 01:22:09 devstack cinder-volume[86111]: WARNING cinder.volume.drivers.remotefs [None req-8f2300a8-ce2e-4076-b24f-f3543482f7c3 tempest-VolumesCloneTest-1077476834 None] /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-eb57a56d-3b73-4449-8d5b-af3f3776fbb7 is being set with open permissions: ugo+rw Aug 29 01:22:09 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8f2300a8-ce2e-4076-b24f-f3543482f7c3 tempest-VolumesCloneTest-1077476834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-eb57a56d-3b73-4449-8d5b-af3f3776fbb7 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:22:09 devstack sudo[99678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-eb57a56d-3b73-4449-8d5b-af3f3776fbb7 Aug 29 01:22:09 devstack sudo[99678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:22:09 devstack sudo[99678]: pam_unix(sudo:session): session closed for user root Aug 29 01:22:09 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8f2300a8-ce2e-4076-b24f-f3543482f7c3 tempest-VolumesCloneTest-1077476834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-eb57a56d-3b73-4449-8d5b-af3f3776fbb7" returned: 0 in 0.278s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:22:09 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-8f2300a8-ce2e-4076-b24f-f3543482f7c3 tempest-VolumesCloneTest-1077476834 None] Lock "cinder-quobyte-eb57a56d-3b73-4449-8d5b-af3f3776fbb7" released by "_copy_volume_from_snapshot" :: held 6.266s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:22:09 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-8f2300a8-ce2e-4076-b24f-f3543482f7c3 tempest-VolumesCloneTest-1077476834 None] Acquiring lock "cinder-quobyte-ee013eb1-d22b-4158-a858-2b05001d0d27" by "_delete_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:22:09 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-8f2300a8-ce2e-4076-b24f-f3543482f7c3 tempest-VolumesCloneTest-1077476834 None] Lock "cinder-quobyte-ee013eb1-d22b-4158-a858-2b05001d0d27" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:22:09 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-8f2300a8-ce2e-4076-b24f-f3543482f7c3 tempest-VolumesCloneTest-1077476834 None] Deleting offline snapshot ee013eb1-d22b-4158-a858-2b05001d0d27 of volume 65fce528-98d5-4fa2-969c-fbaeb4a8118e {{(pid=86111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 29 01:22:09 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-8f2300a8-ce2e-4076-b24f-f3543482f7c3 tempest-VolumesCloneTest-1077476834 None] snapshot_file for this snap is: volume-65fce528-98d5-4fa2-969c-fbaeb4a8118e.ee013eb1-d22b-4158-a858-2b05001d0d27 {{(pid=86111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 29 01:22:09 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[be263c5e-ed7f-4e8e-8229-cc891f5ca8e5]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:22:09 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8f2300a8-ce2e-4076-b24f-f3543482f7c3 tempest-VolumesCloneTest-1077476834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-65fce528-98d5-4fa2-969c-fbaeb4a8118e.ee013eb1-d22b-4158-a858-2b05001d0d27 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:22:09 devstack sudo[99681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-65fce528-98d5-4fa2-969c-fbaeb4a8118e.ee013eb1-d22b-4158-a858-2b05001d0d27 Aug 29 01:22:09 devstack sudo[99681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:22:10 devstack sudo[99681]: pam_unix(sudo:session): session closed for user root Aug 29 01:22:10 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8f2300a8-ce2e-4076-b24f-f3543482f7c3 tempest-VolumesCloneTest-1077476834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-65fce528-98d5-4fa2-969c-fbaeb4a8118e.ee013eb1-d22b-4158-a858-2b05001d0d27" returned: 0 in 0.357s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:22:10 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-8f2300a8-ce2e-4076-b24f-f3543482f7c3 tempest-VolumesCloneTest-1077476834 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-65fce528-98d5-4fa2-969c-fbaeb4a8118e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 29 01:22:10 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fccef28-3a45-4aeb-b467-89c821d8f804]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:22:10 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8f2300a8-ce2e-4076-b24f-f3543482f7c3 tempest-VolumesCloneTest-1077476834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-65fce528-98d5-4fa2-969c-fbaeb4a8118e {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:22:10 devstack sudo[99686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-65fce528-98d5-4fa2-969c-fbaeb4a8118e Aug 29 01:22:10 devstack sudo[99686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:22:10 devstack sudo[99686]: pam_unix(sudo:session): session closed for user root Aug 29 01:22:10 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8f2300a8-ce2e-4076-b24f-f3543482f7c3 tempest-VolumesCloneTest-1077476834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-65fce528-98d5-4fa2-969c-fbaeb4a8118e" returned: 0 in 0.577s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:22:10 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8f2300a8-ce2e-4076-b24f-f3543482f7c3 tempest-VolumesCloneTest-1077476834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-65fce528-98d5-4fa2-969c-fbaeb4a8118e.ee013eb1-d22b-4158-a858-2b05001d0d27 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:22:10 devstack sudo[99692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-65fce528-98d5-4fa2-969c-fbaeb4a8118e.ee013eb1-d22b-4158-a858-2b05001d0d27 Aug 29 01:22:10 devstack sudo[99692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:22:11 devstack sudo[99692]: pam_unix(sudo:session): session closed for user root Aug 29 01:22:11 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8f2300a8-ce2e-4076-b24f-f3543482f7c3 tempest-VolumesCloneTest-1077476834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-65fce528-98d5-4fa2-969c-fbaeb4a8118e.ee013eb1-d22b-4158-a858-2b05001d0d27" returned: 0 in 0.363s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:22:11 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8f2300a8-ce2e-4076-b24f-f3543482f7c3 tempest-VolumesCloneTest-1077476834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-65fce528-98d5-4fa2-969c-fbaeb4a8118e.ee013eb1-d22b-4158-a858-2b05001d0d27 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:22:11 devstack sudo[99697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-65fce528-98d5-4fa2-969c-fbaeb4a8118e.ee013eb1-d22b-4158-a858-2b05001d0d27 Aug 29 01:22:11 devstack sudo[99697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:22:11 devstack sudo[99697]: pam_unix(sudo:session): session closed for user root Aug 29 01:22:11 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8f2300a8-ce2e-4076-b24f-f3543482f7c3 tempest-VolumesCloneTest-1077476834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-65fce528-98d5-4fa2-969c-fbaeb4a8118e.ee013eb1-d22b-4158-a858-2b05001d0d27" returned: 0 in 0.262s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:22:11 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-8f2300a8-ce2e-4076-b24f-f3543482f7c3 tempest-VolumesCloneTest-1077476834 None] Lock "cinder-quobyte-ee013eb1-d22b-4158-a858-2b05001d0d27" released by "_delete_snapshot" :: held 1.655s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:22:11 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-8f2300a8-ce2e-4076-b24f-f3543482f7c3 tempest-VolumesCloneTest-1077476834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.695s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:22:11 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-5e5c2daa-6333-459f-ba01-52fc4bc40228 tempest-VolumeAndVolumeTypeFromImageTest-131665667 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.673s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:22:11 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-5e5c2daa-6333-459f-ba01-52fc4bc40228 tempest-VolumeAndVolumeTypeFromImageTest-131665667 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:21:59Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63d6666d-2542-4aa4-afdc-139b12716c76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4491918490af4e3282de0211fb04b07c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:21:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:21:59Z,use_quota=True,user_id='accc1f2ece684ad7aaba3da61963252a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a9cd012-c634-4abd-ac9d-f5c1bcf8bc31),volume_type_id=3a9cd012-c634-4abd-ac9d-f5c1bcf8bc31)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:22:11 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-5e5c2daa-6333-459f-ba01-52fc4bc40228 tempest-VolumeAndVolumeTypeFromImageTest-131665667 None] Creating volume 63d6666d-2542-4aa4-afdc-139b12716c76 {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:22:11 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-5e5c2daa-6333-459f-ba01-52fc4bc40228 tempest-VolumeAndVolumeTypeFromImageTest-131665667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:22:11 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-5e5c2daa-6333-459f-ba01-52fc4bc40228 tempest-VolumeAndVolumeTypeFromImageTest-131665667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:22:11 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-5e5c2daa-6333-459f-ba01-52fc4bc40228 tempest-VolumeAndVolumeTypeFromImageTest-131665667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:22:11 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-5e5c2daa-6333-459f-ba01-52fc4bc40228 tempest-VolumeAndVolumeTypeFromImageTest-131665667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:22:11 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-5e5c2daa-6333-459f-ba01-52fc4bc40228 tempest-VolumeAndVolumeTypeFromImageTest-131665667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:22:11 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-5e5c2daa-6333-459f-ba01-52fc4bc40228 tempest-VolumeAndVolumeTypeFromImageTest-131665667 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:22:11 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-5e5c2daa-6333-459f-ba01-52fc4bc40228 tempest-VolumeAndVolumeTypeFromImageTest-131665667 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:22:11 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-5e5c2daa-6333-459f-ba01-52fc4bc40228 tempest-VolumeAndVolumeTypeFromImageTest-131665667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-63d6666d-2542-4aa4-afdc-139b12716c76 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:22:11 devstack sudo[99702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-63d6666d-2542-4aa4-afdc-139b12716c76 1073741824 Aug 29 01:22:11 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-8f2300a8-ce2e-4076-b24f-f3543482f7c3 tempest-VolumesCloneTest-1077476834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33eaed91-7a56-4aeb-8cd3-8fd44bed6d37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb57a56d-3b73-4449-8d5b-af3f3776fbb7', 'volume_size': 2, 'source_volid': '65fce528-98d5-4fa2-969c-fbaeb4a8118e', 'source_volstatus': 'available'}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:22:11 devstack sudo[99702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:22:11 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-8f2300a8-ce2e-4076-b24f-f3543482f7c3 tempest-VolumesCloneTest-1077476834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71793ab5-a8b3-4f26-b1d8-c659d0eedcea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:22:11 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-8f2300a8-ce2e-4076-b24f-f3543482f7c3 tempest-VolumesCloneTest-1077476834 None] Volume volume-eb57a56d-3b73-4449-8d5b-af3f3776fbb7 (eb57a56d-3b73-4449-8d5b-af3f3776fbb7): created successfully Aug 29 01:22:11 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-8f2300a8-ce2e-4076-b24f-f3543482f7c3 tempest-VolumesCloneTest-1077476834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71793ab5-a8b3-4f26-b1d8-c659d0eedcea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:22:11 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-8f2300a8-ce2e-4076-b24f-f3543482f7c3 tempest-VolumesCloneTest-1077476834 None] Flow 'volume_create_manager' (dafe71d8-03f0-4355-b01c-2480f83183aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:22:11 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-8f2300a8-ce2e-4076-b24f-f3543482f7c3 tempest-VolumesCloneTest-1077476834 None] Created volume successfully. Aug 29 01:22:11 devstack sudo[99702]: pam_unix(sudo:session): session closed for user root Aug 29 01:22:11 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-5e5c2daa-6333-459f-ba01-52fc4bc40228 tempest-VolumeAndVolumeTypeFromImageTest-131665667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-63d6666d-2542-4aa4-afdc-139b12716c76 1073741824" returned: 0 in 0.463s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:22:11 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-5e5c2daa-6333-459f-ba01-52fc4bc40228 tempest-VolumeAndVolumeTypeFromImageTest-131665667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-63d6666d-2542-4aa4-afdc-139b12716c76 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:22:12 devstack sudo[99709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-63d6666d-2542-4aa4-afdc-139b12716c76 Aug 29 01:22:12 devstack sudo[99709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:22:12 devstack sudo[99709]: pam_unix(sudo:session): session closed for user root Aug 29 01:22:12 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-5e5c2daa-6333-459f-ba01-52fc4bc40228 tempest-VolumeAndVolumeTypeFromImageTest-131665667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-63d6666d-2542-4aa4-afdc-139b12716c76" returned: 0 in 0.266s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:22:12 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-5e5c2daa-6333-459f-ba01-52fc4bc40228 tempest-VolumeAndVolumeTypeFromImageTest-131665667 None] <== create_volume: return (767ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:22:12 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-5e5c2daa-6333-459f-ba01-52fc4bc40228 tempest-VolumeAndVolumeTypeFromImageTest-131665667 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.770s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:22:12 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-4378abdd-8003-44c4-8d52-5f610f14238d tempest-TestImageHashVerification-2107162483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.279s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:22:12 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-4378abdd-8003-44c4-8d52-5f610f14238d tempest-TestImageHashVerification-2107162483 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:22:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1088748604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3b79e2d-0d63-43b5-b0d7-f1d4ad477399,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b3abb908a1644f4acd22efc57bb376b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:22:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:22:04Z,use_quota=True,user_id='98fc67fed2c84d48b5bdeb461f3a0dc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:22:12 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-4378abdd-8003-44c4-8d52-5f610f14238d tempest-TestImageHashVerification-2107162483 None] Creating volume c3b79e2d-0d63-43b5-b0d7-f1d4ad477399 {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:22:12 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-4378abdd-8003-44c4-8d52-5f610f14238d tempest-TestImageHashVerification-2107162483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:22:12 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-4378abdd-8003-44c4-8d52-5f610f14238d tempest-TestImageHashVerification-2107162483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:22:12 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-4378abdd-8003-44c4-8d52-5f610f14238d tempest-TestImageHashVerification-2107162483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:22:12 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-4378abdd-8003-44c4-8d52-5f610f14238d tempest-TestImageHashVerification-2107162483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:22:12 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-4378abdd-8003-44c4-8d52-5f610f14238d tempest-TestImageHashVerification-2107162483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:22:12 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-4378abdd-8003-44c4-8d52-5f610f14238d tempest-TestImageHashVerification-2107162483 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:22:12 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-4378abdd-8003-44c4-8d52-5f610f14238d tempest-TestImageHashVerification-2107162483 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:22:12 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-4378abdd-8003-44c4-8d52-5f610f14238d tempest-TestImageHashVerification-2107162483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-c3b79e2d-0d63-43b5-b0d7-f1d4ad477399 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:22:12 devstack sudo[99712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-c3b79e2d-0d63-43b5-b0d7-f1d4ad477399 1073741824 Aug 29 01:22:12 devstack sudo[99712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:22:12 devstack cinder-volume[86111]: DEBUG cinder.volume.volume_utils [None req-5e5c2daa-6333-459f-ba01-52fc4bc40228 tempest-VolumeAndVolumeTypeFromImageTest-131665667 None] Attempting download of 150ca1e6-83ca-4c33-8657-d2bf2e612206 ((None, [{'url': 'file:///opt/stack/data/glance/images/150ca1e6-83ca-4c33-8657-d2bf2e612206', 'metadata': {}}])) to volume 63d6666d-2542-4aa4-afdc-139b12716c76. {{(pid=86111) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 29 01:22:12 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a1f500f-bb97-438a-a308-60bb32af4b1d]: (4, 'raw') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:22:12 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-5e5c2daa-6333-459f-ba01-52fc4bc40228 tempest-VolumeAndVolumeTypeFromImageTest-131665667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_150ca1e6-83ca-4c33-8657-d2bf2e612206_pay4cd9v {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:22:12 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-664b7758-116c-4994-92eb-dc14395e2058 tempest-VolumesCloneTest-1077476834 None] Acquiring lock "cinder-eb57a56d-3b73-4449-8d5b-af3f3776fbb7-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:22:12 devstack sudo[99714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_150ca1e6-83ca-4c33-8657-d2bf2e612206_pay4cd9v Aug 29 01:22:12 devstack sudo[99714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:22:12 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-664b7758-116c-4994-92eb-dc14395e2058 tempest-VolumesCloneTest-1077476834 None] Lock "cinder-eb57a56d-3b73-4449-8d5b-af3f3776fbb7-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:22:12 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-664b7758-116c-4994-92eb-dc14395e2058 tempest-VolumesCloneTest-1077476834 None] Acquiring lock "cinder-quobyte-eb57a56d-3b73-4449-8d5b-af3f3776fbb7" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:22:12 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-664b7758-116c-4994-92eb-dc14395e2058 tempest-VolumesCloneTest-1077476834 None] Lock "cinder-quobyte-eb57a56d-3b73-4449-8d5b-af3f3776fbb7" acquired by "delete_volume" :: waited 0.018s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:22:12 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4774493-92e0-4a7b-9d5d-0ba87ded1755]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:22:12 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-664b7758-116c-4994-92eb-dc14395e2058 tempest-VolumesCloneTest-1077476834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-eb57a56d-3b73-4449-8d5b-af3f3776fbb7 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:22:12 devstack sudo[99719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-eb57a56d-3b73-4449-8d5b-af3f3776fbb7 Aug 29 01:22:12 devstack sudo[99719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:22:12 devstack sudo[99714]: pam_unix(sudo:session): session closed for user root Aug 29 01:22:12 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-5e5c2daa-6333-459f-ba01-52fc4bc40228 tempest-VolumeAndVolumeTypeFromImageTest-131665667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_150ca1e6-83ca-4c33-8657-d2bf2e612206_pay4cd9v" returned: 0 in 0.432s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:22:12 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-5e5c2daa-6333-459f-ba01-52fc4bc40228 tempest-VolumeAndVolumeTypeFromImageTest-131665667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_150ca1e6-83ca-4c33-8657-d2bf2e612206_pay4cd9v {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:22:12 devstack sudo[99712]: pam_unix(sudo:session): session closed for user root Aug 29 01:22:12 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-4378abdd-8003-44c4-8d52-5f610f14238d tempest-TestImageHashVerification-2107162483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-c3b79e2d-0d63-43b5-b0d7-f1d4ad477399 1073741824" returned: 0 in 0.647s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:22:12 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-4378abdd-8003-44c4-8d52-5f610f14238d tempest-TestImageHashVerification-2107162483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-c3b79e2d-0d63-43b5-b0d7-f1d4ad477399 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:22:12 devstack sudo[99725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-c3b79e2d-0d63-43b5-b0d7-f1d4ad477399 Aug 29 01:22:12 devstack sudo[99725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:22:12 devstack sudo[99724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_150ca1e6-83ca-4c33-8657-d2bf2e612206_pay4cd9v Aug 29 01:22:13 devstack sudo[99724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:22:13 devstack sudo[99719]: pam_unix(sudo:session): session closed for user root Aug 29 01:22:13 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-664b7758-116c-4994-92eb-dc14395e2058 tempest-VolumesCloneTest-1077476834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-eb57a56d-3b73-4449-8d5b-af3f3776fbb7" returned: 0 in 0.485s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:22:13 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-664b7758-116c-4994-92eb-dc14395e2058 tempest-VolumesCloneTest-1077476834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-eb57a56d-3b73-4449-8d5b-af3f3776fbb7 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:22:13 devstack sudo[99731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-eb57a56d-3b73-4449-8d5b-af3f3776fbb7 Aug 29 01:22:13 devstack sudo[99731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:22:13 devstack sudo[99725]: pam_unix(sudo:session): session closed for user root Aug 29 01:22:13 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-4378abdd-8003-44c4-8d52-5f610f14238d tempest-TestImageHashVerification-2107162483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-c3b79e2d-0d63-43b5-b0d7-f1d4ad477399" returned: 0 in 0.271s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:22:13 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-4378abdd-8003-44c4-8d52-5f610f14238d tempest-TestImageHashVerification-2107162483 None] <== create_volume: return (963ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:22:13 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-4378abdd-8003-44c4-8d52-5f610f14238d tempest-TestImageHashVerification-2107162483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.968s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:22:13 devstack sudo[99724]: pam_unix(sudo:session): session closed for user root Aug 29 01:22:13 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-4378abdd-8003-44c4-8d52-5f610f14238d tempest-TestImageHashVerification-2107162483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e89ef4f-bfe0-43ef-853b-bfb2f1ac4985) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3b79e2d-0d63-43b5-b0d7-f1d4ad477399', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:22:13 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-4378abdd-8003-44c4-8d52-5f610f14238d tempest-TestImageHashVerification-2107162483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b86bf388-a6c5-4fff-be62-8db52834d073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:22:13 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-5e5c2daa-6333-459f-ba01-52fc4bc40228 tempest-VolumeAndVolumeTypeFromImageTest-131665667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_150ca1e6-83ca-4c33-8657-d2bf2e612206_pay4cd9v" returned: 1 in 0.437s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:22:13 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-5e5c2daa-6333-459f-ba01-52fc4bc40228 tempest-VolumeAndVolumeTypeFromImageTest-131665667 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_150ca1e6-83ca-4c33-8657-d2bf2e612206_pay4cd9v' failed. Not Retrying. {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 29 01:22:13 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ebae663-fe2b-4969-ace2-e8cabdd480d2]: (4, 'raw') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:22:13 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-5e5c2daa-6333-459f-ba01-52fc4bc40228 tempest-VolumeAndVolumeTypeFromImageTest-131665667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_150ca1e6-83ca-4c33-8657-d2bf2e612206_1u4q83tidevstack@QuobyteHD {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:22:13 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-4378abdd-8003-44c4-8d52-5f610f14238d tempest-TestImageHashVerification-2107162483 None] Volume volume-c3b79e2d-0d63-43b5-b0d7-f1d4ad477399 (c3b79e2d-0d63-43b5-b0d7-f1d4ad477399): created successfully Aug 29 01:22:13 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-4378abdd-8003-44c4-8d52-5f610f14238d tempest-TestImageHashVerification-2107162483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b86bf388-a6c5-4fff-be62-8db52834d073) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:22:13 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-4378abdd-8003-44c4-8d52-5f610f14238d tempest-TestImageHashVerification-2107162483 None] Flow 'volume_create_manager' (950d3a4f-f0a1-4a4d-b950-7b56af0f8da4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:22:13 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-4378abdd-8003-44c4-8d52-5f610f14238d tempest-TestImageHashVerification-2107162483 None] Created volume successfully. Aug 29 01:22:13 devstack sudo[99736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_150ca1e6-83ca-4c33-8657-d2bf2e612206_1u4q83tidevstack@QuobyteHD Aug 29 01:22:13 devstack sudo[99736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:22:13 devstack sudo[99731]: pam_unix(sudo:session): session closed for user root Aug 29 01:22:13 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-664b7758-116c-4994-92eb-dc14395e2058 tempest-VolumesCloneTest-1077476834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-eb57a56d-3b73-4449-8d5b-af3f3776fbb7" returned: 0 in 0.289s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:22:13 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-664b7758-116c-4994-92eb-dc14395e2058 tempest-VolumesCloneTest-1077476834 None] Lock "cinder-quobyte-eb57a56d-3b73-4449-8d5b-af3f3776fbb7" released by "delete_volume" :: held 0.828s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:22:13 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-664b7758-116c-4994-92eb-dc14395e2058 tempest-VolumesCloneTest-1077476834 None] Created reservations ['134b3bc7-6931-4048-ba12-ee5aa8ceab2e', '3747dccd-0fbd-4679-aaac-420c01323138', '09002b04-e5ab-4512-b139-7e874f56f835', '1def3559-aad4-4ffe-a8b9-b49c391d5284'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:22:13 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-664b7758-116c-4994-92eb-dc14395e2058 tempest-VolumesCloneTest-1077476834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:22:13 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-664b7758-116c-4994-92eb-dc14395e2058 tempest-VolumesCloneTest-1077476834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:22:13 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-664b7758-116c-4994-92eb-dc14395e2058 tempest-VolumesCloneTest-1077476834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:22:13 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-664b7758-116c-4994-92eb-dc14395e2058 tempest-VolumesCloneTest-1077476834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:22:13 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-664b7758-116c-4994-92eb-dc14395e2058 tempest-VolumesCloneTest-1077476834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:22:13 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-664b7758-116c-4994-92eb-dc14395e2058 tempest-VolumesCloneTest-1077476834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:22:13 devstack sudo[99739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:22:13 devstack sudo[99739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:22:13 devstack sudo[99736]: pam_unix(sudo:session): session closed for user root Aug 29 01:22:13 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-5e5c2daa-6333-459f-ba01-52fc4bc40228 tempest-VolumeAndVolumeTypeFromImageTest-131665667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_150ca1e6-83ca-4c33-8657-d2bf2e612206_1u4q83tidevstack@QuobyteHD" returned: 0 in 0.377s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:22:13 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-5e5c2daa-6333-459f-ba01-52fc4bc40228 tempest-VolumeAndVolumeTypeFromImageTest-131665667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_150ca1e6-83ca-4c33-8657-d2bf2e612206_1u4q83tidevstack@QuobyteHD {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:22:13 devstack sudo[99743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_150ca1e6-83ca-4c33-8657-d2bf2e612206_1u4q83tidevstack@QuobyteHD Aug 29 01:22:13 devstack sudo[99743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:22:13 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-68eb6de1-f6f7-4399-b11e-b9a6423cd908 tempest-VolumesCloneTest-1077476834 None] Acquiring lock "cinder-65fce528-98d5-4fa2-969c-fbaeb4a8118e-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:22:13 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-68eb6de1-f6f7-4399-b11e-b9a6423cd908 tempest-VolumesCloneTest-1077476834 None] Lock "cinder-65fce528-98d5-4fa2-969c-fbaeb4a8118e-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:22:13 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-68eb6de1-f6f7-4399-b11e-b9a6423cd908 tempest-VolumesCloneTest-1077476834 None] Acquiring lock "cinder-quobyte-65fce528-98d5-4fa2-969c-fbaeb4a8118e" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:22:13 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-68eb6de1-f6f7-4399-b11e-b9a6423cd908 tempest-VolumesCloneTest-1077476834 None] Lock "cinder-quobyte-65fce528-98d5-4fa2-969c-fbaeb4a8118e" acquired by "delete_volume" :: waited 0.029s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:22:14 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aebd00a-e405-4c61-a69e-3ad20cb184b7]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:22:14 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-68eb6de1-f6f7-4399-b11e-b9a6423cd908 tempest-VolumesCloneTest-1077476834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-65fce528-98d5-4fa2-969c-fbaeb4a8118e {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:22:14 devstack sudo[99739]: pam_unix(sudo:session): session closed for user root Aug 29 01:22:14 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-664b7758-116c-4994-92eb-dc14395e2058 tempest-VolumesCloneTest-1077476834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.531s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:22:14 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-664b7758-116c-4994-92eb-dc14395e2058 tempest-VolumesCloneTest-1077476834 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:22:14 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-664b7758-116c-4994-92eb-dc14395e2058 tempest-VolumesCloneTest-1077476834 None] Deleted volume successfully. Aug 29 01:22:14 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-664b7758-116c-4994-92eb-dc14395e2058 tempest-VolumesCloneTest-1077476834 None] Lock "cinder-eb57a56d-3b73-4449-8d5b-af3f3776fbb7-delete_volume" released by "delete_volume" :: held 1.613s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:22:14 devstack sudo[99746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-65fce528-98d5-4fa2-969c-fbaeb4a8118e Aug 29 01:22:14 devstack sudo[99746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:22:14 devstack sudo[99743]: pam_unix(sudo:session): session closed for user root Aug 29 01:22:14 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-5e5c2daa-6333-459f-ba01-52fc4bc40228 tempest-VolumeAndVolumeTypeFromImageTest-131665667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_150ca1e6-83ca-4c33-8657-d2bf2e612206_1u4q83tidevstack@QuobyteHD" returned: 1 in 0.656s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:22:14 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-5e5c2daa-6333-459f-ba01-52fc4bc40228 tempest-VolumeAndVolumeTypeFromImageTest-131665667 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_150ca1e6-83ca-4c33-8657-d2bf2e612206_1u4q83tidevstack@QuobyteHD' failed. Not Retrying. {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 29 01:22:14 devstack cinder-volume[86111]: DEBUG cinder.image.image_utils [None req-5e5c2daa-6333-459f-ba01-52fc4bc40228 tempest-VolumeAndVolumeTypeFromImageTest-131665667 None] 150ca1e6-83ca-4c33-8657-d2bf2e612206 was raw, converting to qcow2 {{(pid=86111) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 29 01:22:14 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-5e5c2daa-6333-459f-ba01-52fc4bc40228 tempest-VolumeAndVolumeTypeFromImageTest-131665667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_150ca1e6-83ca-4c33-8657-d2bf2e612206_1u4q83tidevstack@QuobyteHD /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-63d6666d-2542-4aa4-afdc-139b12716c76 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:22:14 devstack sudo[99751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_150ca1e6-83ca-4c33-8657-d2bf2e612206_1u4q83tidevstack@QuobyteHD /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-63d6666d-2542-4aa4-afdc-139b12716c76 Aug 29 01:22:14 devstack sudo[99751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:22:14 devstack sudo[99746]: pam_unix(sudo:session): session closed for user root Aug 29 01:22:14 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-68eb6de1-f6f7-4399-b11e-b9a6423cd908 tempest-VolumesCloneTest-1077476834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-65fce528-98d5-4fa2-969c-fbaeb4a8118e" returned: 0 in 0.561s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:22:14 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-68eb6de1-f6f7-4399-b11e-b9a6423cd908 tempest-VolumesCloneTest-1077476834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-65fce528-98d5-4fa2-969c-fbaeb4a8118e {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:22:14 devstack sudo[99758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-65fce528-98d5-4fa2-969c-fbaeb4a8118e Aug 29 01:22:14 devstack sudo[99758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:22:14 devstack sudo[99751]: pam_unix(sudo:session): session closed for user root Aug 29 01:22:14 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-5e5c2daa-6333-459f-ba01-52fc4bc40228 tempest-VolumeAndVolumeTypeFromImageTest-131665667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_150ca1e6-83ca-4c33-8657-d2bf2e612206_1u4q83tidevstack@QuobyteHD /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-63d6666d-2542-4aa4-afdc-139b12716c76" returned: 0 in 0.554s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:22:14 devstack cinder-volume[86111]: DEBUG cinder.image.image_utils [None req-5e5c2daa-6333-459f-ba01-52fc4bc40228 tempest-VolumeAndVolumeTypeFromImageTest-131665667 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_150ca1e6-83ca-4c33-8657-d2bf2e612206_1u4q83tidevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-63d6666d-2542-4aa4-afdc-139b12716c76 {{(pid=86111) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 29 01:22:14 devstack cinder-volume[86111]: INFO cinder.image.image_utils [None req-5e5c2daa-6333-459f-ba01-52fc4bc40228 tempest-VolumeAndVolumeTypeFromImageTest-131665667 None] Converted 0.00 MB image at 0.00 MB/s Aug 29 01:22:14 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-5e5c2daa-6333-459f-ba01-52fc4bc40228 tempest-VolumeAndVolumeTypeFromImageTest-131665667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-63d6666d-2542-4aa4-afdc-139b12716c76 1G {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:22:14 devstack sudo[99758]: pam_unix(sudo:session): session closed for user root Aug 29 01:22:14 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-68eb6de1-f6f7-4399-b11e-b9a6423cd908 tempest-VolumesCloneTest-1077476834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-65fce528-98d5-4fa2-969c-fbaeb4a8118e" returned: 0 in 0.335s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:22:14 devstack sudo[99762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-63d6666d-2542-4aa4-afdc-139b12716c76 1G Aug 29 01:22:14 devstack sudo[99762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:22:14 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-68eb6de1-f6f7-4399-b11e-b9a6423cd908 tempest-VolumesCloneTest-1077476834 None] Lock "cinder-quobyte-65fce528-98d5-4fa2-969c-fbaeb4a8118e" released by "delete_volume" :: held 1.042s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:22:15 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-68eb6de1-f6f7-4399-b11e-b9a6423cd908 tempest-VolumesCloneTest-1077476834 None] Created reservations ['44d1ad78-4dfa-481c-9fd0-6e1e41f208e1', '108b19da-a12b-4497-838d-b4083b606e7b', '43c34701-aa48-43b9-9bea-a1de3fcae534', '12cd31a5-1e0f-4e06-a721-aa19a88086b9'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:22:15 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-68eb6de1-f6f7-4399-b11e-b9a6423cd908 tempest-VolumesCloneTest-1077476834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:22:15 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-68eb6de1-f6f7-4399-b11e-b9a6423cd908 tempest-VolumesCloneTest-1077476834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:22:15 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-68eb6de1-f6f7-4399-b11e-b9a6423cd908 tempest-VolumesCloneTest-1077476834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:22:15 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-68eb6de1-f6f7-4399-b11e-b9a6423cd908 tempest-VolumesCloneTest-1077476834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:22:15 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-68eb6de1-f6f7-4399-b11e-b9a6423cd908 tempest-VolumesCloneTest-1077476834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:22:15 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-68eb6de1-f6f7-4399-b11e-b9a6423cd908 tempest-VolumesCloneTest-1077476834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:22:15 devstack sudo[99765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:22:15 devstack sudo[99765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:22:15 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-c31fb426-06ad-4101-8cd4-b55497bed4af tempest-TestImageHashVerification-2107162483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:22:15 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-c31fb426-06ad-4101-8cd4-b55497bed4af tempest-TestImageHashVerification-2107162483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:22:15 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[92fcf92c-e46d-4e10-9cba-82d50d8669ef]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:22:15 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c31fb426-06ad-4101-8cd4-b55497bed4af tempest-TestImageHashVerification-2107162483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-c3b79e2d-0d63-43b5-b0d7-f1d4ad477399 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:22:15 devstack sudo[99762]: pam_unix(sudo:session): session closed for user root Aug 29 01:22:15 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-5e5c2daa-6333-459f-ba01-52fc4bc40228 tempest-VolumeAndVolumeTypeFromImageTest-131665667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-63d6666d-2542-4aa4-afdc-139b12716c76 1G" returned: 0 in 0.460s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:22:15 devstack cinder-volume[86111]: DEBUG cinder.volume.volume_utils [None req-5e5c2daa-6333-459f-ba01-52fc4bc40228 tempest-VolumeAndVolumeTypeFromImageTest-131665667 None] Downloaded image 150ca1e6-83ca-4c33-8657-d2bf2e612206 ((None, [{'url': 'file:///opt/stack/data/glance/images/150ca1e6-83ca-4c33-8657-d2bf2e612206', 'metadata': {}}])) to volume 63d6666d-2542-4aa4-afdc-139b12716c76 successfully. {{(pid=86111) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 29 01:22:15 devstack cinder-volume[86111]: DEBUG cinder.image.image_utils [None req-5e5c2daa-6333-459f-ba01-52fc4bc40228 tempest-VolumeAndVolumeTypeFromImageTest-131665667 None] Temporary image 150ca1e6-83ca-4c33-8657-d2bf2e612206 for user accc1f2ece684ad7aaba3da61963252a is deleted. {{(pid=86111) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 29 01:22:15 devstack cinder-volume[86111]: DEBUG cinder.volume.volume_utils [None req-5e5c2daa-6333-459f-ba01-52fc4bc40228 tempest-VolumeAndVolumeTypeFromImageTest-131665667 None] Marking volume 63d6666d-2542-4aa4-afdc-139b12716c76 as bootable. {{(pid=86111) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 29 01:22:15 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e5c2daa-6333-459f-ba01-52fc4bc40228 tempest-VolumeAndVolumeTypeFromImageTest-131665667 None] Copying metadata from image 150ca1e6-83ca-4c33-8657-d2bf2e612206 to 63d6666d-2542-4aa4-afdc-139b12716c76. {{(pid=86111) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 29 01:22:15 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e5c2daa-6333-459f-ba01-52fc4bc40228 tempest-VolumeAndVolumeTypeFromImageTest-131665667 None] Creating volume glance metadata for volume 63d6666d-2542-4aa4-afdc-139b12716c76 backed by image 150ca1e6-83ca-4c33-8657-d2bf2e612206 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '150ca1e6-83ca-4c33-8657-d2bf2e612206', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'd36e0cd7b8d8717a915b19b269279945', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86111) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 29 01:22:15 devstack sudo[99765]: pam_unix(sudo:session): session closed for user root Aug 29 01:22:15 devstack sudo[99771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-c3b79e2d-0d63-43b5-b0d7-f1d4ad477399 Aug 29 01:22:15 devstack sudo[99771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:22:15 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-68eb6de1-f6f7-4399-b11e-b9a6423cd908 tempest-VolumesCloneTest-1077476834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.335s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:22:15 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-68eb6de1-f6f7-4399-b11e-b9a6423cd908 tempest-VolumesCloneTest-1077476834 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:22:15 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-5e5c2daa-6333-459f-ba01-52fc4bc40228 tempest-VolumeAndVolumeTypeFromImageTest-131665667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd3fc988-9926-461d-96ef-3589d9684c48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63d6666d-2542-4aa4-afdc-139b12716c76', 'volume_size': 1, 'image_id': '150ca1e6-83ca-4c33-8657-d2bf2e612206', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/150ca1e6-83ca-4c33-8657-d2bf2e612206', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd36e0cd7b8d8717a915b19b269279945', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4491918490af4e3282de0211fb04b07c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '02419cb373a09c9940e68080823b6064e36a0eaafab567938f5272b0f60fe37ff5d362f9dd1da44edeca28adb0d3cfd21bf25822df290b0dc53d91b47b3981a5', 'id': '150ca1e6-83ca-4c33-8657-d2bf2e612206', 'created_at': datetime.datetime(2026, 8, 28, 23, 21, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 23, 21, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/150ca1e6-83ca-4c33-8657-d2bf2e612206/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:22:15 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-5e5c2daa-6333-459f-ba01-52fc4bc40228 tempest-VolumeAndVolumeTypeFromImageTest-131665667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e430457-9aa1-4f5f-aea0-1052d8bcde5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:22:15 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-68eb6de1-f6f7-4399-b11e-b9a6423cd908 tempest-VolumesCloneTest-1077476834 None] Deleted volume successfully. Aug 29 01:22:15 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-5e5c2daa-6333-459f-ba01-52fc4bc40228 tempest-VolumeAndVolumeTypeFromImageTest-131665667 None] Volume volume-63d6666d-2542-4aa4-afdc-139b12716c76 (63d6666d-2542-4aa4-afdc-139b12716c76): created successfully Aug 29 01:22:15 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-5e5c2daa-6333-459f-ba01-52fc4bc40228 tempest-VolumeAndVolumeTypeFromImageTest-131665667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e430457-9aa1-4f5f-aea0-1052d8bcde5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:22:15 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-5e5c2daa-6333-459f-ba01-52fc4bc40228 tempest-VolumeAndVolumeTypeFromImageTest-131665667 None] Flow 'volume_create_manager' (ecd41158-c3fe-414d-a2c1-7700f43018e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:22:15 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-68eb6de1-f6f7-4399-b11e-b9a6423cd908 tempest-VolumesCloneTest-1077476834 None] Lock "cinder-65fce528-98d5-4fa2-969c-fbaeb4a8118e-delete_volume" released by "delete_volume" :: held 1.690s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:22:15 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-5e5c2daa-6333-459f-ba01-52fc4bc40228 tempest-VolumeAndVolumeTypeFromImageTest-131665667 None] Created volume successfully. Aug 29 01:22:15 devstack sudo[99771]: pam_unix(sudo:session): session closed for user root Aug 29 01:22:15 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c31fb426-06ad-4101-8cd4-b55497bed4af tempest-TestImageHashVerification-2107162483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-c3b79e2d-0d63-43b5-b0d7-f1d4ad477399" returned: 0 in 0.415s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:22:15 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[b57d6bc9-41ab-4fc2-a472-5a39bfa5ea8c]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:22:15 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c31fb426-06ad-4101-8cd4-b55497bed4af tempest-TestImageHashVerification-2107162483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-c3b79e2d-0d63-43b5-b0d7-f1d4ad477399 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:22:15 devstack sudo[99777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-c3b79e2d-0d63-43b5-b0d7-f1d4ad477399 Aug 29 01:22:15 devstack sudo[99777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:22:15 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-fe70c263-87f5-4528-894b-54601facafa1 tempest-VolumeAndVolumeTypeFromImageTest-131665667 None] Acquiring lock "cinder-63d6666d-2542-4aa4-afdc-139b12716c76-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:22:15 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-fe70c263-87f5-4528-894b-54601facafa1 tempest-VolumeAndVolumeTypeFromImageTest-131665667 None] Lock "cinder-63d6666d-2542-4aa4-afdc-139b12716c76-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:22:16 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-fe70c263-87f5-4528-894b-54601facafa1 tempest-VolumeAndVolumeTypeFromImageTest-131665667 None] Acquiring lock "cinder-quobyte-63d6666d-2542-4aa4-afdc-139b12716c76" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:22:16 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-fe70c263-87f5-4528-894b-54601facafa1 tempest-VolumeAndVolumeTypeFromImageTest-131665667 None] Lock "cinder-quobyte-63d6666d-2542-4aa4-afdc-139b12716c76" acquired by "delete_volume" :: waited 0.025s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:22:16 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ecc6524-2172-45b9-b289-11ebce215ad9]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:22:16 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-fe70c263-87f5-4528-894b-54601facafa1 tempest-VolumeAndVolumeTypeFromImageTest-131665667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-63d6666d-2542-4aa4-afdc-139b12716c76 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:22:16 devstack sudo[99777]: pam_unix(sudo:session): session closed for user root Aug 29 01:22:16 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c31fb426-06ad-4101-8cd4-b55497bed4af tempest-TestImageHashVerification-2107162483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-c3b79e2d-0d63-43b5-b0d7-f1d4ad477399" returned: 0 in 0.460s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:22:16 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c31fb426-06ad-4101-8cd4-b55497bed4af tempest-TestImageHashVerification-2107162483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-c3b79e2d-0d63-43b5-b0d7-f1d4ad477399 /opt/stack/data/cinder/conversion/c3b79e2d-0d63-43b5-b0d7-f1d4ad477399.temp_image.99e3512e-19a9-4a42-a11f-58f0ba5f4ad5z3hw80jn.img {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:22:16 devstack sudo[99783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-c3b79e2d-0d63-43b5-b0d7-f1d4ad477399 /opt/stack/data/cinder/conversion/c3b79e2d-0d63-43b5-b0d7-f1d4ad477399.temp_image.99e3512e-19a9-4a42-a11f-58f0ba5f4ad5z3hw80jn.img Aug 29 01:22:16 devstack sudo[99783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:22:16 devstack sudo[99781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-63d6666d-2542-4aa4-afdc-139b12716c76 Aug 29 01:22:16 devstack sudo[99781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:22:16 devstack sudo[99781]: pam_unix(sudo:session): session closed for user root Aug 29 01:22:16 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-fe70c263-87f5-4528-894b-54601facafa1 tempest-VolumeAndVolumeTypeFromImageTest-131665667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-63d6666d-2542-4aa4-afdc-139b12716c76" returned: 0 in 0.540s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:22:16 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-fe70c263-87f5-4528-894b-54601facafa1 tempest-VolumeAndVolumeTypeFromImageTest-131665667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-63d6666d-2542-4aa4-afdc-139b12716c76 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:22:16 devstack sudo[99798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-63d6666d-2542-4aa4-afdc-139b12716c76 Aug 29 01:22:16 devstack sudo[99798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:22:17 devstack sudo[99798]: pam_unix(sudo:session): session closed for user root Aug 29 01:22:17 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-fe70c263-87f5-4528-894b-54601facafa1 tempest-VolumeAndVolumeTypeFromImageTest-131665667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-63d6666d-2542-4aa4-afdc-139b12716c76" returned: 0 in 0.718s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:22:17 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-fe70c263-87f5-4528-894b-54601facafa1 tempest-VolumeAndVolumeTypeFromImageTest-131665667 None] Lock "cinder-quobyte-63d6666d-2542-4aa4-afdc-139b12716c76" released by "delete_volume" :: held 1.362s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:22:17 devstack cinder-volume[86111]: WARNING cinder.quota [None req-fe70c263-87f5-4528-894b-54601facafa1 tempest-VolumeAndVolumeTypeFromImageTest-131665667 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Aug 29 01:22:17 devstack cinder-volume[86111]: WARNING cinder.quota [None req-fe70c263-87f5-4528-894b-54601facafa1 tempest-VolumeAndVolumeTypeFromImageTest-131665667 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Aug 29 01:22:17 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-fe70c263-87f5-4528-894b-54601facafa1 tempest-VolumeAndVolumeTypeFromImageTest-131665667 None] Created reservations ['01c4b273-b762-477c-b756-8e59a7d2093b', '0a4d1770-5e6f-41e2-926d-f063c2c84524', 'b249f1b7-e3b4-4b68-b925-4f35d8d9bcd6', '9e9eb29a-7f1a-4030-b363-118f40aecb9e'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:22:17 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-fe70c263-87f5-4528-894b-54601facafa1 tempest-VolumeAndVolumeTypeFromImageTest-131665667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:22:17 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-fe70c263-87f5-4528-894b-54601facafa1 tempest-VolumeAndVolumeTypeFromImageTest-131665667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:22:17 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-fe70c263-87f5-4528-894b-54601facafa1 tempest-VolumeAndVolumeTypeFromImageTest-131665667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:22:17 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-fe70c263-87f5-4528-894b-54601facafa1 tempest-VolumeAndVolumeTypeFromImageTest-131665667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:22:17 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-fe70c263-87f5-4528-894b-54601facafa1 tempest-VolumeAndVolumeTypeFromImageTest-131665667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:22:17 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-fe70c263-87f5-4528-894b-54601facafa1 tempest-VolumeAndVolumeTypeFromImageTest-131665667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:22:17 devstack sudo[99804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:22:17 devstack sudo[99804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:22:18 devstack sudo[99804]: pam_unix(sudo:session): session closed for user root Aug 29 01:22:18 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-fe70c263-87f5-4528-894b-54601facafa1 tempest-VolumeAndVolumeTypeFromImageTest-131665667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.393s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:22:18 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-fe70c263-87f5-4528-894b-54601facafa1 tempest-VolumeAndVolumeTypeFromImageTest-131665667 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:22:18 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-fe70c263-87f5-4528-894b-54601facafa1 tempest-VolumeAndVolumeTypeFromImageTest-131665667 None] Deleted volume successfully. Aug 29 01:22:18 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-fe70c263-87f5-4528-894b-54601facafa1 tempest-VolumeAndVolumeTypeFromImageTest-131665667 None] Lock "cinder-63d6666d-2542-4aa4-afdc-139b12716c76-delete_volume" released by "delete_volume" :: held 2.304s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:22:21 devstack sudo[99783]: pam_unix(sudo:session): session closed for user root Aug 29 01:22:21 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c31fb426-06ad-4101-8cd4-b55497bed4af tempest-TestImageHashVerification-2107162483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-c3b79e2d-0d63-43b5-b0d7-f1d4ad477399 /opt/stack/data/cinder/conversion/c3b79e2d-0d63-43b5-b0d7-f1d4ad477399.temp_image.99e3512e-19a9-4a42-a11f-58f0ba5f4ad5z3hw80jn.img" returned: 0 in 5.669s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:22:21 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9931f38-c40f-4a54-b709-da4aaec9d91e]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:22:21 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c31fb426-06ad-4101-8cd4-b55497bed4af tempest-TestImageHashVerification-2107162483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-c3b79e2d-0d63-43b5-b0d7-f1d4ad477399 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:22:22 devstack sudo[99809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-c3b79e2d-0d63-43b5-b0d7-f1d4ad477399 Aug 29 01:22:22 devstack sudo[99809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:22:22 devstack sudo[99809]: pam_unix(sudo:session): session closed for user root Aug 29 01:22:22 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c31fb426-06ad-4101-8cd4-b55497bed4af tempest-TestImageHashVerification-2107162483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-c3b79e2d-0d63-43b5-b0d7-f1d4ad477399" returned: 0 in 0.657s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:22:22 devstack cinder-volume[86111]: DEBUG cinder.image.image_utils [None req-c31fb426-06ad-4101-8cd4-b55497bed4af tempest-TestImageHashVerification-2107162483 None] Image conversion details: src /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-c3b79e2d-0d63-43b5-b0d7-f1d4ad477399, size 1024.00 MB, duration 5.67 sec, destination /opt/stack/data/cinder/conversion/c3b79e2d-0d63-43b5-b0d7-f1d4ad477399.temp_image.99e3512e-19a9-4a42-a11f-58f0ba5f4ad5z3hw80jn.img {{(pid=86111) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 29 01:22:22 devstack cinder-volume[86111]: INFO cinder.image.image_utils [None req-c31fb426-06ad-4101-8cd4-b55497bed4af tempest-TestImageHashVerification-2107162483 None] Converted 1024.00 MB image at 180.61 MB/s Aug 29 01:22:22 devstack cinder-volume[86111]: DEBUG cinder.image.image_utils [None req-c31fb426-06ad-4101-8cd4-b55497bed4af tempest-TestImageHashVerification-2107162483 None] 99e3512e-19a9-4a42-a11f-58f0ba5f4ad5 was raw, no need to convert to raw {{(pid=86111) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Aug 29 01:22:23 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce76f1dd-fa8d-4d7f-8675-ecb901620f53 tempest-VolumesGetTest-954660907 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:22:23 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-ce76f1dd-fa8d-4d7f-8675-ecb901620f53 tempest-VolumesGetTest-954660907 None] Flow 'volume_create_manager' (8d11d7bf-4d6a-48cd-b1c7-76abbecd8fbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:22:23 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-ce76f1dd-fa8d-4d7f-8675-ecb901620f53 tempest-VolumesGetTest-954660907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64e037d4-5f18-4f8a-b4d9-4c9849f33701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:22:23 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-ce76f1dd-fa8d-4d7f-8675-ecb901620f53 tempest-VolumesGetTest-954660907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64e037d4-5f18-4f8a-b4d9-4c9849f33701) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:22:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1729588819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=718c2594-e743-400b-a196-187fbafce2ea,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='5c4c32927df54b70ae25b85da6abe7ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:22:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:22:24Z,use_quota=True,user_id='6d651c7f6792483d90119c301b2dd999',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:22:23 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-ce76f1dd-fa8d-4d7f-8675-ecb901620f53 tempest-VolumesGetTest-954660907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d574adf-ee73-444a-9746-3e31fdb0b9c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:22:23 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-ce76f1dd-fa8d-4d7f-8675-ecb901620f53 tempest-VolumesGetTest-954660907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d574adf-ee73-444a-9746-3e31fdb0b9c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:22:23 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-ce76f1dd-fa8d-4d7f-8675-ecb901620f53 tempest-VolumesGetTest-954660907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a587198a-8b11-424a-a891-aaf517bfb64a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:22:23 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-ce76f1dd-fa8d-4d7f-8675-ecb901620f53 tempest-VolumesGetTest-954660907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a587198a-8b11-424a-a891-aaf517bfb64a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '718c2594-e743-400b-a196-187fbafce2ea', 'volume_name': 'volume-718c2594-e743-400b-a196-187fbafce2ea', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:22:23 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-ce76f1dd-fa8d-4d7f-8675-ecb901620f53 tempest-VolumesGetTest-954660907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60b5c264-5e08-4462-bacb-c88e397a45f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:22:23 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-ce76f1dd-fa8d-4d7f-8675-ecb901620f53 tempest-VolumesGetTest-954660907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60b5c264-5e08-4462-bacb-c88e397a45f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:22:23 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-ce76f1dd-fa8d-4d7f-8675-ecb901620f53 tempest-VolumesGetTest-954660907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65fa17e6-d235-476e-b778-341a79adf494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:22:23 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-ce76f1dd-fa8d-4d7f-8675-ecb901620f53 tempest-VolumesGetTest-954660907 None] Volume 718c2594-e743-400b-a196-187fbafce2ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-718c2594-e743-400b-a196-187fbafce2ea', 'volume_size': 1} Aug 29 01:22:23 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-ce76f1dd-fa8d-4d7f-8675-ecb901620f53 tempest-VolumesGetTest-954660907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:22:26 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-1836a5d3-119c-4e94-b5a1-c6195a7a0652 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:22:26 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-1836a5d3-119c-4e94-b5a1-c6195a7a0652 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Flow 'volume_create_manager' (54813688-10ea-46c7-8e14-95ad09e9e147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:22:26 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-1836a5d3-119c-4e94-b5a1-c6195a7a0652 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (774c8b60-c54a-4c61-8133-7d1f638f3e47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:22:26 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-1836a5d3-119c-4e94-b5a1-c6195a7a0652 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (774c8b60-c54a-4c61-8133-7d1f638f3e47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:22:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1949600099',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ece0894-d177-4a56-8078-bd9352672608,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='919ac2ce6d46489f905916ca474cc495',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:22:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:22:26Z,use_quota=True,user_id='29232661a428474d9d225623aeddbf3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:22:26 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-1836a5d3-119c-4e94-b5a1-c6195a7a0652 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f757c7bf-fa98-4937-a540-4f4210860303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:22:26 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-1836a5d3-119c-4e94-b5a1-c6195a7a0652 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f757c7bf-fa98-4937-a540-4f4210860303) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:22:26 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-1836a5d3-119c-4e94-b5a1-c6195a7a0652 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20dceb72-930b-47a6-bdc4-6cdb4fd302b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:22:26 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-1836a5d3-119c-4e94-b5a1-c6195a7a0652 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20dceb72-930b-47a6-bdc4-6cdb4fd302b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ece0894-d177-4a56-8078-bd9352672608', 'volume_name': 'volume-3ece0894-d177-4a56-8078-bd9352672608', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:22:26 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-1836a5d3-119c-4e94-b5a1-c6195a7a0652 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c66d2942-bd49-4e47-9b97-7e73d15f9b9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:22:26 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-1836a5d3-119c-4e94-b5a1-c6195a7a0652 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c66d2942-bd49-4e47-9b97-7e73d15f9b9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:22:26 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-1836a5d3-119c-4e94-b5a1-c6195a7a0652 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69123b14-0e1a-4dcf-8f08-2d3df183a243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:22:26 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-1836a5d3-119c-4e94-b5a1-c6195a7a0652 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Volume 3ece0894-d177-4a56-8078-bd9352672608: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ece0894-d177-4a56-8078-bd9352672608', 'volume_size': 1} Aug 29 01:22:26 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-1836a5d3-119c-4e94-b5a1-c6195a7a0652 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:22:36 devstack cinder-volume[86111]: DEBUG dbcounter [-] [86111] Writing DB stats cinder:SELECT=49,cinder:INSERT=14,cinder:UPDATE=42,cinder:DELETE=3 {{(pid=86111) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 29 01:22:36 devstack cinder-volume[86111]: DEBUG dbcounter [-] [86111] Writing DB stats cinder:UPDATE=54,cinder:SELECT=34,cinder:INSERT=18,cinder:DELETE=5 {{(pid=86111) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 29 01:22:40 devstack cinder-volume[86111]: DEBUG oslo_service.periodic_task [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86111) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 29 01:22:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:22:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:22:40 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:22:40 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:22:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:22:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:22:40 devstack sudo[99861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:22:40 devstack sudo[99861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:22:41 devstack sudo[99861]: pam_unix(sudo:session): session closed for user root Aug 29 01:22:41 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-de752545-d617-440e-8362-d04fae0901a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.446s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:22:41 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:22:41 devstack cinder-volume[86111]: DEBUG oslo_service.periodic_task [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Running periodic task VolumeManager._thread_info {{(pid=86111) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 29 01:22:41 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-de752545-d617-440e-8362-d04fae0901a5 None None] thread count: 28 {{(pid=86111) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 29 01:22:41 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-de752545-d617-440e-8362-d04fae0901a5 None None] thread info: [<_MainThread(MainThread, started 129173440548992)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86111) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 29 01:22:44 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f806f9c-6699-4f80-a055-1993a5c86dfa tempest-TestServerVolumeAttachmentScenario-1287155210 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:22:44 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6f806f9c-6699-4f80-a055-1993a5c86dfa tempest-TestServerVolumeAttachmentScenario-1287155210 None] Flow 'volume_create_manager' (9a8b6332-5085-4bdc-9bfd-8a85ec552d83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:22:45 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6f806f9c-6699-4f80-a055-1993a5c86dfa tempest-TestServerVolumeAttachmentScenario-1287155210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c30c534-7c8e-443c-a17a-be327647d10b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:22:45 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6f806f9c-6699-4f80-a055-1993a5c86dfa tempest-TestServerVolumeAttachmentScenario-1287155210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c30c534-7c8e-443c-a17a-be327647d10b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:22:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1659977407',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=494081d0-dc9d-41a5-805f-77a09960fe59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a512f118f024df1a7fe893b1e4061c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:22:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:22:45Z,use_quota=True,user_id='63b38ee499234596adfe3290c6f808b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:22:45 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6f806f9c-6699-4f80-a055-1993a5c86dfa tempest-TestServerVolumeAttachmentScenario-1287155210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98f69870-11bf-4655-bbf5-5f13ca6fba0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:22:45 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6f806f9c-6699-4f80-a055-1993a5c86dfa tempest-TestServerVolumeAttachmentScenario-1287155210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98f69870-11bf-4655-bbf5-5f13ca6fba0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:22:45 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6f806f9c-6699-4f80-a055-1993a5c86dfa tempest-TestServerVolumeAttachmentScenario-1287155210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f720496-1ba9-487a-9e20-b6581f497f56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:22:45 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6f806f9c-6699-4f80-a055-1993a5c86dfa tempest-TestServerVolumeAttachmentScenario-1287155210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f720496-1ba9-487a-9e20-b6581f497f56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '494081d0-dc9d-41a5-805f-77a09960fe59', 'volume_name': 'volume-494081d0-dc9d-41a5-805f-77a09960fe59', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:22:45 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6f806f9c-6699-4f80-a055-1993a5c86dfa tempest-TestServerVolumeAttachmentScenario-1287155210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c440dde-6393-4d85-9f01-d2736fbfe081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:22:45 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6f806f9c-6699-4f80-a055-1993a5c86dfa tempest-TestServerVolumeAttachmentScenario-1287155210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c440dde-6393-4d85-9f01-d2736fbfe081) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:22:45 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6f806f9c-6699-4f80-a055-1993a5c86dfa tempest-TestServerVolumeAttachmentScenario-1287155210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dbe52fd-e9b0-47d2-b07c-29860acb2839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:22:45 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-6f806f9c-6699-4f80-a055-1993a5c86dfa tempest-TestServerVolumeAttachmentScenario-1287155210 None] Volume 494081d0-dc9d-41a5-805f-77a09960fe59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-494081d0-dc9d-41a5-805f-77a09960fe59', 'volume_size': 1} Aug 29 01:22:45 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-6f806f9c-6699-4f80-a055-1993a5c86dfa tempest-TestServerVolumeAttachmentScenario-1287155210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:22:45 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-52142f04-8687-461d-8d5c-81d40a974dc6 tempest-TestServerVolumeAttachmentScenario-1287155210 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:22:45 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-52142f04-8687-461d-8d5c-81d40a974dc6 tempest-TestServerVolumeAttachmentScenario-1287155210 None] Flow 'volume_create_manager' (14c76810-d458-40fd-ae8f-d69eef4e852b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:22:45 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-52142f04-8687-461d-8d5c-81d40a974dc6 tempest-TestServerVolumeAttachmentScenario-1287155210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11a9d6e9-2821-4d06-8a45-9e43cbf241ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:22:45 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-52142f04-8687-461d-8d5c-81d40a974dc6 tempest-TestServerVolumeAttachmentScenario-1287155210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11a9d6e9-2821-4d06-8a45-9e43cbf241ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:22:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1551213018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad972605-1a2f-492a-85cf-b624da47d1e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a512f118f024df1a7fe893b1e4061c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:22:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:22:45Z,use_quota=True,user_id='63b38ee499234596adfe3290c6f808b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:22:45 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-52142f04-8687-461d-8d5c-81d40a974dc6 tempest-TestServerVolumeAttachmentScenario-1287155210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cd0b765-286c-4c26-bd9e-271bf1ed84ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:22:45 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-52142f04-8687-461d-8d5c-81d40a974dc6 tempest-TestServerVolumeAttachmentScenario-1287155210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cd0b765-286c-4c26-bd9e-271bf1ed84ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:22:45 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-52142f04-8687-461d-8d5c-81d40a974dc6 tempest-TestServerVolumeAttachmentScenario-1287155210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e655c5e9-908c-449f-a05c-8bd625803085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:22:45 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-52142f04-8687-461d-8d5c-81d40a974dc6 tempest-TestServerVolumeAttachmentScenario-1287155210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e655c5e9-908c-449f-a05c-8bd625803085) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad972605-1a2f-492a-85cf-b624da47d1e8', 'volume_name': 'volume-ad972605-1a2f-492a-85cf-b624da47d1e8', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:22:45 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-52142f04-8687-461d-8d5c-81d40a974dc6 tempest-TestServerVolumeAttachmentScenario-1287155210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e2fa0ed-fb7a-4476-8892-7eabacb5783e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:22:45 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-52142f04-8687-461d-8d5c-81d40a974dc6 tempest-TestServerVolumeAttachmentScenario-1287155210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e2fa0ed-fb7a-4476-8892-7eabacb5783e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:22:45 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-52142f04-8687-461d-8d5c-81d40a974dc6 tempest-TestServerVolumeAttachmentScenario-1287155210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b234332-e676-450d-a092-e0077b506976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:22:45 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-52142f04-8687-461d-8d5c-81d40a974dc6 tempest-TestServerVolumeAttachmentScenario-1287155210 None] Volume ad972605-1a2f-492a-85cf-b624da47d1e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad972605-1a2f-492a-85cf-b624da47d1e8', 'volume_size': 1} Aug 29 01:22:45 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-52142f04-8687-461d-8d5c-81d40a974dc6 tempest-TestServerVolumeAttachmentScenario-1287155210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:22:45 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-c31fb426-06ad-4101-8cd4-b55497bed4af tempest-TestImageHashVerification-2107162483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 30.408s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:22:45 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-c31fb426-06ad-4101-8cd4-b55497bed4af tempest-TestImageHashVerification-2107162483 None] Uploaded volume to glance image-id: 99e3512e-19a9-4a42-a11f-58f0ba5f4ad5. {{(pid=86111) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Aug 29 01:22:45 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-ce76f1dd-fa8d-4d7f-8675-ecb901620f53 tempest-VolumesGetTest-954660907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 21.980s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:22:45 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-ce76f1dd-fa8d-4d7f-8675-ecb901620f53 tempest-VolumesGetTest-954660907 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:22:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1729588819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=718c2594-e743-400b-a196-187fbafce2ea,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='5c4c32927df54b70ae25b85da6abe7ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:22:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:22:24Z,use_quota=True,user_id='6d651c7f6792483d90119c301b2dd999',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:22:45 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-ce76f1dd-fa8d-4d7f-8675-ecb901620f53 tempest-VolumesGetTest-954660907 None] Creating volume 718c2594-e743-400b-a196-187fbafce2ea {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:22:45 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-ce76f1dd-fa8d-4d7f-8675-ecb901620f53 tempest-VolumesGetTest-954660907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:22:45 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-ce76f1dd-fa8d-4d7f-8675-ecb901620f53 tempest-VolumesGetTest-954660907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:22:45 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-ce76f1dd-fa8d-4d7f-8675-ecb901620f53 tempest-VolumesGetTest-954660907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:22:45 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-ce76f1dd-fa8d-4d7f-8675-ecb901620f53 tempest-VolumesGetTest-954660907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:22:45 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-ce76f1dd-fa8d-4d7f-8675-ecb901620f53 tempest-VolumesGetTest-954660907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:22:45 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-ce76f1dd-fa8d-4d7f-8675-ecb901620f53 tempest-VolumesGetTest-954660907 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:22:45 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-ce76f1dd-fa8d-4d7f-8675-ecb901620f53 tempest-VolumesGetTest-954660907 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:22:45 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-ce76f1dd-fa8d-4d7f-8675-ecb901620f53 tempest-VolumesGetTest-954660907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-718c2594-e743-400b-a196-187fbafce2ea 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:22:45 devstack sudo[99864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-718c2594-e743-400b-a196-187fbafce2ea 1073741824 Aug 29 01:22:45 devstack sudo[99864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:22:45 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-c31fb426-06ad-4101-8cd4-b55497bed4af tempest-TestImageHashVerification-2107162483 None] Copy volume to image completed successfully. Aug 29 01:22:46 devstack sudo[99864]: pam_unix(sudo:session): session closed for user root Aug 29 01:22:46 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-ce76f1dd-fa8d-4d7f-8675-ecb901620f53 tempest-VolumesGetTest-954660907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-718c2594-e743-400b-a196-187fbafce2ea 1073741824" returned: 0 in 0.493s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:22:46 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-ce76f1dd-fa8d-4d7f-8675-ecb901620f53 tempest-VolumesGetTest-954660907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-718c2594-e743-400b-a196-187fbafce2ea {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:22:46 devstack sudo[99870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-718c2594-e743-400b-a196-187fbafce2ea Aug 29 01:22:46 devstack sudo[99870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:22:46 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-57f4edce-76a5-43de-a03e-db6c7da3fba5 tempest-TestImageHashVerification-2107162483 None] Acquiring lock "cinder-c3b79e2d-0d63-43b5-b0d7-f1d4ad477399-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:22:46 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-57f4edce-76a5-43de-a03e-db6c7da3fba5 tempest-TestImageHashVerification-2107162483 None] Lock "cinder-c3b79e2d-0d63-43b5-b0d7-f1d4ad477399-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:22:46 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-57f4edce-76a5-43de-a03e-db6c7da3fba5 tempest-TestImageHashVerification-2107162483 None] Acquiring lock "cinder-quobyte-c3b79e2d-0d63-43b5-b0d7-f1d4ad477399" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:22:46 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-57f4edce-76a5-43de-a03e-db6c7da3fba5 tempest-TestImageHashVerification-2107162483 None] Lock "cinder-quobyte-c3b79e2d-0d63-43b5-b0d7-f1d4ad477399" acquired by "delete_volume" :: waited 0.019s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:22:46 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ff1cc08-456e-45b2-ae5d-0fd206b381ba]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:22:46 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-57f4edce-76a5-43de-a03e-db6c7da3fba5 tempest-TestImageHashVerification-2107162483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-c3b79e2d-0d63-43b5-b0d7-f1d4ad477399 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:22:46 devstack sudo[99870]: pam_unix(sudo:session): session closed for user root Aug 29 01:22:46 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-ce76f1dd-fa8d-4d7f-8675-ecb901620f53 tempest-VolumesGetTest-954660907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-718c2594-e743-400b-a196-187fbafce2ea" returned: 0 in 0.318s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:22:46 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-ce76f1dd-fa8d-4d7f-8675-ecb901620f53 tempest-VolumesGetTest-954660907 None] <== create_volume: return (850ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:22:46 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-ce76f1dd-fa8d-4d7f-8675-ecb901620f53 tempest-VolumesGetTest-954660907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.854s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:22:46 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-1836a5d3-119c-4e94-b5a1-c6195a7a0652 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 19.854s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:22:46 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-1836a5d3-119c-4e94-b5a1-c6195a7a0652 tempest-CreateVolumesFromSnapshotTest-1872904588 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:22:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1949600099',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ece0894-d177-4a56-8078-bd9352672608,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='919ac2ce6d46489f905916ca474cc495',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:22:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:22:26Z,use_quota=True,user_id='29232661a428474d9d225623aeddbf3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:22:46 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-1836a5d3-119c-4e94-b5a1-c6195a7a0652 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Creating volume 3ece0894-d177-4a56-8078-bd9352672608 {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:22:46 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-1836a5d3-119c-4e94-b5a1-c6195a7a0652 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:22:46 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-1836a5d3-119c-4e94-b5a1-c6195a7a0652 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:22:46 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-1836a5d3-119c-4e94-b5a1-c6195a7a0652 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:22:46 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-1836a5d3-119c-4e94-b5a1-c6195a7a0652 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:22:46 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-1836a5d3-119c-4e94-b5a1-c6195a7a0652 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:22:46 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-1836a5d3-119c-4e94-b5a1-c6195a7a0652 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:22:46 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-1836a5d3-119c-4e94-b5a1-c6195a7a0652 tempest-CreateVolumesFromSnapshotTest-1872904588 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:22:46 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-1836a5d3-119c-4e94-b5a1-c6195a7a0652 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3ece0894-d177-4a56-8078-bd9352672608 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:22:46 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-ce76f1dd-fa8d-4d7f-8675-ecb901620f53 tempest-VolumesGetTest-954660907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65fa17e6-d235-476e-b778-341a79adf494) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-718c2594-e743-400b-a196-187fbafce2ea', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:22:46 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-ce76f1dd-fa8d-4d7f-8675-ecb901620f53 tempest-VolumesGetTest-954660907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b767308-fe1e-42ec-862f-3ca1caaf7441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:22:46 devstack sudo[99874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3ece0894-d177-4a56-8078-bd9352672608 1073741824 Aug 29 01:22:46 devstack sudo[99874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:22:46 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-ce76f1dd-fa8d-4d7f-8675-ecb901620f53 tempest-VolumesGetTest-954660907 None] Volume volume-718c2594-e743-400b-a196-187fbafce2ea (718c2594-e743-400b-a196-187fbafce2ea): created successfully Aug 29 01:22:46 devstack sudo[99873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-c3b79e2d-0d63-43b5-b0d7-f1d4ad477399 Aug 29 01:22:46 devstack sudo[99873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:22:46 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-ce76f1dd-fa8d-4d7f-8675-ecb901620f53 tempest-VolumesGetTest-954660907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b767308-fe1e-42ec-862f-3ca1caaf7441) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:22:46 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-ce76f1dd-fa8d-4d7f-8675-ecb901620f53 tempest-VolumesGetTest-954660907 None] Flow 'volume_create_manager' (8d11d7bf-4d6a-48cd-b1c7-76abbecd8fbc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:22:46 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-ce76f1dd-fa8d-4d7f-8675-ecb901620f53 tempest-VolumesGetTest-954660907 None] Created volume successfully. Aug 29 01:22:46 devstack sudo[99873]: pam_unix(sudo:session): session closed for user root Aug 29 01:22:46 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-57f4edce-76a5-43de-a03e-db6c7da3fba5 tempest-TestImageHashVerification-2107162483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-c3b79e2d-0d63-43b5-b0d7-f1d4ad477399" returned: 0 in 0.384s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:22:46 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-57f4edce-76a5-43de-a03e-db6c7da3fba5 tempest-TestImageHashVerification-2107162483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-c3b79e2d-0d63-43b5-b0d7-f1d4ad477399 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:22:46 devstack sudo[99884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-c3b79e2d-0d63-43b5-b0d7-f1d4ad477399 Aug 29 01:22:46 devstack sudo[99884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:22:47 devstack sudo[99874]: pam_unix(sudo:session): session closed for user root Aug 29 01:22:47 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-1836a5d3-119c-4e94-b5a1-c6195a7a0652 tempest-CreateVolumesFromSnapshotTest-1872904588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3ece0894-d177-4a56-8078-bd9352672608 1073741824" returned: 0 in 0.536s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:22:47 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-1836a5d3-119c-4e94-b5a1-c6195a7a0652 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3ece0894-d177-4a56-8078-bd9352672608 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:22:47 devstack sudo[99884]: pam_unix(sudo:session): session closed for user root Aug 29 01:22:47 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-57f4edce-76a5-43de-a03e-db6c7da3fba5 tempest-TestImageHashVerification-2107162483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-c3b79e2d-0d63-43b5-b0d7-f1d4ad477399" returned: 0 in 0.269s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:22:47 devstack sudo[99888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3ece0894-d177-4a56-8078-bd9352672608 Aug 29 01:22:47 devstack sudo[99888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:22:47 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-57f4edce-76a5-43de-a03e-db6c7da3fba5 tempest-TestImageHashVerification-2107162483 None] Lock "cinder-quobyte-c3b79e2d-0d63-43b5-b0d7-f1d4ad477399" released by "delete_volume" :: held 0.699s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:22:47 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-57f4edce-76a5-43de-a03e-db6c7da3fba5 tempest-TestImageHashVerification-2107162483 None] Created reservations ['b1e9290b-9e2b-42fc-b07b-9d8900e95ff1', '1405440d-ee42-4d33-9419-7e51265866b6', '8e03e376-beba-4247-9280-f1083a1b1248', '250583fe-0806-4e20-9c6a-385cff9d02f9'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:22:47 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-57f4edce-76a5-43de-a03e-db6c7da3fba5 tempest-TestImageHashVerification-2107162483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:22:47 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-57f4edce-76a5-43de-a03e-db6c7da3fba5 tempest-TestImageHashVerification-2107162483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:22:47 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-57f4edce-76a5-43de-a03e-db6c7da3fba5 tempest-TestImageHashVerification-2107162483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:22:47 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-57f4edce-76a5-43de-a03e-db6c7da3fba5 tempest-TestImageHashVerification-2107162483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:22:47 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-57f4edce-76a5-43de-a03e-db6c7da3fba5 tempest-TestImageHashVerification-2107162483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:22:47 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-57f4edce-76a5-43de-a03e-db6c7da3fba5 tempest-TestImageHashVerification-2107162483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:22:47 devstack sudo[99890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:22:47 devstack sudo[99890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:22:47 devstack sudo[99888]: pam_unix(sudo:session): session closed for user root Aug 29 01:22:47 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-1836a5d3-119c-4e94-b5a1-c6195a7a0652 tempest-CreateVolumesFromSnapshotTest-1872904588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3ece0894-d177-4a56-8078-bd9352672608" returned: 0 in 0.378s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:22:47 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-1836a5d3-119c-4e94-b5a1-c6195a7a0652 tempest-CreateVolumesFromSnapshotTest-1872904588 None] <== create_volume: return (968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:22:47 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-1836a5d3-119c-4e94-b5a1-c6195a7a0652 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.977s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:22:47 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-6f806f9c-6699-4f80-a055-1993a5c86dfa tempest-TestServerVolumeAttachmentScenario-1287155210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.447s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:22:47 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-6f806f9c-6699-4f80-a055-1993a5c86dfa tempest-TestServerVolumeAttachmentScenario-1287155210 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:22:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1659977407',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=494081d0-dc9d-41a5-805f-77a09960fe59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a512f118f024df1a7fe893b1e4061c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:22:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:22:45Z,use_quota=True,user_id='63b38ee499234596adfe3290c6f808b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:22:47 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-6f806f9c-6699-4f80-a055-1993a5c86dfa tempest-TestServerVolumeAttachmentScenario-1287155210 None] Creating volume 494081d0-dc9d-41a5-805f-77a09960fe59 {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:22:47 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-6f806f9c-6699-4f80-a055-1993a5c86dfa tempest-TestServerVolumeAttachmentScenario-1287155210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:22:47 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-6f806f9c-6699-4f80-a055-1993a5c86dfa tempest-TestServerVolumeAttachmentScenario-1287155210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:22:47 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-6f806f9c-6699-4f80-a055-1993a5c86dfa tempest-TestServerVolumeAttachmentScenario-1287155210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:22:47 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-6f806f9c-6699-4f80-a055-1993a5c86dfa tempest-TestServerVolumeAttachmentScenario-1287155210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:22:47 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-6f806f9c-6699-4f80-a055-1993a5c86dfa tempest-TestServerVolumeAttachmentScenario-1287155210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:22:47 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-6f806f9c-6699-4f80-a055-1993a5c86dfa tempest-TestServerVolumeAttachmentScenario-1287155210 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:22:47 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-6f806f9c-6699-4f80-a055-1993a5c86dfa tempest-TestServerVolumeAttachmentScenario-1287155210 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:22:47 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-6f806f9c-6699-4f80-a055-1993a5c86dfa tempest-TestServerVolumeAttachmentScenario-1287155210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-494081d0-dc9d-41a5-805f-77a09960fe59 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:22:47 devstack sudo[99893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-494081d0-dc9d-41a5-805f-77a09960fe59 1073741824 Aug 29 01:22:47 devstack sudo[99893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:22:47 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-1836a5d3-119c-4e94-b5a1-c6195a7a0652 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69123b14-0e1a-4dcf-8f08-2d3df183a243) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ece0894-d177-4a56-8078-bd9352672608', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:22:47 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-1836a5d3-119c-4e94-b5a1-c6195a7a0652 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ef27db7-994f-4e38-92dd-478ef90dc673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:22:47 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-1836a5d3-119c-4e94-b5a1-c6195a7a0652 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Volume volume-3ece0894-d177-4a56-8078-bd9352672608 (3ece0894-d177-4a56-8078-bd9352672608): created successfully Aug 29 01:22:47 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-1836a5d3-119c-4e94-b5a1-c6195a7a0652 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ef27db7-994f-4e38-92dd-478ef90dc673) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:22:47 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-1836a5d3-119c-4e94-b5a1-c6195a7a0652 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Flow 'volume_create_manager' (54813688-10ea-46c7-8e14-95ad09e9e147) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:22:47 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-1836a5d3-119c-4e94-b5a1-c6195a7a0652 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Created volume successfully. Aug 29 01:22:47 devstack sudo[99890]: pam_unix(sudo:session): session closed for user root Aug 29 01:22:47 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-57f4edce-76a5-43de-a03e-db6c7da3fba5 tempest-TestImageHashVerification-2107162483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.441s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:22:47 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-57f4edce-76a5-43de-a03e-db6c7da3fba5 tempest-TestImageHashVerification-2107162483 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:22:47 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-57f4edce-76a5-43de-a03e-db6c7da3fba5 tempest-TestImageHashVerification-2107162483 None] Deleted volume successfully. Aug 29 01:22:47 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-57f4edce-76a5-43de-a03e-db6c7da3fba5 tempest-TestImageHashVerification-2107162483 None] Lock "cinder-c3b79e2d-0d63-43b5-b0d7-f1d4ad477399-delete_volume" released by "delete_volume" :: held 1.451s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:22:48 devstack sudo[99893]: pam_unix(sudo:session): session closed for user root Aug 29 01:22:48 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-6f806f9c-6699-4f80-a055-1993a5c86dfa tempest-TestServerVolumeAttachmentScenario-1287155210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-494081d0-dc9d-41a5-805f-77a09960fe59 1073741824" returned: 0 in 0.796s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:22:48 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-889578f6-71db-4fc3-b569-133ac2e3250f tempest-VolumesGetTest-954660907 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:22:48 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-889578f6-71db-4fc3-b569-133ac2e3250f tempest-VolumesGetTest-954660907 None] Flow 'volume_create_manager' (642561c8-9b02-4fae-be9a-91e1988f4f1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:22:48 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-889578f6-71db-4fc3-b569-133ac2e3250f tempest-VolumesGetTest-954660907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8831fa27-64b5-4208-ac6b-c7bad8c72491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:22:48 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-889578f6-71db-4fc3-b569-133ac2e3250f tempest-VolumesGetTest-954660907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8831fa27-64b5-4208-ac6b-c7bad8c72491) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:22:48Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1993529928',display_name='tempest-VolumesGetTest-Volume-602869464',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=842bb38e-86de-4e9d-9953-87b35c69ae9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c4c32927df54b70ae25b85da6abe7ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:22:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:22:48Z,use_quota=True,user_id='6d651c7f6792483d90119c301b2dd999',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:22:48 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-889578f6-71db-4fc3-b569-133ac2e3250f tempest-VolumesGetTest-954660907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b66fff35-5b10-4e78-b64c-b22f89fc981d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:22:48 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-889578f6-71db-4fc3-b569-133ac2e3250f tempest-VolumesGetTest-954660907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b66fff35-5b10-4e78-b64c-b22f89fc981d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:22:48 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-889578f6-71db-4fc3-b569-133ac2e3250f tempest-VolumesGetTest-954660907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b68b812-9734-4fb6-9665-e4f907f4f3a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:22:48 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-889578f6-71db-4fc3-b569-133ac2e3250f tempest-VolumesGetTest-954660907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b68b812-9734-4fb6-9665-e4f907f4f3a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '842bb38e-86de-4e9d-9953-87b35c69ae9e', 'volume_name': 'volume-842bb38e-86de-4e9d-9953-87b35c69ae9e', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:22:48 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-889578f6-71db-4fc3-b569-133ac2e3250f tempest-VolumesGetTest-954660907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bd732ff-31b0-4341-b27c-bc20dc3e43b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:22:48 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-889578f6-71db-4fc3-b569-133ac2e3250f tempest-VolumesGetTest-954660907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bd732ff-31b0-4341-b27c-bc20dc3e43b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:22:48 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-889578f6-71db-4fc3-b569-133ac2e3250f tempest-VolumesGetTest-954660907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1813d5f4-677d-454e-98c5-3fd8de61bd0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:22:48 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-889578f6-71db-4fc3-b569-133ac2e3250f tempest-VolumesGetTest-954660907 None] Volume 842bb38e-86de-4e9d-9953-87b35c69ae9e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-842bb38e-86de-4e9d-9953-87b35c69ae9e', 'volume_size': 1} Aug 29 01:22:48 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-889578f6-71db-4fc3-b569-133ac2e3250f tempest-VolumesGetTest-954660907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:22:48 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-6f806f9c-6699-4f80-a055-1993a5c86dfa tempest-TestServerVolumeAttachmentScenario-1287155210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-494081d0-dc9d-41a5-805f-77a09960fe59 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:22:48 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-c30e217f-66c1-4418-bf19-b0bad800f28f tempest-CreateVolumesFromSnapshotTest-1872904588 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:22:48 devstack sudo[99900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-494081d0-dc9d-41a5-805f-77a09960fe59 Aug 29 01:22:48 devstack sudo[99900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:22:48 devstack sudo[99900]: pam_unix(sudo:session): session closed for user root Aug 29 01:22:48 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-6f806f9c-6699-4f80-a055-1993a5c86dfa tempest-TestServerVolumeAttachmentScenario-1287155210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-494081d0-dc9d-41a5-805f-77a09960fe59" returned: 0 in 0.301s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:22:48 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-6f806f9c-6699-4f80-a055-1993a5c86dfa tempest-TestServerVolumeAttachmentScenario-1287155210 None] <== create_volume: return (1254ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:22:48 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-6f806f9c-6699-4f80-a055-1993a5c86dfa tempest-TestServerVolumeAttachmentScenario-1287155210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.260s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:22:48 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-52142f04-8687-461d-8d5c-81d40a974dc6 tempest-TestServerVolumeAttachmentScenario-1287155210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.304s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:22:48 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-52142f04-8687-461d-8d5c-81d40a974dc6 tempest-TestServerVolumeAttachmentScenario-1287155210 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:22:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1551213018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad972605-1a2f-492a-85cf-b624da47d1e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a512f118f024df1a7fe893b1e4061c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:22:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:22:45Z,use_quota=True,user_id='63b38ee499234596adfe3290c6f808b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:22:48 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-52142f04-8687-461d-8d5c-81d40a974dc6 tempest-TestServerVolumeAttachmentScenario-1287155210 None] Creating volume ad972605-1a2f-492a-85cf-b624da47d1e8 {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:22:48 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-52142f04-8687-461d-8d5c-81d40a974dc6 tempest-TestServerVolumeAttachmentScenario-1287155210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:22:48 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-52142f04-8687-461d-8d5c-81d40a974dc6 tempest-TestServerVolumeAttachmentScenario-1287155210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:22:48 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-52142f04-8687-461d-8d5c-81d40a974dc6 tempest-TestServerVolumeAttachmentScenario-1287155210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:22:48 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-52142f04-8687-461d-8d5c-81d40a974dc6 tempest-TestServerVolumeAttachmentScenario-1287155210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:22:48 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-52142f04-8687-461d-8d5c-81d40a974dc6 tempest-TestServerVolumeAttachmentScenario-1287155210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:22:48 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-52142f04-8687-461d-8d5c-81d40a974dc6 tempest-TestServerVolumeAttachmentScenario-1287155210 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:22:48 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-52142f04-8687-461d-8d5c-81d40a974dc6 tempest-TestServerVolumeAttachmentScenario-1287155210 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:22:48 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-52142f04-8687-461d-8d5c-81d40a974dc6 tempest-TestServerVolumeAttachmentScenario-1287155210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ad972605-1a2f-492a-85cf-b624da47d1e8 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:22:48 devstack sudo[99903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ad972605-1a2f-492a-85cf-b624da47d1e8 1073741824 Aug 29 01:22:48 devstack sudo[99903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:22:48 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6f806f9c-6699-4f80-a055-1993a5c86dfa tempest-TestServerVolumeAttachmentScenario-1287155210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dbe52fd-e9b0-47d2-b07c-29860acb2839) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-494081d0-dc9d-41a5-805f-77a09960fe59', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:22:48 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6f806f9c-6699-4f80-a055-1993a5c86dfa tempest-TestServerVolumeAttachmentScenario-1287155210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e15ac86-38ff-46da-83cc-5d637198376e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:22:48 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-6f806f9c-6699-4f80-a055-1993a5c86dfa tempest-TestServerVolumeAttachmentScenario-1287155210 None] Volume volume-494081d0-dc9d-41a5-805f-77a09960fe59 (494081d0-dc9d-41a5-805f-77a09960fe59): created successfully Aug 29 01:22:48 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6f806f9c-6699-4f80-a055-1993a5c86dfa tempest-TestServerVolumeAttachmentScenario-1287155210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e15ac86-38ff-46da-83cc-5d637198376e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:22:48 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6f806f9c-6699-4f80-a055-1993a5c86dfa tempest-TestServerVolumeAttachmentScenario-1287155210 None] Flow 'volume_create_manager' (9a8b6332-5085-4bdc-9bfd-8a85ec552d83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:22:48 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-6f806f9c-6699-4f80-a055-1993a5c86dfa tempest-TestServerVolumeAttachmentScenario-1287155210 None] Created volume successfully. Aug 29 01:22:49 devstack sudo[99903]: pam_unix(sudo:session): session closed for user root Aug 29 01:22:49 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-52142f04-8687-461d-8d5c-81d40a974dc6 tempest-TestServerVolumeAttachmentScenario-1287155210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ad972605-1a2f-492a-85cf-b624da47d1e8 1073741824" returned: 0 in 0.567s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:22:49 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-52142f04-8687-461d-8d5c-81d40a974dc6 tempest-TestServerVolumeAttachmentScenario-1287155210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ad972605-1a2f-492a-85cf-b624da47d1e8 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:22:49 devstack sudo[99914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ad972605-1a2f-492a-85cf-b624da47d1e8 Aug 29 01:22:49 devstack sudo[99914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:22:49 devstack sudo[99914]: pam_unix(sudo:session): session closed for user root Aug 29 01:22:49 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-52142f04-8687-461d-8d5c-81d40a974dc6 tempest-TestServerVolumeAttachmentScenario-1287155210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ad972605-1a2f-492a-85cf-b624da47d1e8" returned: 0 in 0.266s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:22:49 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-52142f04-8687-461d-8d5c-81d40a974dc6 tempest-TestServerVolumeAttachmentScenario-1287155210 None] <== create_volume: return (921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:22:49 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-52142f04-8687-461d-8d5c-81d40a974dc6 tempest-TestServerVolumeAttachmentScenario-1287155210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.925s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:22:49 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-889578f6-71db-4fc3-b569-133ac2e3250f tempest-VolumesGetTest-954660907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.261s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:22:49 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-889578f6-71db-4fc3-b569-133ac2e3250f tempest-VolumesGetTest-954660907 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:22:48Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1993529928',display_name='tempest-VolumesGetTest-Volume-602869464',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=842bb38e-86de-4e9d-9953-87b35c69ae9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c4c32927df54b70ae25b85da6abe7ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:22:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:22:48Z,use_quota=True,user_id='6d651c7f6792483d90119c301b2dd999',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:22:49 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-889578f6-71db-4fc3-b569-133ac2e3250f tempest-VolumesGetTest-954660907 None] Creating volume 842bb38e-86de-4e9d-9953-87b35c69ae9e {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:22:49 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-889578f6-71db-4fc3-b569-133ac2e3250f tempest-VolumesGetTest-954660907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:22:49 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-889578f6-71db-4fc3-b569-133ac2e3250f tempest-VolumesGetTest-954660907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:22:49 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-889578f6-71db-4fc3-b569-133ac2e3250f tempest-VolumesGetTest-954660907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:22:49 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-889578f6-71db-4fc3-b569-133ac2e3250f tempest-VolumesGetTest-954660907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:22:49 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-889578f6-71db-4fc3-b569-133ac2e3250f tempest-VolumesGetTest-954660907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:22:49 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-889578f6-71db-4fc3-b569-133ac2e3250f tempest-VolumesGetTest-954660907 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:22:49 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-889578f6-71db-4fc3-b569-133ac2e3250f tempest-VolumesGetTest-954660907 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:22:49 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-889578f6-71db-4fc3-b569-133ac2e3250f tempest-VolumesGetTest-954660907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-842bb38e-86de-4e9d-9953-87b35c69ae9e 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:22:49 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-52142f04-8687-461d-8d5c-81d40a974dc6 tempest-TestServerVolumeAttachmentScenario-1287155210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b234332-e676-450d-a092-e0077b506976) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad972605-1a2f-492a-85cf-b624da47d1e8', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:22:49 devstack sudo[99917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-842bb38e-86de-4e9d-9953-87b35c69ae9e 1073741824 Aug 29 01:22:49 devstack sudo[99917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:22:49 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-52142f04-8687-461d-8d5c-81d40a974dc6 tempest-TestServerVolumeAttachmentScenario-1287155210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a02529f-f4af-4717-be5f-807c169835ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:22:49 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-52142f04-8687-461d-8d5c-81d40a974dc6 tempest-TestServerVolumeAttachmentScenario-1287155210 None] Volume volume-ad972605-1a2f-492a-85cf-b624da47d1e8 (ad972605-1a2f-492a-85cf-b624da47d1e8): created successfully Aug 29 01:22:49 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-52142f04-8687-461d-8d5c-81d40a974dc6 tempest-TestServerVolumeAttachmentScenario-1287155210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a02529f-f4af-4717-be5f-807c169835ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:22:49 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-52142f04-8687-461d-8d5c-81d40a974dc6 tempest-TestServerVolumeAttachmentScenario-1287155210 None] Flow 'volume_create_manager' (14c76810-d458-40fd-ae8f-d69eef4e852b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:22:49 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-52142f04-8687-461d-8d5c-81d40a974dc6 tempest-TestServerVolumeAttachmentScenario-1287155210 None] Created volume successfully. Aug 29 01:22:50 devstack sudo[99917]: pam_unix(sudo:session): session closed for user root Aug 29 01:22:50 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-889578f6-71db-4fc3-b569-133ac2e3250f tempest-VolumesGetTest-954660907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-842bb38e-86de-4e9d-9953-87b35c69ae9e 1073741824" returned: 0 in 0.542s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:22:50 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-889578f6-71db-4fc3-b569-133ac2e3250f tempest-VolumesGetTest-954660907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-842bb38e-86de-4e9d-9953-87b35c69ae9e {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:22:50 devstack sudo[99923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-842bb38e-86de-4e9d-9953-87b35c69ae9e Aug 29 01:22:50 devstack sudo[99923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:22:50 devstack sudo[99923]: pam_unix(sudo:session): session closed for user root Aug 29 01:22:50 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-889578f6-71db-4fc3-b569-133ac2e3250f tempest-VolumesGetTest-954660907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-842bb38e-86de-4e9d-9953-87b35c69ae9e" returned: 0 in 0.405s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:22:50 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-889578f6-71db-4fc3-b569-133ac2e3250f tempest-VolumesGetTest-954660907 None] <== create_volume: return (1028ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:22:50 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-889578f6-71db-4fc3-b569-133ac2e3250f tempest-VolumesGetTest-954660907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.041s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:22:50 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-c30e217f-66c1-4418-bf19-b0bad800f28f tempest-CreateVolumesFromSnapshotTest-1872904588 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.270s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:22:50 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-c30e217f-66c1-4418-bf19-b0bad800f28f tempest-CreateVolumesFromSnapshotTest-1872904588 None] Creating offline snapshot 2d46897a-786e-42e8-9264-4132ab40dc56 of volume 3ece0894-d177-4a56-8078-bd9352672608 {{(pid=86111) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 29 01:22:50 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-889578f6-71db-4fc3-b569-133ac2e3250f tempest-VolumesGetTest-954660907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1813d5f4-677d-454e-98c5-3fd8de61bd0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-842bb38e-86de-4e9d-9953-87b35c69ae9e', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:22:50 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-889578f6-71db-4fc3-b569-133ac2e3250f tempest-VolumesGetTest-954660907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78e92f49-5762-4b50-804f-20d686540977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:22:50 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[24d3f25f-fa37-4a51-a834-934715b2c397]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:22:50 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c30e217f-66c1-4418-bf19-b0bad800f28f tempest-CreateVolumesFromSnapshotTest-1872904588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3ece0894-d177-4a56-8078-bd9352672608 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:22:50 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-889578f6-71db-4fc3-b569-133ac2e3250f tempest-VolumesGetTest-954660907 None] Volume volume-842bb38e-86de-4e9d-9953-87b35c69ae9e (842bb38e-86de-4e9d-9953-87b35c69ae9e): created successfully Aug 29 01:22:50 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-889578f6-71db-4fc3-b569-133ac2e3250f tempest-VolumesGetTest-954660907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78e92f49-5762-4b50-804f-20d686540977) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:22:50 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-889578f6-71db-4fc3-b569-133ac2e3250f tempest-VolumesGetTest-954660907 None] Flow 'volume_create_manager' (642561c8-9b02-4fae-be9a-91e1988f4f1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:22:50 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-889578f6-71db-4fc3-b569-133ac2e3250f tempest-VolumesGetTest-954660907 None] Created volume successfully. Aug 29 01:22:51 devstack sudo[99929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3ece0894-d177-4a56-8078-bd9352672608 Aug 29 01:22:51 devstack sudo[99929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:22:51 devstack sudo[99929]: pam_unix(sudo:session): session closed for user root Aug 29 01:22:51 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c30e217f-66c1-4418-bf19-b0bad800f28f tempest-CreateVolumesFromSnapshotTest-1872904588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3ece0894-d177-4a56-8078-bd9352672608" returned: 0 in 0.498s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:22:51 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c30e217f-66c1-4418-bf19-b0bad800f28f tempest-CreateVolumesFromSnapshotTest-1872904588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3ece0894-d177-4a56-8078-bd9352672608,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3ece0894-d177-4a56-8078-bd9352672608.2d46897a-786e-42e8-9264-4132ab40dc56 1G {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:22:51 devstack sudo[99945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3ece0894-d177-4a56-8078-bd9352672608,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3ece0894-d177-4a56-8078-bd9352672608.2d46897a-786e-42e8-9264-4132ab40dc56 1G Aug 29 01:22:51 devstack sudo[99945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:22:51 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-543c789a-619e-4bf7-8716-39c8c68eaad9 tempest-VolumesGetTest-954660907 None] Acquiring lock "cinder-842bb38e-86de-4e9d-9953-87b35c69ae9e-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:22:51 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-543c789a-619e-4bf7-8716-39c8c68eaad9 tempest-VolumesGetTest-954660907 None] Lock "cinder-842bb38e-86de-4e9d-9953-87b35c69ae9e-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:22:51 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-543c789a-619e-4bf7-8716-39c8c68eaad9 tempest-VolumesGetTest-954660907 None] Acquiring lock "cinder-quobyte-842bb38e-86de-4e9d-9953-87b35c69ae9e" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:22:51 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-543c789a-619e-4bf7-8716-39c8c68eaad9 tempest-VolumesGetTest-954660907 None] Lock "cinder-quobyte-842bb38e-86de-4e9d-9953-87b35c69ae9e" acquired by "delete_volume" :: waited 0.027s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:22:51 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7b7c6df-8b47-4890-a4d5-93d2b6b51a66]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:22:51 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-543c789a-619e-4bf7-8716-39c8c68eaad9 tempest-VolumesGetTest-954660907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-842bb38e-86de-4e9d-9953-87b35c69ae9e {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:22:52 devstack sudo[99945]: pam_unix(sudo:session): session closed for user root Aug 29 01:22:52 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c30e217f-66c1-4418-bf19-b0bad800f28f tempest-CreateVolumesFromSnapshotTest-1872904588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3ece0894-d177-4a56-8078-bd9352672608,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3ece0894-d177-4a56-8078-bd9352672608.2d46897a-786e-42e8-9264-4132ab40dc56 1G" returned: 0 in 0.717s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:22:52 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c30e217f-66c1-4418-bf19-b0bad800f28f tempest-CreateVolumesFromSnapshotTest-1872904588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ece0894-d177-4a56-8078-bd9352672608 -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3ece0894-d177-4a56-8078-bd9352672608.2d46897a-786e-42e8-9264-4132ab40dc56 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:22:52 devstack sudo[99954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-842bb38e-86de-4e9d-9953-87b35c69ae9e Aug 29 01:22:52 devstack sudo[99954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:22:52 devstack sudo[99955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ece0894-d177-4a56-8078-bd9352672608 -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3ece0894-d177-4a56-8078-bd9352672608.2d46897a-786e-42e8-9264-4132ab40dc56 Aug 29 01:22:52 devstack sudo[99955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:22:52 devstack sudo[99954]: pam_unix(sudo:session): session closed for user root Aug 29 01:22:52 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-543c789a-619e-4bf7-8716-39c8c68eaad9 tempest-VolumesGetTest-954660907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-842bb38e-86de-4e9d-9953-87b35c69ae9e" returned: 0 in 0.533s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:22:52 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-543c789a-619e-4bf7-8716-39c8c68eaad9 tempest-VolumesGetTest-954660907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-842bb38e-86de-4e9d-9953-87b35c69ae9e {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:22:52 devstack sudo[99955]: pam_unix(sudo:session): session closed for user root Aug 29 01:22:52 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c30e217f-66c1-4418-bf19-b0bad800f28f tempest-CreateVolumesFromSnapshotTest-1872904588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ece0894-d177-4a56-8078-bd9352672608 -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3ece0894-d177-4a56-8078-bd9352672608.2d46897a-786e-42e8-9264-4132ab40dc56" returned: 0 in 0.381s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:22:52 devstack cinder-volume[86111]: WARNING cinder.volume.drivers.remotefs [None req-c30e217f-66c1-4418-bf19-b0bad800f28f tempest-CreateVolumesFromSnapshotTest-1872904588 None] /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3ece0894-d177-4a56-8078-bd9352672608.2d46897a-786e-42e8-9264-4132ab40dc56 is being set with open permissions: ugo+rw Aug 29 01:22:52 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c30e217f-66c1-4418-bf19-b0bad800f28f tempest-CreateVolumesFromSnapshotTest-1872904588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3ece0894-d177-4a56-8078-bd9352672608.2d46897a-786e-42e8-9264-4132ab40dc56 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:22:52 devstack sudo[99966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-842bb38e-86de-4e9d-9953-87b35c69ae9e Aug 29 01:22:52 devstack sudo[99966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:22:52 devstack sudo[99967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3ece0894-d177-4a56-8078-bd9352672608.2d46897a-786e-42e8-9264-4132ab40dc56 Aug 29 01:22:52 devstack sudo[99967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:22:52 devstack sudo[99966]: pam_unix(sudo:session): session closed for user root Aug 29 01:22:52 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-543c789a-619e-4bf7-8716-39c8c68eaad9 tempest-VolumesGetTest-954660907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-842bb38e-86de-4e9d-9953-87b35c69ae9e" returned: 0 in 0.317s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:22:52 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-543c789a-619e-4bf7-8716-39c8c68eaad9 tempest-VolumesGetTest-954660907 None] Lock "cinder-quobyte-842bb38e-86de-4e9d-9953-87b35c69ae9e" released by "delete_volume" :: held 0.901s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:22:52 devstack sudo[99967]: pam_unix(sudo:session): session closed for user root Aug 29 01:22:52 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c30e217f-66c1-4418-bf19-b0bad800f28f tempest-CreateVolumesFromSnapshotTest-1872904588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3ece0894-d177-4a56-8078-bd9352672608.2d46897a-786e-42e8-9264-4132ab40dc56" returned: 0 in 0.324s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:22:52 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c30e217f-66c1-4418-bf19-b0bad800f28f tempest-CreateVolumesFromSnapshotTest-1872904588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3ece0894-d177-4a56-8078-bd9352672608.info {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:22:52 devstack sudo[99972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3ece0894-d177-4a56-8078-bd9352672608.info Aug 29 01:22:52 devstack sudo[99972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:22:52 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-543c789a-619e-4bf7-8716-39c8c68eaad9 tempest-VolumesGetTest-954660907 None] Created reservations ['4b11853f-884d-4561-a462-bba79b01c48e', 'e621b656-4f8a-4e07-b1bd-2f522cf0cd70', '92ab1e3c-1c0c-4b75-a13e-6930bfc810a9', '23075de3-cb95-4b2a-aaef-1c827994718b'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:22:52 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-543c789a-619e-4bf7-8716-39c8c68eaad9 tempest-VolumesGetTest-954660907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:22:52 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-543c789a-619e-4bf7-8716-39c8c68eaad9 tempest-VolumesGetTest-954660907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:22:52 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-543c789a-619e-4bf7-8716-39c8c68eaad9 tempest-VolumesGetTest-954660907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:22:52 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-543c789a-619e-4bf7-8716-39c8c68eaad9 tempest-VolumesGetTest-954660907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:22:52 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-543c789a-619e-4bf7-8716-39c8c68eaad9 tempest-VolumesGetTest-954660907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:22:52 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-543c789a-619e-4bf7-8716-39c8c68eaad9 tempest-VolumesGetTest-954660907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:22:53 devstack sudo[99974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:22:53 devstack sudo[99974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:22:53 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-6d56946f-008a-47dc-b8d4-e382b7606c38 tempest-VolumesGetTest-954660907 None] Acquiring lock "cinder-718c2594-e743-400b-a196-187fbafce2ea-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:22:53 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-6d56946f-008a-47dc-b8d4-e382b7606c38 tempest-VolumesGetTest-954660907 None] Lock "cinder-718c2594-e743-400b-a196-187fbafce2ea-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:22:53 devstack sudo[99972]: pam_unix(sudo:session): session closed for user root Aug 29 01:22:53 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c30e217f-66c1-4418-bf19-b0bad800f28f tempest-CreateVolumesFromSnapshotTest-1872904588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3ece0894-d177-4a56-8078-bd9352672608.info" returned: 0 in 0.471s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:22:53 devstack cinder-volume[86111]: WARNING cinder.volume.drivers.remotefs [None req-c30e217f-66c1-4418-bf19-b0bad800f28f tempest-CreateVolumesFromSnapshotTest-1872904588 None] /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3ece0894-d177-4a56-8078-bd9352672608.info is being set with open permissions: ugo+rw Aug 29 01:22:53 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c30e217f-66c1-4418-bf19-b0bad800f28f tempest-CreateVolumesFromSnapshotTest-1872904588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3ece0894-d177-4a56-8078-bd9352672608.info {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:22:53 devstack sudo[99978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3ece0894-d177-4a56-8078-bd9352672608.info Aug 29 01:22:53 devstack sudo[99978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:22:53 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-6d56946f-008a-47dc-b8d4-e382b7606c38 tempest-VolumesGetTest-954660907 None] Acquiring lock "cinder-quobyte-718c2594-e743-400b-a196-187fbafce2ea" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:22:53 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-6d56946f-008a-47dc-b8d4-e382b7606c38 tempest-VolumesGetTest-954660907 None] Lock "cinder-quobyte-718c2594-e743-400b-a196-187fbafce2ea" acquired by "delete_volume" :: waited 0.025s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:22:53 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[91f875c6-5e43-45e2-bf45-ccd94a502bb7]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:22:53 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-6d56946f-008a-47dc-b8d4-e382b7606c38 tempest-VolumesGetTest-954660907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-718c2594-e743-400b-a196-187fbafce2ea {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:22:53 devstack sudo[99974]: pam_unix(sudo:session): session closed for user root Aug 29 01:22:53 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-543c789a-619e-4bf7-8716-39c8c68eaad9 tempest-VolumesGetTest-954660907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.485s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:22:53 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-543c789a-619e-4bf7-8716-39c8c68eaad9 tempest-VolumesGetTest-954660907 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:22:53 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-543c789a-619e-4bf7-8716-39c8c68eaad9 tempest-VolumesGetTest-954660907 None] Deleted volume successfully. Aug 29 01:22:53 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-543c789a-619e-4bf7-8716-39c8c68eaad9 tempest-VolumesGetTest-954660907 None] Lock "cinder-842bb38e-86de-4e9d-9953-87b35c69ae9e-delete_volume" released by "delete_volume" :: held 1.722s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:22:53 devstack sudo[99978]: pam_unix(sudo:session): session closed for user root Aug 29 01:22:53 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c30e217f-66c1-4418-bf19-b0bad800f28f tempest-CreateVolumesFromSnapshotTest-1872904588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3ece0894-d177-4a56-8078-bd9352672608.info" returned: 0 in 0.345s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:22:53 devstack sudo[99981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-718c2594-e743-400b-a196-187fbafce2ea Aug 29 01:22:53 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-c30e217f-66c1-4418-bf19-b0bad800f28f tempest-CreateVolumesFromSnapshotTest-1872904588 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.904s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:22:53 devstack sudo[99981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:22:53 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-c30e217f-66c1-4418-bf19-b0bad800f28f tempest-CreateVolumesFromSnapshotTest-1872904588 None] Create snapshot completed successfully Aug 29 01:22:53 devstack sudo[99981]: pam_unix(sudo:session): session closed for user root Aug 29 01:22:53 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-6d56946f-008a-47dc-b8d4-e382b7606c38 tempest-VolumesGetTest-954660907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-718c2594-e743-400b-a196-187fbafce2ea" returned: 0 in 0.518s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:22:53 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-6d56946f-008a-47dc-b8d4-e382b7606c38 tempest-VolumesGetTest-954660907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-718c2594-e743-400b-a196-187fbafce2ea {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:22:54 devstack sudo[99989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-718c2594-e743-400b-a196-187fbafce2ea Aug 29 01:22:54 devstack sudo[99989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:22:54 devstack sudo[99989]: pam_unix(sudo:session): session closed for user root Aug 29 01:22:54 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-6d56946f-008a-47dc-b8d4-e382b7606c38 tempest-VolumesGetTest-954660907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-718c2594-e743-400b-a196-187fbafce2ea" returned: 0 in 0.277s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:22:54 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-6d56946f-008a-47dc-b8d4-e382b7606c38 tempest-VolumesGetTest-954660907 None] Lock "cinder-quobyte-718c2594-e743-400b-a196-187fbafce2ea" released by "delete_volume" :: held 0.870s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:22:54 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-6d56946f-008a-47dc-b8d4-e382b7606c38 tempest-VolumesGetTest-954660907 None] Created reservations ['cd8f2fc9-2261-4f43-90ce-0402576c8d12', '04713e85-e65d-457a-9a55-e8841cfb4eb6', '3f6ce87b-2d9c-4300-b1ab-46918a7553ad', 'f361074f-4ab4-45ab-98fe-982a5b57d819'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:22:54 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-6d56946f-008a-47dc-b8d4-e382b7606c38 tempest-VolumesGetTest-954660907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:22:54 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-6d56946f-008a-47dc-b8d4-e382b7606c38 tempest-VolumesGetTest-954660907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:22:54 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-6d56946f-008a-47dc-b8d4-e382b7606c38 tempest-VolumesGetTest-954660907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:22:54 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-6d56946f-008a-47dc-b8d4-e382b7606c38 tempest-VolumesGetTest-954660907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:22:54 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-6d56946f-008a-47dc-b8d4-e382b7606c38 tempest-VolumesGetTest-954660907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:22:54 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-6d56946f-008a-47dc-b8d4-e382b7606c38 tempest-VolumesGetTest-954660907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:22:54 devstack sudo[100016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:22:54 devstack sudo[100016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:22:55 devstack sudo[100016]: pam_unix(sudo:session): session closed for user root Aug 29 01:22:55 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-6d56946f-008a-47dc-b8d4-e382b7606c38 tempest-VolumesGetTest-954660907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.565s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:22:55 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-6d56946f-008a-47dc-b8d4-e382b7606c38 tempest-VolumesGetTest-954660907 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:22:55 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-6d56946f-008a-47dc-b8d4-e382b7606c38 tempest-VolumesGetTest-954660907 None] Deleted volume successfully. Aug 29 01:22:55 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-6d56946f-008a-47dc-b8d4-e382b7606c38 tempest-VolumesGetTest-954660907 None] Lock "cinder-718c2594-e743-400b-a196-187fbafce2ea-delete_volume" released by "delete_volume" :: held 2.025s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:22:55 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-aea8538a-392b-431e-b185-468cdc7cb002 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:22:55 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-aea8538a-392b-431e-b185-468cdc7cb002 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Flow 'volume_create_manager' (989be636-7ab6-49f9-9c2a-47bf8670d0ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:22:55 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-aea8538a-392b-431e-b185-468cdc7cb002 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e97aac25-13a5-430c-91d6-dbc7cefca989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:22:55 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-aea8538a-392b-431e-b185-468cdc7cb002 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e97aac25-13a5-430c-91d6-dbc7cefca989) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:22:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1278886365',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d74658c-ab26-4d21-9b51-6603bf309fa6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='919ac2ce6d46489f905916ca474cc495',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:22:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:22:56Z,use_quota=True,user_id='29232661a428474d9d225623aeddbf3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:22:55 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-aea8538a-392b-431e-b185-468cdc7cb002 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea40d85f-a7b8-4cf8-9c42-fa111a0ec42e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:22:55 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-aea8538a-392b-431e-b185-468cdc7cb002 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea40d85f-a7b8-4cf8-9c42-fa111a0ec42e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:22:55 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-aea8538a-392b-431e-b185-468cdc7cb002 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92069acd-1e24-454c-bc37-c6bc4607849f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:22:55 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-aea8538a-392b-431e-b185-468cdc7cb002 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92069acd-1e24-454c-bc37-c6bc4607849f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d74658c-ab26-4d21-9b51-6603bf309fa6', 'volume_name': 'volume-2d74658c-ab26-4d21-9b51-6603bf309fa6', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:22:55 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-aea8538a-392b-431e-b185-468cdc7cb002 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53423c67-edd8-480b-bdeb-dcebcd323f48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:22:55 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-aea8538a-392b-431e-b185-468cdc7cb002 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53423c67-edd8-480b-bdeb-dcebcd323f48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:22:55 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-aea8538a-392b-431e-b185-468cdc7cb002 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdf1ca1c-fdde-45c5-b0ae-04a2cbcccd45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:22:55 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-aea8538a-392b-431e-b185-468cdc7cb002 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Volume 2d74658c-ab26-4d21-9b51-6603bf309fa6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d74658c-ab26-4d21-9b51-6603bf309fa6', 'volume_size': 1} Aug 29 01:22:55 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-aea8538a-392b-431e-b185-468cdc7cb002 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:22:55 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-aea8538a-392b-431e-b185-468cdc7cb002 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:22:55 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-aea8538a-392b-431e-b185-468cdc7cb002 tempest-CreateVolumesFromSnapshotTest-1872904588 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:22:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1278886365',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d74658c-ab26-4d21-9b51-6603bf309fa6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='919ac2ce6d46489f905916ca474cc495',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:22:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:22:56Z,use_quota=True,user_id='29232661a428474d9d225623aeddbf3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:22:55 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-aea8538a-392b-431e-b185-468cdc7cb002 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Creating volume 2d74658c-ab26-4d21-9b51-6603bf309fa6 {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:22:55 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-aea8538a-392b-431e-b185-468cdc7cb002 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:22:55 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-aea8538a-392b-431e-b185-468cdc7cb002 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:22:55 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-aea8538a-392b-431e-b185-468cdc7cb002 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:22:56 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-aea8538a-392b-431e-b185-468cdc7cb002 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:22:56 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-aea8538a-392b-431e-b185-468cdc7cb002 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:22:56 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-aea8538a-392b-431e-b185-468cdc7cb002 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:22:56 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-aea8538a-392b-431e-b185-468cdc7cb002 tempest-CreateVolumesFromSnapshotTest-1872904588 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:22:56 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-aea8538a-392b-431e-b185-468cdc7cb002 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-2d74658c-ab26-4d21-9b51-6603bf309fa6 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:22:56 devstack sudo[100060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-2d74658c-ab26-4d21-9b51-6603bf309fa6 1073741824 Aug 29 01:22:56 devstack sudo[100060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:22:56 devstack sudo[100060]: pam_unix(sudo:session): session closed for user root Aug 29 01:22:56 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-aea8538a-392b-431e-b185-468cdc7cb002 tempest-CreateVolumesFromSnapshotTest-1872904588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-2d74658c-ab26-4d21-9b51-6603bf309fa6 1073741824" returned: 0 in 0.920s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:22:56 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-aea8538a-392b-431e-b185-468cdc7cb002 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-2d74658c-ab26-4d21-9b51-6603bf309fa6 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:22:57 devstack sudo[100068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-2d74658c-ab26-4d21-9b51-6603bf309fa6 Aug 29 01:22:57 devstack sudo[100068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:22:57 devstack sudo[100068]: pam_unix(sudo:session): session closed for user root Aug 29 01:22:57 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-aea8538a-392b-431e-b185-468cdc7cb002 tempest-CreateVolumesFromSnapshotTest-1872904588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-2d74658c-ab26-4d21-9b51-6603bf309fa6" returned: 0 in 0.452s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:22:57 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-aea8538a-392b-431e-b185-468cdc7cb002 tempest-CreateVolumesFromSnapshotTest-1872904588 None] <== create_volume: return (1438ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:22:57 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-aea8538a-392b-431e-b185-468cdc7cb002 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.441s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:22:57 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-aea8538a-392b-431e-b185-468cdc7cb002 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdf1ca1c-fdde-45c5-b0ae-04a2cbcccd45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d74658c-ab26-4d21-9b51-6603bf309fa6', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:22:57 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-aea8538a-392b-431e-b185-468cdc7cb002 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fba47331-d1fe-4a16-a6ec-9aed0aeb0150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:22:57 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-aea8538a-392b-431e-b185-468cdc7cb002 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Volume volume-2d74658c-ab26-4d21-9b51-6603bf309fa6 (2d74658c-ab26-4d21-9b51-6603bf309fa6): created successfully Aug 29 01:22:57 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-aea8538a-392b-431e-b185-468cdc7cb002 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fba47331-d1fe-4a16-a6ec-9aed0aeb0150) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:22:57 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-aea8538a-392b-431e-b185-468cdc7cb002 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Flow 'volume_create_manager' (989be636-7ab6-49f9-9c2a-47bf8670d0ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:22:57 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-8de1472c-d693-4710-ad74-e1e8f4986d0f tempest-CreateVolumesFromSnapshotTest-1872904588 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:22:57 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-8de1472c-d693-4710-ad74-e1e8f4986d0f tempest-CreateVolumesFromSnapshotTest-1872904588 None] Flow 'volume_create_manager' (73b4d251-04c7-4687-bf3c-51a3bf00cb5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:22:57 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-8de1472c-d693-4710-ad74-e1e8f4986d0f tempest-CreateVolumesFromSnapshotTest-1872904588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d7167d0-97a1-4421-b22e-7bf3ade88687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:22:57 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-aea8538a-392b-431e-b185-468cdc7cb002 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Created volume successfully. Aug 29 01:22:57 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-8de1472c-d693-4710-ad74-e1e8f4986d0f tempest-CreateVolumesFromSnapshotTest-1872904588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d7167d0-97a1-4421-b22e-7bf3ade88687) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:22:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-444231703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=208246bf-7a99-462e-9bec-33b26b59f2c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='919ac2ce6d46489f905916ca474cc495',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:22:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:22:57Z,use_quota=True,user_id='29232661a428474d9d225623aeddbf3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:22:57 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-8de1472c-d693-4710-ad74-e1e8f4986d0f tempest-CreateVolumesFromSnapshotTest-1872904588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bb48850-8f87-4068-bc7e-275e4cea7b4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:22:57 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-8de1472c-d693-4710-ad74-e1e8f4986d0f tempest-CreateVolumesFromSnapshotTest-1872904588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bb48850-8f87-4068-bc7e-275e4cea7b4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:22:57 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-8de1472c-d693-4710-ad74-e1e8f4986d0f tempest-CreateVolumesFromSnapshotTest-1872904588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7755c998-308f-4a4d-a19c-eb1a1dac83cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:22:57 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-8de1472c-d693-4710-ad74-e1e8f4986d0f tempest-CreateVolumesFromSnapshotTest-1872904588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7755c998-308f-4a4d-a19c-eb1a1dac83cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '208246bf-7a99-462e-9bec-33b26b59f2c0', 'volume_name': 'volume-208246bf-7a99-462e-9bec-33b26b59f2c0', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:22:57 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-8de1472c-d693-4710-ad74-e1e8f4986d0f tempest-CreateVolumesFromSnapshotTest-1872904588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72aeaf51-243c-4d69-8753-681223159fdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:22:57 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-8de1472c-d693-4710-ad74-e1e8f4986d0f tempest-CreateVolumesFromSnapshotTest-1872904588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72aeaf51-243c-4d69-8753-681223159fdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:22:57 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-8de1472c-d693-4710-ad74-e1e8f4986d0f tempest-CreateVolumesFromSnapshotTest-1872904588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f0b8600-b09b-4d1a-9d50-b74104ffc446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:22:57 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-8de1472c-d693-4710-ad74-e1e8f4986d0f tempest-CreateVolumesFromSnapshotTest-1872904588 None] Volume 208246bf-7a99-462e-9bec-33b26b59f2c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-208246bf-7a99-462e-9bec-33b26b59f2c0', 'volume_size': 1} Aug 29 01:22:57 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-8de1472c-d693-4710-ad74-e1e8f4986d0f tempest-CreateVolumesFromSnapshotTest-1872904588 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:22:57 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-8de1472c-d693-4710-ad74-e1e8f4986d0f tempest-CreateVolumesFromSnapshotTest-1872904588 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:22:57 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-8de1472c-d693-4710-ad74-e1e8f4986d0f tempest-CreateVolumesFromSnapshotTest-1872904588 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:22:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-444231703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=208246bf-7a99-462e-9bec-33b26b59f2c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='919ac2ce6d46489f905916ca474cc495',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:22:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:22:57Z,use_quota=True,user_id='29232661a428474d9d225623aeddbf3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:22:57 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-8de1472c-d693-4710-ad74-e1e8f4986d0f tempest-CreateVolumesFromSnapshotTest-1872904588 None] Creating volume 208246bf-7a99-462e-9bec-33b26b59f2c0 {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:22:57 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-8de1472c-d693-4710-ad74-e1e8f4986d0f tempest-CreateVolumesFromSnapshotTest-1872904588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:22:57 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-8de1472c-d693-4710-ad74-e1e8f4986d0f tempest-CreateVolumesFromSnapshotTest-1872904588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:22:57 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-8de1472c-d693-4710-ad74-e1e8f4986d0f tempest-CreateVolumesFromSnapshotTest-1872904588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:22:57 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-8de1472c-d693-4710-ad74-e1e8f4986d0f tempest-CreateVolumesFromSnapshotTest-1872904588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:22:57 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-8de1472c-d693-4710-ad74-e1e8f4986d0f tempest-CreateVolumesFromSnapshotTest-1872904588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:22:57 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-8de1472c-d693-4710-ad74-e1e8f4986d0f tempest-CreateVolumesFromSnapshotTest-1872904588 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:22:57 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-8de1472c-d693-4710-ad74-e1e8f4986d0f tempest-CreateVolumesFromSnapshotTest-1872904588 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:22:57 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8de1472c-d693-4710-ad74-e1e8f4986d0f tempest-CreateVolumesFromSnapshotTest-1872904588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-208246bf-7a99-462e-9bec-33b26b59f2c0 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:22:58 devstack sudo[100074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-208246bf-7a99-462e-9bec-33b26b59f2c0 1073741824 Aug 29 01:22:58 devstack sudo[100074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:22:58 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-261bbc9c-3fc1-4541-a374-233b8a55376c tempest-VolumesGetTest-954660907 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:22:58 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-261bbc9c-3fc1-4541-a374-233b8a55376c tempest-VolumesGetTest-954660907 None] Flow 'volume_create_manager' (26b196a4-a6c8-49c0-a077-a11ff85a9205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:22:58 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-261bbc9c-3fc1-4541-a374-233b8a55376c tempest-VolumesGetTest-954660907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19f2fe97-e7fa-4f75-90e9-a82b4ce64c5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:22:58 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-df6c80d3-a2d9-447c-9eda-1864f94c8973 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:22:58 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-df6c80d3-a2d9-447c-9eda-1864f94c8973 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Flow 'volume_create_manager' (283d1136-9d45-4906-89e4-591cd55b6f84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:22:58 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-df6c80d3-a2d9-447c-9eda-1864f94c8973 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (871af7bb-62a8-4c78-9c89-5591d9eda81d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:22:58 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-261bbc9c-3fc1-4541-a374-233b8a55376c tempest-VolumesGetTest-954660907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19f2fe97-e7fa-4f75-90e9-a82b4ce64c5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:22:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-145205033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc441ad4-2065-4632-a5cb-3054ac0c1ae3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c4c32927df54b70ae25b85da6abe7ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:22:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:22:58Z,use_quota=True,user_id='6d651c7f6792483d90119c301b2dd999',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:22:58 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-261bbc9c-3fc1-4541-a374-233b8a55376c tempest-VolumesGetTest-954660907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30865157-23b1-4f74-8c3f-1b3d225da789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:22:58 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-261bbc9c-3fc1-4541-a374-233b8a55376c tempest-VolumesGetTest-954660907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30865157-23b1-4f74-8c3f-1b3d225da789) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:22:58 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-261bbc9c-3fc1-4541-a374-233b8a55376c tempest-VolumesGetTest-954660907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5d53ca9-ebd4-46ea-9e4e-124b2d3e2e86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:22:58 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-261bbc9c-3fc1-4541-a374-233b8a55376c tempest-VolumesGetTest-954660907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5d53ca9-ebd4-46ea-9e4e-124b2d3e2e86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc441ad4-2065-4632-a5cb-3054ac0c1ae3', 'volume_name': 'volume-dc441ad4-2065-4632-a5cb-3054ac0c1ae3', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:22:58 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-261bbc9c-3fc1-4541-a374-233b8a55376c tempest-VolumesGetTest-954660907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0783e9ee-8ff0-4eb7-b48d-c94bdbbc267d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:22:58 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-261bbc9c-3fc1-4541-a374-233b8a55376c tempest-VolumesGetTest-954660907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0783e9ee-8ff0-4eb7-b48d-c94bdbbc267d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:22:58 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-261bbc9c-3fc1-4541-a374-233b8a55376c tempest-VolumesGetTest-954660907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd2c2157-0eb0-4f8f-906f-8fde9bb9d1ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:22:58 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-261bbc9c-3fc1-4541-a374-233b8a55376c tempest-VolumesGetTest-954660907 None] Volume dc441ad4-2065-4632-a5cb-3054ac0c1ae3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc441ad4-2065-4632-a5cb-3054ac0c1ae3', 'volume_size': 1} Aug 29 01:22:58 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-261bbc9c-3fc1-4541-a374-233b8a55376c tempest-VolumesGetTest-954660907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:22:58 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-df6c80d3-a2d9-447c-9eda-1864f94c8973 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (871af7bb-62a8-4c78-9c89-5591d9eda81d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:22:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1274566741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=715217fc-e542-4cbb-aead-b4475bc3c48d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='919ac2ce6d46489f905916ca474cc495',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:22:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:22:58Z,use_quota=True,user_id='29232661a428474d9d225623aeddbf3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:22:58 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-df6c80d3-a2d9-447c-9eda-1864f94c8973 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34e9efb1-dd8d-495c-8773-6f0d8dc6d432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:22:58 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-df6c80d3-a2d9-447c-9eda-1864f94c8973 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34e9efb1-dd8d-495c-8773-6f0d8dc6d432) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:22:58 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-df6c80d3-a2d9-447c-9eda-1864f94c8973 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbef9cd2-8981-483f-b647-0f28f285f44d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:22:58 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-df6c80d3-a2d9-447c-9eda-1864f94c8973 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbef9cd2-8981-483f-b647-0f28f285f44d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '715217fc-e542-4cbb-aead-b4475bc3c48d', 'volume_name': 'volume-715217fc-e542-4cbb-aead-b4475bc3c48d', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:22:58 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-df6c80d3-a2d9-447c-9eda-1864f94c8973 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adbfcce2-f020-4987-8c2c-b22d2dfbb18b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:22:58 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-df6c80d3-a2d9-447c-9eda-1864f94c8973 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adbfcce2-f020-4987-8c2c-b22d2dfbb18b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:22:58 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-df6c80d3-a2d9-447c-9eda-1864f94c8973 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23dfdebf-be82-4244-a86c-5129812fdaf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:22:58 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-df6c80d3-a2d9-447c-9eda-1864f94c8973 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Volume 715217fc-e542-4cbb-aead-b4475bc3c48d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-715217fc-e542-4cbb-aead-b4475bc3c48d', 'volume_size': 1} Aug 29 01:22:58 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-df6c80d3-a2d9-447c-9eda-1864f94c8973 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:22:58 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-de4f6725-8948-4bf5-bcfd-4a3cb852a445 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:22:58 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-de4f6725-8948-4bf5-bcfd-4a3cb852a445 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Flow 'volume_create_manager' (39dc0f20-651a-47a9-8cd2-76b1a0931dfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:22:58 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-de4f6725-8948-4bf5-bcfd-4a3cb852a445 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (119e5bd7-d10d-4046-b37a-184a771e1b0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:22:58 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-de4f6725-8948-4bf5-bcfd-4a3cb852a445 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (119e5bd7-d10d-4046-b37a-184a771e1b0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:22:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1913445277',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75ba5cb5-56db-4f51-a387-d4873f1141a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='919ac2ce6d46489f905916ca474cc495',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:22:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:22:59Z,use_quota=True,user_id='29232661a428474d9d225623aeddbf3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:22:58 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-de4f6725-8948-4bf5-bcfd-4a3cb852a445 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1a6186b-8b25-4845-8385-d2d3cb07fea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:22:58 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-de4f6725-8948-4bf5-bcfd-4a3cb852a445 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1a6186b-8b25-4845-8385-d2d3cb07fea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:22:58 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-de4f6725-8948-4bf5-bcfd-4a3cb852a445 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02904b2f-92b1-44cf-94d2-01f25e71b5fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:22:58 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-de4f6725-8948-4bf5-bcfd-4a3cb852a445 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02904b2f-92b1-44cf-94d2-01f25e71b5fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75ba5cb5-56db-4f51-a387-d4873f1141a6', 'volume_name': 'volume-75ba5cb5-56db-4f51-a387-d4873f1141a6', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:22:58 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-de4f6725-8948-4bf5-bcfd-4a3cb852a445 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1712c75-2eb7-46bf-9e82-5bd89eb95b1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:22:58 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-de4f6725-8948-4bf5-bcfd-4a3cb852a445 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1712c75-2eb7-46bf-9e82-5bd89eb95b1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:22:58 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-de4f6725-8948-4bf5-bcfd-4a3cb852a445 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb0d145f-5df3-4b40-a383-ddd0cc5ca728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:22:58 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-de4f6725-8948-4bf5-bcfd-4a3cb852a445 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Volume 75ba5cb5-56db-4f51-a387-d4873f1141a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75ba5cb5-56db-4f51-a387-d4873f1141a6', 'volume_size': 1} Aug 29 01:22:58 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-de4f6725-8948-4bf5-bcfd-4a3cb852a445 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:22:59 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-51f1fb40-3c51-4b36-bc2d-4d95e94c09c2 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:22:59 devstack sudo[100074]: pam_unix(sudo:session): session closed for user root Aug 29 01:22:59 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-51f1fb40-3c51-4b36-bc2d-4d95e94c09c2 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Flow 'volume_create_manager' (3d842e2d-3b29-4c11-97ea-d41d3a5399b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:22:59 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-51f1fb40-3c51-4b36-bc2d-4d95e94c09c2 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3eb4405-0862-4495-8ebd-97821da726f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:22:59 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8de1472c-d693-4710-ad74-e1e8f4986d0f tempest-CreateVolumesFromSnapshotTest-1872904588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-208246bf-7a99-462e-9bec-33b26b59f2c0 1073741824" returned: 0 in 1.128s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:22:59 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-51f1fb40-3c51-4b36-bc2d-4d95e94c09c2 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3eb4405-0862-4495-8ebd-97821da726f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:22:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1529020479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e221b75a-dbe9-452b-8797-212c98a3d9d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='919ac2ce6d46489f905916ca474cc495',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:22:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:22:59Z,use_quota=True,user_id='29232661a428474d9d225623aeddbf3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:22:59 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-51f1fb40-3c51-4b36-bc2d-4d95e94c09c2 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1887afa-6664-4c7c-8e91-8a6ef0e8160c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:22:59 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-51f1fb40-3c51-4b36-bc2d-4d95e94c09c2 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1887afa-6664-4c7c-8e91-8a6ef0e8160c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:22:59 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-51f1fb40-3c51-4b36-bc2d-4d95e94c09c2 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6df6c042-131c-4e5c-bcd2-09553af14f66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:22:59 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-51f1fb40-3c51-4b36-bc2d-4d95e94c09c2 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6df6c042-131c-4e5c-bcd2-09553af14f66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e221b75a-dbe9-452b-8797-212c98a3d9d4', 'volume_name': 'volume-e221b75a-dbe9-452b-8797-212c98a3d9d4', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:22:59 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-51f1fb40-3c51-4b36-bc2d-4d95e94c09c2 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba6ee30b-8a5b-497f-bd61-a8e656880605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:22:59 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-51f1fb40-3c51-4b36-bc2d-4d95e94c09c2 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba6ee30b-8a5b-497f-bd61-a8e656880605) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:22:59 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-51f1fb40-3c51-4b36-bc2d-4d95e94c09c2 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (213831ac-e86c-4e98-a99f-a4f01ac12c5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:22:59 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-51f1fb40-3c51-4b36-bc2d-4d95e94c09c2 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Volume e221b75a-dbe9-452b-8797-212c98a3d9d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e221b75a-dbe9-452b-8797-212c98a3d9d4', 'volume_size': 1} Aug 29 01:22:59 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-51f1fb40-3c51-4b36-bc2d-4d95e94c09c2 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:22:59 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8de1472c-d693-4710-ad74-e1e8f4986d0f tempest-CreateVolumesFromSnapshotTest-1872904588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-208246bf-7a99-462e-9bec-33b26b59f2c0 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:22:59 devstack sudo[100081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-208246bf-7a99-462e-9bec-33b26b59f2c0 Aug 29 01:22:59 devstack sudo[100081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:22:59 devstack sudo[100081]: pam_unix(sudo:session): session closed for user root Aug 29 01:22:59 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8de1472c-d693-4710-ad74-e1e8f4986d0f tempest-CreateVolumesFromSnapshotTest-1872904588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-208246bf-7a99-462e-9bec-33b26b59f2c0" returned: 0 in 0.355s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:22:59 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-8de1472c-d693-4710-ad74-e1e8f4986d0f tempest-CreateVolumesFromSnapshotTest-1872904588 None] <== create_volume: return (1645ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:22:59 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-8de1472c-d693-4710-ad74-e1e8f4986d0f tempest-CreateVolumesFromSnapshotTest-1872904588 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.647s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:22:59 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-261bbc9c-3fc1-4541-a374-233b8a55376c tempest-VolumesGetTest-954660907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.192s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:22:59 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-261bbc9c-3fc1-4541-a374-233b8a55376c tempest-VolumesGetTest-954660907 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:22:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-145205033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc441ad4-2065-4632-a5cb-3054ac0c1ae3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c4c32927df54b70ae25b85da6abe7ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:22:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:22:58Z,use_quota=True,user_id='6d651c7f6792483d90119c301b2dd999',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:22:59 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-261bbc9c-3fc1-4541-a374-233b8a55376c tempest-VolumesGetTest-954660907 None] Creating volume dc441ad4-2065-4632-a5cb-3054ac0c1ae3 {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:22:59 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-261bbc9c-3fc1-4541-a374-233b8a55376c tempest-VolumesGetTest-954660907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:22:59 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-261bbc9c-3fc1-4541-a374-233b8a55376c tempest-VolumesGetTest-954660907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:22:59 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-261bbc9c-3fc1-4541-a374-233b8a55376c tempest-VolumesGetTest-954660907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:22:59 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-261bbc9c-3fc1-4541-a374-233b8a55376c tempest-VolumesGetTest-954660907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:22:59 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-261bbc9c-3fc1-4541-a374-233b8a55376c tempest-VolumesGetTest-954660907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:22:59 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-261bbc9c-3fc1-4541-a374-233b8a55376c tempest-VolumesGetTest-954660907 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:22:59 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-261bbc9c-3fc1-4541-a374-233b8a55376c tempest-VolumesGetTest-954660907 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:22:59 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-261bbc9c-3fc1-4541-a374-233b8a55376c tempest-VolumesGetTest-954660907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-dc441ad4-2065-4632-a5cb-3054ac0c1ae3 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:22:59 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-8de1472c-d693-4710-ad74-e1e8f4986d0f tempest-CreateVolumesFromSnapshotTest-1872904588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f0b8600-b09b-4d1a-9d50-b74104ffc446) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-208246bf-7a99-462e-9bec-33b26b59f2c0', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:22:59 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-8de1472c-d693-4710-ad74-e1e8f4986d0f tempest-CreateVolumesFromSnapshotTest-1872904588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dff25c9d-412b-42ab-83e7-6e652c7de87a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:22:59 devstack sudo[100084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-dc441ad4-2065-4632-a5cb-3054ac0c1ae3 1073741824 Aug 29 01:22:59 devstack sudo[100084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:22:59 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-8de1472c-d693-4710-ad74-e1e8f4986d0f tempest-CreateVolumesFromSnapshotTest-1872904588 None] Volume volume-208246bf-7a99-462e-9bec-33b26b59f2c0 (208246bf-7a99-462e-9bec-33b26b59f2c0): created successfully Aug 29 01:22:59 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-8de1472c-d693-4710-ad74-e1e8f4986d0f tempest-CreateVolumesFromSnapshotTest-1872904588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dff25c9d-412b-42ab-83e7-6e652c7de87a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:22:59 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-8de1472c-d693-4710-ad74-e1e8f4986d0f tempest-CreateVolumesFromSnapshotTest-1872904588 None] Flow 'volume_create_manager' (73b4d251-04c7-4687-bf3c-51a3bf00cb5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:22:59 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-8de1472c-d693-4710-ad74-e1e8f4986d0f tempest-CreateVolumesFromSnapshotTest-1872904588 None] Created volume successfully. Aug 29 01:23:00 devstack sudo[100084]: pam_unix(sudo:session): session closed for user root Aug 29 01:23:00 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-261bbc9c-3fc1-4541-a374-233b8a55376c tempest-VolumesGetTest-954660907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-dc441ad4-2065-4632-a5cb-3054ac0c1ae3 1073741824" returned: 0 in 0.542s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:23:00 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-261bbc9c-3fc1-4541-a374-233b8a55376c tempest-VolumesGetTest-954660907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-dc441ad4-2065-4632-a5cb-3054ac0c1ae3 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:23:00 devstack sudo[100090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-dc441ad4-2065-4632-a5cb-3054ac0c1ae3 Aug 29 01:23:00 devstack sudo[100090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:23:00 devstack sudo[100090]: pam_unix(sudo:session): session closed for user root Aug 29 01:23:00 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-261bbc9c-3fc1-4541-a374-233b8a55376c tempest-VolumesGetTest-954660907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-dc441ad4-2065-4632-a5cb-3054ac0c1ae3" returned: 0 in 0.417s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:23:00 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-261bbc9c-3fc1-4541-a374-233b8a55376c tempest-VolumesGetTest-954660907 None] <== create_volume: return (1016ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:23:00 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-261bbc9c-3fc1-4541-a374-233b8a55376c tempest-VolumesGetTest-954660907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.020s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:23:00 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-df6c80d3-a2d9-447c-9eda-1864f94c8973 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.068s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:23:00 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-df6c80d3-a2d9-447c-9eda-1864f94c8973 tempest-CreateVolumesFromSnapshotTest-1872904588 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:22:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1274566741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=715217fc-e542-4cbb-aead-b4475bc3c48d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='919ac2ce6d46489f905916ca474cc495',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:22:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:22:58Z,use_quota=True,user_id='29232661a428474d9d225623aeddbf3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:23:00 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-df6c80d3-a2d9-447c-9eda-1864f94c8973 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Creating volume 715217fc-e542-4cbb-aead-b4475bc3c48d {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:23:00 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-df6c80d3-a2d9-447c-9eda-1864f94c8973 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:23:00 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-df6c80d3-a2d9-447c-9eda-1864f94c8973 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:23:00 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-df6c80d3-a2d9-447c-9eda-1864f94c8973 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:23:00 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-df6c80d3-a2d9-447c-9eda-1864f94c8973 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:23:00 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-df6c80d3-a2d9-447c-9eda-1864f94c8973 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:23:00 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-df6c80d3-a2d9-447c-9eda-1864f94c8973 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:23:00 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-df6c80d3-a2d9-447c-9eda-1864f94c8973 tempest-CreateVolumesFromSnapshotTest-1872904588 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:23:00 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-df6c80d3-a2d9-447c-9eda-1864f94c8973 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-715217fc-e542-4cbb-aead-b4475bc3c48d 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:23:00 devstack sudo[100093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-715217fc-e542-4cbb-aead-b4475bc3c48d 1073741824 Aug 29 01:23:00 devstack sudo[100093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:23:00 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-261bbc9c-3fc1-4541-a374-233b8a55376c tempest-VolumesGetTest-954660907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd2c2157-0eb0-4f8f-906f-8fde9bb9d1ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc441ad4-2065-4632-a5cb-3054ac0c1ae3', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:23:00 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-261bbc9c-3fc1-4541-a374-233b8a55376c tempest-VolumesGetTest-954660907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (186a26c2-b927-42f7-9525-ad8ae41bf3e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:23:00 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-261bbc9c-3fc1-4541-a374-233b8a55376c tempest-VolumesGetTest-954660907 None] Volume volume-dc441ad4-2065-4632-a5cb-3054ac0c1ae3 (dc441ad4-2065-4632-a5cb-3054ac0c1ae3): created successfully Aug 29 01:23:00 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-261bbc9c-3fc1-4541-a374-233b8a55376c tempest-VolumesGetTest-954660907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (186a26c2-b927-42f7-9525-ad8ae41bf3e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:23:00 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-261bbc9c-3fc1-4541-a374-233b8a55376c tempest-VolumesGetTest-954660907 None] Flow 'volume_create_manager' (26b196a4-a6c8-49c0-a077-a11ff85a9205) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:23:00 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-261bbc9c-3fc1-4541-a374-233b8a55376c tempest-VolumesGetTest-954660907 None] Created volume successfully. Aug 29 01:23:01 devstack sudo[100093]: pam_unix(sudo:session): session closed for user root Aug 29 01:23:01 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-df6c80d3-a2d9-447c-9eda-1864f94c8973 tempest-CreateVolumesFromSnapshotTest-1872904588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-715217fc-e542-4cbb-aead-b4475bc3c48d 1073741824" returned: 0 in 0.820s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:23:01 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-df6c80d3-a2d9-447c-9eda-1864f94c8973 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-715217fc-e542-4cbb-aead-b4475bc3c48d {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:23:01 devstack sudo[100099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-715217fc-e542-4cbb-aead-b4475bc3c48d Aug 29 01:23:01 devstack sudo[100099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:23:01 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc83b7bb-67af-427b-ba54-bd3d828c4e88 tempest-VolumesGetTest-954660907 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:23:01 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-cc83b7bb-67af-427b-ba54-bd3d828c4e88 tempest-VolumesGetTest-954660907 None] Flow 'volume_create_manager' (826f0ade-e7b6-455c-a6ed-6cb49f682db7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:23:01 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-cc83b7bb-67af-427b-ba54-bd3d828c4e88 tempest-VolumesGetTest-954660907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f8f7a01-eed6-4518-981a-508bf3c5937f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:23:01 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-cc83b7bb-67af-427b-ba54-bd3d828c4e88 tempest-VolumesGetTest-954660907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f8f7a01-eed6-4518-981a-508bf3c5937f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:23:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-376112620',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07cffb9c-e2e8-40f3-9237-5be146c032e3,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='5c4c32927df54b70ae25b85da6abe7ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:23:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=dc441ad4-2065-4632-a5cb-3054ac0c1ae3,status='creating',terminated_at=None,updated_at=2026-08-28T23:23:02Z,use_quota=True,user_id='6d651c7f6792483d90119c301b2dd999',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:23:01 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-cc83b7bb-67af-427b-ba54-bd3d828c4e88 tempest-VolumesGetTest-954660907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab9ceee6-2d2e-4f14-a96e-a02eff6873ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:23:01 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-cc83b7bb-67af-427b-ba54-bd3d828c4e88 tempest-VolumesGetTest-954660907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab9ceee6-2d2e-4f14-a96e-a02eff6873ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:23:01 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-cc83b7bb-67af-427b-ba54-bd3d828c4e88 tempest-VolumesGetTest-954660907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e4ca6fd-a031-4a8a-a967-ada8cda88d06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:23:01 devstack sudo[100099]: pam_unix(sudo:session): session closed for user root Aug 29 01:23:01 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-df6c80d3-a2d9-447c-9eda-1864f94c8973 tempest-CreateVolumesFromSnapshotTest-1872904588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-715217fc-e542-4cbb-aead-b4475bc3c48d" returned: 0 in 0.440s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:23:01 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-df6c80d3-a2d9-447c-9eda-1864f94c8973 tempest-CreateVolumesFromSnapshotTest-1872904588 None] <== create_volume: return (1347ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:23:01 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-df6c80d3-a2d9-447c-9eda-1864f94c8973 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.350s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:23:01 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-de4f6725-8948-4bf5-bcfd-4a3cb852a445 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.092s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:23:01 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-de4f6725-8948-4bf5-bcfd-4a3cb852a445 tempest-CreateVolumesFromSnapshotTest-1872904588 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:22:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1913445277',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75ba5cb5-56db-4f51-a387-d4873f1141a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='919ac2ce6d46489f905916ca474cc495',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:22:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:22:59Z,use_quota=True,user_id='29232661a428474d9d225623aeddbf3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:23:01 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-de4f6725-8948-4bf5-bcfd-4a3cb852a445 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Creating volume 75ba5cb5-56db-4f51-a387-d4873f1141a6 {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:23:01 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-de4f6725-8948-4bf5-bcfd-4a3cb852a445 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:23:01 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-de4f6725-8948-4bf5-bcfd-4a3cb852a445 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:23:01 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-de4f6725-8948-4bf5-bcfd-4a3cb852a445 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:23:01 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-de4f6725-8948-4bf5-bcfd-4a3cb852a445 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:23:01 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-de4f6725-8948-4bf5-bcfd-4a3cb852a445 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:23:01 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-de4f6725-8948-4bf5-bcfd-4a3cb852a445 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:23:01 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-de4f6725-8948-4bf5-bcfd-4a3cb852a445 tempest-CreateVolumesFromSnapshotTest-1872904588 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:23:01 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-de4f6725-8948-4bf5-bcfd-4a3cb852a445 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-75ba5cb5-56db-4f51-a387-d4873f1141a6 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:23:02 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-cc83b7bb-67af-427b-ba54-bd3d828c4e88 tempest-VolumesGetTest-954660907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e4ca6fd-a031-4a8a-a967-ada8cda88d06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '07cffb9c-e2e8-40f3-9237-5be146c032e3', 'volume_name': 'volume-07cffb9c-e2e8-40f3-9237-5be146c032e3', 'volume_size': 1, 'source_volid': 'dc441ad4-2065-4632-a5cb-3054ac0c1ae3', 'source_volstatus': 'available'}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:23:02 devstack sudo[100103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-75ba5cb5-56db-4f51-a387-d4873f1141a6 1073741824 Aug 29 01:23:02 devstack sudo[100103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:23:02 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-cc83b7bb-67af-427b-ba54-bd3d828c4e88 tempest-VolumesGetTest-954660907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f990558-bb90-4033-b7d2-221eb7b571ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:23:02 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-cc83b7bb-67af-427b-ba54-bd3d828c4e88 tempest-VolumesGetTest-954660907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f990558-bb90-4033-b7d2-221eb7b571ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:23:02 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-cc83b7bb-67af-427b-ba54-bd3d828c4e88 tempest-VolumesGetTest-954660907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35ba9f69-eb50-4c0a-8596-5d24bc38dae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:23:02 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-cc83b7bb-67af-427b-ba54-bd3d828c4e88 tempest-VolumesGetTest-954660907 None] Volume 07cffb9c-e2e8-40f3-9237-5be146c032e3: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-07cffb9c-e2e8-40f3-9237-5be146c032e3', 'volume_size': 1, 'source_volid': 'dc441ad4-2065-4632-a5cb-3054ac0c1ae3', 'source_volstatus': 'available'} Aug 29 01:23:02 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-cc83b7bb-67af-427b-ba54-bd3d828c4e88 tempest-VolumesGetTest-954660907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:23:02 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-df6c80d3-a2d9-447c-9eda-1864f94c8973 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23dfdebf-be82-4244-a86c-5129812fdaf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-715217fc-e542-4cbb-aead-b4475bc3c48d', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:23:02 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-df6c80d3-a2d9-447c-9eda-1864f94c8973 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e4f95f8-7b7e-4a91-a998-a13b73955755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:23:02 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-df6c80d3-a2d9-447c-9eda-1864f94c8973 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Volume volume-715217fc-e542-4cbb-aead-b4475bc3c48d (715217fc-e542-4cbb-aead-b4475bc3c48d): created successfully Aug 29 01:23:02 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-df6c80d3-a2d9-447c-9eda-1864f94c8973 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e4f95f8-7b7e-4a91-a998-a13b73955755) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:23:02 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-df6c80d3-a2d9-447c-9eda-1864f94c8973 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Flow 'volume_create_manager' (283d1136-9d45-4906-89e4-591cd55b6f84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:23:02 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-df6c80d3-a2d9-447c-9eda-1864f94c8973 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Created volume successfully. Aug 29 01:23:02 devstack sudo[100103]: pam_unix(sudo:session): session closed for user root Aug 29 01:23:02 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-de4f6725-8948-4bf5-bcfd-4a3cb852a445 tempest-CreateVolumesFromSnapshotTest-1872904588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-75ba5cb5-56db-4f51-a387-d4873f1141a6 1073741824" returned: 0 in 0.565s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:23:02 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-de4f6725-8948-4bf5-bcfd-4a3cb852a445 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-75ba5cb5-56db-4f51-a387-d4873f1141a6 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:23:02 devstack sudo[100109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-75ba5cb5-56db-4f51-a387-d4873f1141a6 Aug 29 01:23:02 devstack sudo[100109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:23:02 devstack sudo[100109]: pam_unix(sudo:session): session closed for user root Aug 29 01:23:02 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-de4f6725-8948-4bf5-bcfd-4a3cb852a445 tempest-CreateVolumesFromSnapshotTest-1872904588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-75ba5cb5-56db-4f51-a387-d4873f1141a6" returned: 0 in 0.284s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:23:02 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-de4f6725-8948-4bf5-bcfd-4a3cb852a445 tempest-CreateVolumesFromSnapshotTest-1872904588 None] <== create_volume: return (915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:23:02 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-de4f6725-8948-4bf5-bcfd-4a3cb852a445 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.918s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:23:02 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-51f1fb40-3c51-4b36-bc2d-4d95e94c09c2 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.720s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:23:02 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-51f1fb40-3c51-4b36-bc2d-4d95e94c09c2 tempest-CreateVolumesFromSnapshotTest-1872904588 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:22:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1529020479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e221b75a-dbe9-452b-8797-212c98a3d9d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='919ac2ce6d46489f905916ca474cc495',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:22:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:22:59Z,use_quota=True,user_id='29232661a428474d9d225623aeddbf3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:23:02 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-51f1fb40-3c51-4b36-bc2d-4d95e94c09c2 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Creating volume e221b75a-dbe9-452b-8797-212c98a3d9d4 {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:23:02 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-51f1fb40-3c51-4b36-bc2d-4d95e94c09c2 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:23:02 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-51f1fb40-3c51-4b36-bc2d-4d95e94c09c2 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:23:02 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-51f1fb40-3c51-4b36-bc2d-4d95e94c09c2 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:23:02 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-51f1fb40-3c51-4b36-bc2d-4d95e94c09c2 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:23:02 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-51f1fb40-3c51-4b36-bc2d-4d95e94c09c2 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:23:02 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-51f1fb40-3c51-4b36-bc2d-4d95e94c09c2 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:23:02 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-51f1fb40-3c51-4b36-bc2d-4d95e94c09c2 tempest-CreateVolumesFromSnapshotTest-1872904588 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:23:02 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-51f1fb40-3c51-4b36-bc2d-4d95e94c09c2 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-e221b75a-dbe9-452b-8797-212c98a3d9d4 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:23:02 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-de4f6725-8948-4bf5-bcfd-4a3cb852a445 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb0d145f-5df3-4b40-a383-ddd0cc5ca728) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75ba5cb5-56db-4f51-a387-d4873f1141a6', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:23:02 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-de4f6725-8948-4bf5-bcfd-4a3cb852a445 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e206cb8-ff23-4f7e-babf-67e0864ccd67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:23:02 devstack sudo[100113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-e221b75a-dbe9-452b-8797-212c98a3d9d4 1073741824 Aug 29 01:23:02 devstack sudo[100113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:23:02 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-de4f6725-8948-4bf5-bcfd-4a3cb852a445 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Volume volume-75ba5cb5-56db-4f51-a387-d4873f1141a6 (75ba5cb5-56db-4f51-a387-d4873f1141a6): created successfully Aug 29 01:23:02 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-de4f6725-8948-4bf5-bcfd-4a3cb852a445 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e206cb8-ff23-4f7e-babf-67e0864ccd67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:23:02 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-de4f6725-8948-4bf5-bcfd-4a3cb852a445 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Flow 'volume_create_manager' (39dc0f20-651a-47a9-8cd2-76b1a0931dfb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:23:02 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-de4f6725-8948-4bf5-bcfd-4a3cb852a445 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Created volume successfully. Aug 29 01:23:03 devstack sudo[100113]: pam_unix(sudo:session): session closed for user root Aug 29 01:23:03 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-51f1fb40-3c51-4b36-bc2d-4d95e94c09c2 tempest-CreateVolumesFromSnapshotTest-1872904588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-e221b75a-dbe9-452b-8797-212c98a3d9d4 1073741824" returned: 0 in 0.501s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:23:03 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-51f1fb40-3c51-4b36-bc2d-4d95e94c09c2 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-e221b75a-dbe9-452b-8797-212c98a3d9d4 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:23:03 devstack sudo[100120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-e221b75a-dbe9-452b-8797-212c98a3d9d4 Aug 29 01:23:03 devstack sudo[100120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:23:03 devstack sudo[100120]: pam_unix(sudo:session): session closed for user root Aug 29 01:23:03 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-51f1fb40-3c51-4b36-bc2d-4d95e94c09c2 tempest-CreateVolumesFromSnapshotTest-1872904588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-e221b75a-dbe9-452b-8797-212c98a3d9d4" returned: 0 in 0.320s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:23:03 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-51f1fb40-3c51-4b36-bc2d-4d95e94c09c2 tempest-CreateVolumesFromSnapshotTest-1872904588 None] <== create_volume: return (866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:23:03 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-51f1fb40-3c51-4b36-bc2d-4d95e94c09c2 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.869s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:23:03 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-cc83b7bb-67af-427b-ba54-bd3d828c4e88 tempest-VolumesGetTest-954660907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 1.684s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:23:03 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-cc83b7bb-67af-427b-ba54-bd3d828c4e88 tempest-VolumesGetTest-954660907 None] Cloning volume dc441ad4-2065-4632-a5cb-3054ac0c1ae3 to volume 07cffb9c-e2e8-40f3-9237-5be146c032e3 Aug 29 01:23:03 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-51f1fb40-3c51-4b36-bc2d-4d95e94c09c2 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (213831ac-e86c-4e98-a99f-a4f01ac12c5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e221b75a-dbe9-452b-8797-212c98a3d9d4', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:23:03 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-51f1fb40-3c51-4b36-bc2d-4d95e94c09c2 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83b06315-318e-4234-ace0-7d79dd66f1d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:23:03 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-cc83b7bb-67af-427b-ba54-bd3d828c4e88 tempest-VolumesGetTest-954660907 None] Creating offline snapshot 308218c1-7537-4b6b-b055-7cecc00dc278 of volume dc441ad4-2065-4632-a5cb-3054ac0c1ae3 {{(pid=86111) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 29 01:23:03 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-51f1fb40-3c51-4b36-bc2d-4d95e94c09c2 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Volume volume-e221b75a-dbe9-452b-8797-212c98a3d9d4 (e221b75a-dbe9-452b-8797-212c98a3d9d4): created successfully Aug 29 01:23:03 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-51f1fb40-3c51-4b36-bc2d-4d95e94c09c2 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83b06315-318e-4234-ace0-7d79dd66f1d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:23:03 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-51f1fb40-3c51-4b36-bc2d-4d95e94c09c2 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Flow 'volume_create_manager' (3d842e2d-3b29-4c11-97ea-d41d3a5399b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:23:03 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2ca705f-ae68-422c-9933-25d365189c29]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:23:03 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-cc83b7bb-67af-427b-ba54-bd3d828c4e88 tempest-VolumesGetTest-954660907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-dc441ad4-2065-4632-a5cb-3054ac0c1ae3 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:23:03 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-51f1fb40-3c51-4b36-bc2d-4d95e94c09c2 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Created volume successfully. Aug 29 01:23:03 devstack sudo[100123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-dc441ad4-2065-4632-a5cb-3054ac0c1ae3 Aug 29 01:23:03 devstack sudo[100123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:23:04 devstack sudo[100123]: pam_unix(sudo:session): session closed for user root Aug 29 01:23:04 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-cc83b7bb-67af-427b-ba54-bd3d828c4e88 tempest-VolumesGetTest-954660907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-dc441ad4-2065-4632-a5cb-3054ac0c1ae3" returned: 0 in 0.399s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:23:04 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-cc83b7bb-67af-427b-ba54-bd3d828c4e88 tempest-VolumesGetTest-954660907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-dc441ad4-2065-4632-a5cb-3054ac0c1ae3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-dc441ad4-2065-4632-a5cb-3054ac0c1ae3.308218c1-7537-4b6b-b055-7cecc00dc278 1G {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:23:04 devstack sudo[100128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-dc441ad4-2065-4632-a5cb-3054ac0c1ae3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-dc441ad4-2065-4632-a5cb-3054ac0c1ae3.308218c1-7537-4b6b-b055-7cecc00dc278 1G Aug 29 01:23:04 devstack sudo[100128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:23:04 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-2a334cda-653f-4496-bbf2-cb857bddce0c tempest-CreateVolumesFromSnapshotTest-1872904588 None] Acquiring lock "cinder-e221b75a-dbe9-452b-8797-212c98a3d9d4-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:23:04 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-2a334cda-653f-4496-bbf2-cb857bddce0c tempest-CreateVolumesFromSnapshotTest-1872904588 None] Lock "cinder-e221b75a-dbe9-452b-8797-212c98a3d9d4-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:23:04 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-2a334cda-653f-4496-bbf2-cb857bddce0c tempest-CreateVolumesFromSnapshotTest-1872904588 None] Acquiring lock "cinder-quobyte-e221b75a-dbe9-452b-8797-212c98a3d9d4" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:23:04 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-2a334cda-653f-4496-bbf2-cb857bddce0c tempest-CreateVolumesFromSnapshotTest-1872904588 None] Lock "cinder-quobyte-e221b75a-dbe9-452b-8797-212c98a3d9d4" acquired by "delete_volume" :: waited 0.025s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:23:04 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[f65b6bf0-b7d2-4a81-b8c1-e5fa57430ef5]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:23:04 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-2a334cda-653f-4496-bbf2-cb857bddce0c tempest-CreateVolumesFromSnapshotTest-1872904588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-e221b75a-dbe9-452b-8797-212c98a3d9d4 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:23:04 devstack sudo[100128]: pam_unix(sudo:session): session closed for user root Aug 29 01:23:04 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-cc83b7bb-67af-427b-ba54-bd3d828c4e88 tempest-VolumesGetTest-954660907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-dc441ad4-2065-4632-a5cb-3054ac0c1ae3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-dc441ad4-2065-4632-a5cb-3054ac0c1ae3.308218c1-7537-4b6b-b055-7cecc00dc278 1G" returned: 0 in 0.583s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:23:04 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-cc83b7bb-67af-427b-ba54-bd3d828c4e88 tempest-VolumesGetTest-954660907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc441ad4-2065-4632-a5cb-3054ac0c1ae3 -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-dc441ad4-2065-4632-a5cb-3054ac0c1ae3.308218c1-7537-4b6b-b055-7cecc00dc278 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:23:04 devstack sudo[100134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc441ad4-2065-4632-a5cb-3054ac0c1ae3 -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-dc441ad4-2065-4632-a5cb-3054ac0c1ae3.308218c1-7537-4b6b-b055-7cecc00dc278 Aug 29 01:23:04 devstack sudo[100134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:23:04 devstack sudo[100133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-e221b75a-dbe9-452b-8797-212c98a3d9d4 Aug 29 01:23:04 devstack sudo[100133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:23:05 devstack sudo[100134]: pam_unix(sudo:session): session closed for user root Aug 29 01:23:05 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-cc83b7bb-67af-427b-ba54-bd3d828c4e88 tempest-VolumesGetTest-954660907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc441ad4-2065-4632-a5cb-3054ac0c1ae3 -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-dc441ad4-2065-4632-a5cb-3054ac0c1ae3.308218c1-7537-4b6b-b055-7cecc00dc278" returned: 0 in 0.366s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:23:05 devstack cinder-volume[86111]: WARNING cinder.volume.drivers.remotefs [None req-cc83b7bb-67af-427b-ba54-bd3d828c4e88 tempest-VolumesGetTest-954660907 None] /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-dc441ad4-2065-4632-a5cb-3054ac0c1ae3.308218c1-7537-4b6b-b055-7cecc00dc278 is being set with open permissions: ugo+rw Aug 29 01:23:05 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-cc83b7bb-67af-427b-ba54-bd3d828c4e88 tempest-VolumesGetTest-954660907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-dc441ad4-2065-4632-a5cb-3054ac0c1ae3.308218c1-7537-4b6b-b055-7cecc00dc278 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:23:05 devstack sudo[100142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-dc441ad4-2065-4632-a5cb-3054ac0c1ae3.308218c1-7537-4b6b-b055-7cecc00dc278 Aug 29 01:23:05 devstack sudo[100142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:23:05 devstack sudo[100133]: pam_unix(sudo:session): session closed for user root Aug 29 01:23:05 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-2a334cda-653f-4496-bbf2-cb857bddce0c tempest-CreateVolumesFromSnapshotTest-1872904588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-e221b75a-dbe9-452b-8797-212c98a3d9d4" returned: 0 in 0.500s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:23:05 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-2a334cda-653f-4496-bbf2-cb857bddce0c tempest-CreateVolumesFromSnapshotTest-1872904588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-e221b75a-dbe9-452b-8797-212c98a3d9d4 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:23:05 devstack sudo[100145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-e221b75a-dbe9-452b-8797-212c98a3d9d4 Aug 29 01:23:05 devstack sudo[100145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:23:05 devstack sudo[100142]: pam_unix(sudo:session): session closed for user root Aug 29 01:23:05 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-cc83b7bb-67af-427b-ba54-bd3d828c4e88 tempest-VolumesGetTest-954660907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-dc441ad4-2065-4632-a5cb-3054ac0c1ae3.308218c1-7537-4b6b-b055-7cecc00dc278" returned: 0 in 0.373s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:23:05 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-cc83b7bb-67af-427b-ba54-bd3d828c4e88 tempest-VolumesGetTest-954660907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-dc441ad4-2065-4632-a5cb-3054ac0c1ae3.info {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:23:05 devstack sudo[100145]: pam_unix(sudo:session): session closed for user root Aug 29 01:23:05 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-2a334cda-653f-4496-bbf2-cb857bddce0c tempest-CreateVolumesFromSnapshotTest-1872904588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-e221b75a-dbe9-452b-8797-212c98a3d9d4" returned: 0 in 0.310s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:23:05 devstack sudo[100149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-dc441ad4-2065-4632-a5cb-3054ac0c1ae3.info Aug 29 01:23:05 devstack sudo[100149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:23:05 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-2a334cda-653f-4496-bbf2-cb857bddce0c tempest-CreateVolumesFromSnapshotTest-1872904588 None] Lock "cinder-quobyte-e221b75a-dbe9-452b-8797-212c98a3d9d4" released by "delete_volume" :: held 0.869s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:23:05 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-2a334cda-653f-4496-bbf2-cb857bddce0c tempest-CreateVolumesFromSnapshotTest-1872904588 None] Created reservations ['0cdb40fa-c7d5-4360-8425-92d40303c5e6', '07ab256a-f7ee-4d8b-bf76-45f748129345', '38ec50af-e2d4-4302-b574-b977481e97ca', 'f7fbe09f-7385-4110-b9aa-d97571ef5ea0'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:23:05 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-2a334cda-653f-4496-bbf2-cb857bddce0c tempest-CreateVolumesFromSnapshotTest-1872904588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:23:05 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-2a334cda-653f-4496-bbf2-cb857bddce0c tempest-CreateVolumesFromSnapshotTest-1872904588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:23:05 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-2a334cda-653f-4496-bbf2-cb857bddce0c tempest-CreateVolumesFromSnapshotTest-1872904588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:23:05 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-2a334cda-653f-4496-bbf2-cb857bddce0c tempest-CreateVolumesFromSnapshotTest-1872904588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:23:05 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-2a334cda-653f-4496-bbf2-cb857bddce0c tempest-CreateVolumesFromSnapshotTest-1872904588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:23:05 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-2a334cda-653f-4496-bbf2-cb857bddce0c tempest-CreateVolumesFromSnapshotTest-1872904588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:23:05 devstack sudo[100152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:23:05 devstack sudo[100152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:23:06 devstack sudo[100149]: pam_unix(sudo:session): session closed for user root Aug 29 01:23:06 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-cc83b7bb-67af-427b-ba54-bd3d828c4e88 tempest-VolumesGetTest-954660907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-dc441ad4-2065-4632-a5cb-3054ac0c1ae3.info" returned: 0 in 0.488s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:23:06 devstack cinder-volume[86111]: WARNING cinder.volume.drivers.remotefs [None req-cc83b7bb-67af-427b-ba54-bd3d828c4e88 tempest-VolumesGetTest-954660907 None] /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-dc441ad4-2065-4632-a5cb-3054ac0c1ae3.info is being set with open permissions: ugo+rw Aug 29 01:23:06 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-cc83b7bb-67af-427b-ba54-bd3d828c4e88 tempest-VolumesGetTest-954660907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-dc441ad4-2065-4632-a5cb-3054ac0c1ae3.info {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:23:06 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-85fca7c7-f81b-4943-b588-834a43a61f62 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Acquiring lock "cinder-75ba5cb5-56db-4f51-a387-d4873f1141a6-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:23:06 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-85fca7c7-f81b-4943-b588-834a43a61f62 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Lock "cinder-75ba5cb5-56db-4f51-a387-d4873f1141a6-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:23:06 devstack sudo[100154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-dc441ad4-2065-4632-a5cb-3054ac0c1ae3.info Aug 29 01:23:06 devstack sudo[100154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:23:06 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-85fca7c7-f81b-4943-b588-834a43a61f62 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Acquiring lock "cinder-quobyte-75ba5cb5-56db-4f51-a387-d4873f1141a6" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:23:06 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-85fca7c7-f81b-4943-b588-834a43a61f62 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Lock "cinder-quobyte-75ba5cb5-56db-4f51-a387-d4873f1141a6" acquired by "delete_volume" :: waited 0.034s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:23:06 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[cde92eee-2e2b-49e2-8234-9d5fb0498a1c]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:23:06 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-85fca7c7-f81b-4943-b588-834a43a61f62 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-75ba5cb5-56db-4f51-a387-d4873f1141a6 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:23:06 devstack sudo[100156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-75ba5cb5-56db-4f51-a387-d4873f1141a6 Aug 29 01:23:06 devstack sudo[100156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:23:06 devstack sudo[100152]: pam_unix(sudo:session): session closed for user root Aug 29 01:23:06 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-2a334cda-653f-4496-bbf2-cb857bddce0c tempest-CreateVolumesFromSnapshotTest-1872904588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.560s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:23:06 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-2a334cda-653f-4496-bbf2-cb857bddce0c tempest-CreateVolumesFromSnapshotTest-1872904588 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:23:06 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-2a334cda-653f-4496-bbf2-cb857bddce0c tempest-CreateVolumesFromSnapshotTest-1872904588 None] Deleted volume successfully. Aug 29 01:23:06 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-2a334cda-653f-4496-bbf2-cb857bddce0c tempest-CreateVolumesFromSnapshotTest-1872904588 None] Lock "cinder-e221b75a-dbe9-452b-8797-212c98a3d9d4-delete_volume" released by "delete_volume" :: held 1.854s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:23:06 devstack sudo[100154]: pam_unix(sudo:session): session closed for user root Aug 29 01:23:06 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-cc83b7bb-67af-427b-ba54-bd3d828c4e88 tempest-VolumesGetTest-954660907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-dc441ad4-2065-4632-a5cb-3054ac0c1ae3.info" returned: 0 in 0.484s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:23:06 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-cc83b7bb-67af-427b-ba54-bd3d828c4e88 tempest-VolumesGetTest-954660907 None] Acquiring lock "cinder-quobyte-07cffb9c-e2e8-40f3-9237-5be146c032e3" by "_copy_volume_from_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:23:06 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-cc83b7bb-67af-427b-ba54-bd3d828c4e88 tempest-VolumesGetTest-954660907 None] Lock "cinder-quobyte-07cffb9c-e2e8-40f3-9237-5be146c032e3" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:23:06 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-cc83b7bb-67af-427b-ba54-bd3d828c4e88 tempest-VolumesGetTest-954660907 None] snapshot: 308218c1-7537-4b6b-b055-7cecc00dc278, volume: 07cffb9c-e2e8-40f3-9237-5be146c032e3, {{(pid=86111) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 29 01:23:06 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-cc83b7bb-67af-427b-ba54-bd3d828c4e88 tempest-VolumesGetTest-954660907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:23:06 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-cc83b7bb-67af-427b-ba54-bd3d828c4e88 tempest-VolumesGetTest-954660907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:23:06 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-cc83b7bb-67af-427b-ba54-bd3d828c4e88 tempest-VolumesGetTest-954660907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:23:06 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-cc83b7bb-67af-427b-ba54-bd3d828c4e88 tempest-VolumesGetTest-954660907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:23:06 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-cc83b7bb-67af-427b-ba54-bd3d828c4e88 tempest-VolumesGetTest-954660907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:23:06 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[6712df4b-ecfb-4c15-a1d4-be4c574d3a35]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:23:06 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-cc83b7bb-67af-427b-ba54-bd3d828c4e88 tempest-VolumesGetTest-954660907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-dc441ad4-2065-4632-a5cb-3054ac0c1ae3.308218c1-7537-4b6b-b055-7cecc00dc278 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:23:06 devstack sudo[100156]: pam_unix(sudo:session): session closed for user root Aug 29 01:23:06 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-85fca7c7-f81b-4943-b588-834a43a61f62 tempest-CreateVolumesFromSnapshotTest-1872904588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-75ba5cb5-56db-4f51-a387-d4873f1141a6" returned: 0 in 0.464s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:23:06 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-85fca7c7-f81b-4943-b588-834a43a61f62 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-75ba5cb5-56db-4f51-a387-d4873f1141a6 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:23:06 devstack sudo[100164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-75ba5cb5-56db-4f51-a387-d4873f1141a6 Aug 29 01:23:06 devstack sudo[100164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:23:06 devstack sudo[100161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-dc441ad4-2065-4632-a5cb-3054ac0c1ae3.308218c1-7537-4b6b-b055-7cecc00dc278 Aug 29 01:23:06 devstack sudo[100161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:23:07 devstack sudo[100164]: pam_unix(sudo:session): session closed for user root Aug 29 01:23:07 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-85fca7c7-f81b-4943-b588-834a43a61f62 tempest-CreateVolumesFromSnapshotTest-1872904588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-75ba5cb5-56db-4f51-a387-d4873f1141a6" returned: 0 in 0.394s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:23:07 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-85fca7c7-f81b-4943-b588-834a43a61f62 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Lock "cinder-quobyte-75ba5cb5-56db-4f51-a387-d4873f1141a6" released by "delete_volume" :: held 0.926s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:23:07 devstack sudo[100161]: pam_unix(sudo:session): session closed for user root Aug 29 01:23:07 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-cc83b7bb-67af-427b-ba54-bd3d828c4e88 tempest-VolumesGetTest-954660907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-dc441ad4-2065-4632-a5cb-3054ac0c1ae3.308218c1-7537-4b6b-b055-7cecc00dc278" returned: 0 in 0.522s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:23:07 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-cc83b7bb-67af-427b-ba54-bd3d828c4e88 tempest-VolumesGetTest-954660907 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dc441ad4-2065-4632-a5cb-3054ac0c1ae3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 29 01:23:07 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[2046dbd6-9b69-4dd6-93c3-444f7a1daf60]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:23:07 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-cc83b7bb-67af-427b-ba54-bd3d828c4e88 tempest-VolumesGetTest-954660907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-dc441ad4-2065-4632-a5cb-3054ac0c1ae3 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:23:07 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f3b11de-1fc4-47ae-a39c-400a653efeb4 tempest-ProjectReaderTests-1690395873 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:23:07 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-3f3b11de-1fc4-47ae-a39c-400a653efeb4 tempest-ProjectReaderTests-1690395873 None] Flow 'volume_create_manager' (bf49c7a3-e1ac-47ba-ac2f-b5a50c2b6fee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:23:07 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-3f3b11de-1fc4-47ae-a39c-400a653efeb4 tempest-ProjectReaderTests-1690395873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20c48bba-b1aa-4e2e-b6f1-1c945ba593b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:23:07 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-85fca7c7-f81b-4943-b588-834a43a61f62 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Created reservations ['222e6130-a8df-4d3e-8a65-8daac6d726e3', '533ef708-a79d-48f9-beaf-d87cc56f4504', 'c4d2043c-1eca-49e5-bfc4-dab0a30aa4ba', 'ac3ec30e-fff5-4d1d-b34f-9f371231b267'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:23:07 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-3f3b11de-1fc4-47ae-a39c-400a653efeb4 tempest-ProjectReaderTests-1690395873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20c48bba-b1aa-4e2e-b6f1-1c945ba593b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:23:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1538911282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ceff73d2-2974-4d49-a220-43911129f546,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94d43c17f1544685a67db2bf45ebdca1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:23:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:23:07Z,use_quota=True,user_id='9c7b7dcd643440a792fbb37f30c2e7b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:23:07 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-3f3b11de-1fc4-47ae-a39c-400a653efeb4 tempest-ProjectReaderTests-1690395873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2423ad0a-d19c-4fe5-a8ee-446adf18cf0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:23:07 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-3f3b11de-1fc4-47ae-a39c-400a653efeb4 tempest-ProjectReaderTests-1690395873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2423ad0a-d19c-4fe5-a8ee-446adf18cf0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:23:07 devstack sudo[100172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-dc441ad4-2065-4632-a5cb-3054ac0c1ae3 Aug 29 01:23:07 devstack sudo[100172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:23:07 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-3f3b11de-1fc4-47ae-a39c-400a653efeb4 tempest-ProjectReaderTests-1690395873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd8471a4-bc15-4305-a353-f7e29a00b83d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:23:07 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-3f3b11de-1fc4-47ae-a39c-400a653efeb4 tempest-ProjectReaderTests-1690395873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd8471a4-bc15-4305-a353-f7e29a00b83d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ceff73d2-2974-4d49-a220-43911129f546', 'volume_name': 'volume-ceff73d2-2974-4d49-a220-43911129f546', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:23:07 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-3f3b11de-1fc4-47ae-a39c-400a653efeb4 tempest-ProjectReaderTests-1690395873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41e3bb19-8382-450d-8feb-91626defd75d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:23:07 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-3f3b11de-1fc4-47ae-a39c-400a653efeb4 tempest-ProjectReaderTests-1690395873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41e3bb19-8382-450d-8feb-91626defd75d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:23:07 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-3f3b11de-1fc4-47ae-a39c-400a653efeb4 tempest-ProjectReaderTests-1690395873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f456b6c8-a1ef-439f-a01e-47eec4ed8a22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:23:07 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-3f3b11de-1fc4-47ae-a39c-400a653efeb4 tempest-ProjectReaderTests-1690395873 None] Volume ceff73d2-2974-4d49-a220-43911129f546: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ceff73d2-2974-4d49-a220-43911129f546', 'volume_size': 1} Aug 29 01:23:07 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-3f3b11de-1fc4-47ae-a39c-400a653efeb4 tempest-ProjectReaderTests-1690395873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:23:07 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-85fca7c7-f81b-4943-b588-834a43a61f62 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:23:07 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-85fca7c7-f81b-4943-b588-834a43a61f62 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:23:07 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-85fca7c7-f81b-4943-b588-834a43a61f62 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:23:07 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-85fca7c7-f81b-4943-b588-834a43a61f62 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:23:07 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-85fca7c7-f81b-4943-b588-834a43a61f62 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:23:07 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-85fca7c7-f81b-4943-b588-834a43a61f62 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:23:07 devstack sudo[100174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:23:07 devstack sudo[100174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:23:07 devstack sudo[100172]: pam_unix(sudo:session): session closed for user root Aug 29 01:23:07 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-cc83b7bb-67af-427b-ba54-bd3d828c4e88 tempest-VolumesGetTest-954660907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-dc441ad4-2065-4632-a5cb-3054ac0c1ae3" returned: 0 in 0.447s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:23:07 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-cc83b7bb-67af-427b-ba54-bd3d828c4e88 tempest-VolumesGetTest-954660907 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-dc441ad4-2065-4632-a5cb-3054ac0c1ae3 {{(pid=86111) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 29 01:23:07 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-cc83b7bb-67af-427b-ba54-bd3d828c4e88 tempest-VolumesGetTest-954660907 None] Creating direct copy from snapshot {{(pid=86111) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 29 01:23:07 devstack cinder-volume[86111]: DEBUG cinder.utils [None req-cc83b7bb-67af-427b-ba54-bd3d828c4e88 tempest-VolumesGetTest-954660907 None] Path /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-07cffb9c-e2e8-40f3-9237-5be146c032e3 not found in is_blk_device check {{(pid=86111) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 29 01:23:07 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-cc83b7bb-67af-427b-ba54-bd3d828c4e88 tempest-VolumesGetTest-954660907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-dc441ad4-2065-4632-a5cb-3054ac0c1ae3 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-07cffb9c-e2e8-40f3-9237-5be146c032e3 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:23:07 devstack sudo[100180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-dc441ad4-2065-4632-a5cb-3054ac0c1ae3 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-07cffb9c-e2e8-40f3-9237-5be146c032e3 Aug 29 01:23:07 devstack sudo[100180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:23:07 devstack sudo[100174]: pam_unix(sudo:session): session closed for user root Aug 29 01:23:07 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-85fca7c7-f81b-4943-b588-834a43a61f62 tempest-CreateVolumesFromSnapshotTest-1872904588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.297s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:23:07 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-85fca7c7-f81b-4943-b588-834a43a61f62 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:23:07 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-85fca7c7-f81b-4943-b588-834a43a61f62 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Deleted volume successfully. Aug 29 01:23:07 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-85fca7c7-f81b-4943-b588-834a43a61f62 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Lock "cinder-75ba5cb5-56db-4f51-a387-d4873f1141a6-delete_volume" released by "delete_volume" :: held 1.648s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:23:08 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-f00971c4-7720-4751-89fc-1a36d2e8d051 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Acquiring lock "cinder-715217fc-e542-4cbb-aead-b4475bc3c48d-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:23:08 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-f00971c4-7720-4751-89fc-1a36d2e8d051 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Lock "cinder-715217fc-e542-4cbb-aead-b4475bc3c48d-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:23:08 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-f00971c4-7720-4751-89fc-1a36d2e8d051 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Acquiring lock "cinder-quobyte-715217fc-e542-4cbb-aead-b4475bc3c48d" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:23:08 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-f00971c4-7720-4751-89fc-1a36d2e8d051 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Lock "cinder-quobyte-715217fc-e542-4cbb-aead-b4475bc3c48d" acquired by "delete_volume" :: waited 0.057s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:23:09 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[2599ce4d-e6e1-453b-9379-14ab287cf41b]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:23:09 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-f00971c4-7720-4751-89fc-1a36d2e8d051 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-715217fc-e542-4cbb-aead-b4475bc3c48d {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:23:09 devstack sudo[100223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-715217fc-e542-4cbb-aead-b4475bc3c48d Aug 29 01:23:09 devstack sudo[100223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:23:09 devstack sudo[100223]: pam_unix(sudo:session): session closed for user root Aug 29 01:23:09 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-f00971c4-7720-4751-89fc-1a36d2e8d051 tempest-CreateVolumesFromSnapshotTest-1872904588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-715217fc-e542-4cbb-aead-b4475bc3c48d" returned: 0 in 0.848s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:23:09 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-f00971c4-7720-4751-89fc-1a36d2e8d051 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-715217fc-e542-4cbb-aead-b4475bc3c48d {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:23:09 devstack sudo[100229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-715217fc-e542-4cbb-aead-b4475bc3c48d Aug 29 01:23:09 devstack sudo[100229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:23:10 devstack sudo[100229]: pam_unix(sudo:session): session closed for user root Aug 29 01:23:10 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-f00971c4-7720-4751-89fc-1a36d2e8d051 tempest-CreateVolumesFromSnapshotTest-1872904588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-715217fc-e542-4cbb-aead-b4475bc3c48d" returned: 0 in 0.512s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:23:10 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-f00971c4-7720-4751-89fc-1a36d2e8d051 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Lock "cinder-quobyte-715217fc-e542-4cbb-aead-b4475bc3c48d" released by "delete_volume" :: held 1.490s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:23:10 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-f00971c4-7720-4751-89fc-1a36d2e8d051 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Created reservations ['9763c7a0-39f5-4d49-ba05-d1a23259751f', '4ce553f3-8cf4-48b9-a52d-39399049edaa', '9d91246c-d128-4729-9da5-35ff691eb7ef', 'a204c824-1792-4cc7-ba6e-f4d3a1373148'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:23:10 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-f00971c4-7720-4751-89fc-1a36d2e8d051 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:23:10 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-f00971c4-7720-4751-89fc-1a36d2e8d051 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:23:10 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-f00971c4-7720-4751-89fc-1a36d2e8d051 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:23:10 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-f00971c4-7720-4751-89fc-1a36d2e8d051 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:23:10 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-f00971c4-7720-4751-89fc-1a36d2e8d051 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:23:10 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-f00971c4-7720-4751-89fc-1a36d2e8d051 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:23:10 devstack sudo[100232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:23:10 devstack sudo[100232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:23:11 devstack sudo[100232]: pam_unix(sudo:session): session closed for user root Aug 29 01:23:11 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-f00971c4-7720-4751-89fc-1a36d2e8d051 tempest-CreateVolumesFromSnapshotTest-1872904588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.307s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:23:11 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-f00971c4-7720-4751-89fc-1a36d2e8d051 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:23:11 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-f00971c4-7720-4751-89fc-1a36d2e8d051 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Deleted volume successfully. Aug 29 01:23:11 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-f00971c4-7720-4751-89fc-1a36d2e8d051 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Lock "cinder-715217fc-e542-4cbb-aead-b4475bc3c48d-delete_volume" released by "delete_volume" :: held 2.363s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:23:11 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-c17e84e3-8475-465f-b561-2e6836faa0d2 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Acquiring lock "cinder-208246bf-7a99-462e-9bec-33b26b59f2c0-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:23:11 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-c17e84e3-8475-465f-b561-2e6836faa0d2 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Lock "cinder-208246bf-7a99-462e-9bec-33b26b59f2c0-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:23:11 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-c17e84e3-8475-465f-b561-2e6836faa0d2 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Acquiring lock "cinder-quobyte-208246bf-7a99-462e-9bec-33b26b59f2c0" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:23:11 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-c17e84e3-8475-465f-b561-2e6836faa0d2 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Lock "cinder-quobyte-208246bf-7a99-462e-9bec-33b26b59f2c0" acquired by "delete_volume" :: waited 0.028s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:23:11 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[347f893f-ff96-4778-9615-c53db5126fae]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:23:11 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c17e84e3-8475-465f-b561-2e6836faa0d2 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-208246bf-7a99-462e-9bec-33b26b59f2c0 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:23:11 devstack sudo[100235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-208246bf-7a99-462e-9bec-33b26b59f2c0 Aug 29 01:23:11 devstack sudo[100235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:23:12 devstack sudo[100235]: pam_unix(sudo:session): session closed for user root Aug 29 01:23:12 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c17e84e3-8475-465f-b561-2e6836faa0d2 tempest-CreateVolumesFromSnapshotTest-1872904588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-208246bf-7a99-462e-9bec-33b26b59f2c0" returned: 0 in 0.762s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:23:12 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c17e84e3-8475-465f-b561-2e6836faa0d2 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-208246bf-7a99-462e-9bec-33b26b59f2c0 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:23:12 devstack sudo[100240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-208246bf-7a99-462e-9bec-33b26b59f2c0 Aug 29 01:23:12 devstack sudo[100240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:23:12 devstack sudo[100240]: pam_unix(sudo:session): session closed for user root Aug 29 01:23:12 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c17e84e3-8475-465f-b561-2e6836faa0d2 tempest-CreateVolumesFromSnapshotTest-1872904588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-208246bf-7a99-462e-9bec-33b26b59f2c0" returned: 0 in 0.390s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:23:12 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-c17e84e3-8475-465f-b561-2e6836faa0d2 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Lock "cinder-quobyte-208246bf-7a99-462e-9bec-33b26b59f2c0" released by "delete_volume" :: held 1.266s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:23:12 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-c17e84e3-8475-465f-b561-2e6836faa0d2 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Created reservations ['4aa9fb16-57bb-49b9-a540-58244cc45f2c', '2aefd17a-16f7-4912-ac3d-1451dde6f2cb', 'dab6a983-85a8-4f1e-ba30-b238d94c959f', '0f7d51aa-c56f-41be-8770-ccc678129cd0'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:23:13 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-c17e84e3-8475-465f-b561-2e6836faa0d2 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:23:13 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-c17e84e3-8475-465f-b561-2e6836faa0d2 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:23:13 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-c17e84e3-8475-465f-b561-2e6836faa0d2 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:23:13 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-c17e84e3-8475-465f-b561-2e6836faa0d2 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:23:13 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-c17e84e3-8475-465f-b561-2e6836faa0d2 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:23:13 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c17e84e3-8475-465f-b561-2e6836faa0d2 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:23:13 devstack sudo[100243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:23:13 devstack sudo[100180]: pam_unix(sudo:session): session closed for user root Aug 29 01:23:13 devstack sudo[100243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:23:13 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-cc83b7bb-67af-427b-ba54-bd3d828c4e88 tempest-VolumesGetTest-954660907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-dc441ad4-2065-4632-a5cb-3054ac0c1ae3 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-07cffb9c-e2e8-40f3-9237-5be146c032e3" returned: 0 in 5.434s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:23:13 devstack cinder-volume[86111]: DEBUG cinder.image.image_utils [None req-cc83b7bb-67af-427b-ba54-bd3d828c4e88 tempest-VolumesGetTest-954660907 None] Image conversion details: src /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-dc441ad4-2065-4632-a5cb-3054ac0c1ae3, size 1024.00 MB, duration 5.43 sec, destination /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-07cffb9c-e2e8-40f3-9237-5be146c032e3 {{(pid=86111) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 29 01:23:13 devstack cinder-volume[86111]: INFO cinder.image.image_utils [None req-cc83b7bb-67af-427b-ba54-bd3d828c4e88 tempest-VolumesGetTest-954660907 None] Converted 1024.00 MB image at 188.41 MB/s Aug 29 01:23:13 devstack cinder-volume[86111]: WARNING cinder.volume.drivers.remotefs [None req-cc83b7bb-67af-427b-ba54-bd3d828c4e88 tempest-VolumesGetTest-954660907 None] /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-07cffb9c-e2e8-40f3-9237-5be146c032e3 is being set with open permissions: ugo+rw Aug 29 01:23:13 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-cc83b7bb-67af-427b-ba54-bd3d828c4e88 tempest-VolumesGetTest-954660907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-07cffb9c-e2e8-40f3-9237-5be146c032e3 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:23:13 devstack sudo[100245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-07cffb9c-e2e8-40f3-9237-5be146c032e3 Aug 29 01:23:13 devstack sudo[100245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:23:13 devstack sudo[100243]: pam_unix(sudo:session): session closed for user root Aug 29 01:23:13 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c17e84e3-8475-465f-b561-2e6836faa0d2 tempest-CreateVolumesFromSnapshotTest-1872904588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.247s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:23:13 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-c17e84e3-8475-465f-b561-2e6836faa0d2 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:23:13 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-c17e84e3-8475-465f-b561-2e6836faa0d2 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Deleted volume successfully. Aug 29 01:23:13 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-c17e84e3-8475-465f-b561-2e6836faa0d2 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Lock "cinder-208246bf-7a99-462e-9bec-33b26b59f2c0-delete_volume" released by "delete_volume" :: held 1.998s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:23:13 devstack sudo[100245]: pam_unix(sudo:session): session closed for user root Aug 29 01:23:13 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-cc83b7bb-67af-427b-ba54-bd3d828c4e88 tempest-VolumesGetTest-954660907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-07cffb9c-e2e8-40f3-9237-5be146c032e3" returned: 0 in 0.259s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:23:13 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-cc83b7bb-67af-427b-ba54-bd3d828c4e88 tempest-VolumesGetTest-954660907 None] Lock "cinder-quobyte-07cffb9c-e2e8-40f3-9237-5be146c032e3" released by "_copy_volume_from_snapshot" :: held 6.744s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:23:13 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-cc83b7bb-67af-427b-ba54-bd3d828c4e88 tempest-VolumesGetTest-954660907 None] Acquiring lock "cinder-quobyte-308218c1-7537-4b6b-b055-7cecc00dc278" by "_delete_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:23:13 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-cc83b7bb-67af-427b-ba54-bd3d828c4e88 tempest-VolumesGetTest-954660907 None] Lock "cinder-quobyte-308218c1-7537-4b6b-b055-7cecc00dc278" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:23:13 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-cc83b7bb-67af-427b-ba54-bd3d828c4e88 tempest-VolumesGetTest-954660907 None] Deleting offline snapshot 308218c1-7537-4b6b-b055-7cecc00dc278 of volume dc441ad4-2065-4632-a5cb-3054ac0c1ae3 {{(pid=86111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 29 01:23:13 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-cc83b7bb-67af-427b-ba54-bd3d828c4e88 tempest-VolumesGetTest-954660907 None] snapshot_file for this snap is: volume-dc441ad4-2065-4632-a5cb-3054ac0c1ae3.308218c1-7537-4b6b-b055-7cecc00dc278 {{(pid=86111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 29 01:23:13 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4c68a22-7a6c-44b1-a350-4eacc8432a5e]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:23:13 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-cc83b7bb-67af-427b-ba54-bd3d828c4e88 tempest-VolumesGetTest-954660907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-dc441ad4-2065-4632-a5cb-3054ac0c1ae3.308218c1-7537-4b6b-b055-7cecc00dc278 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:23:13 devstack sudo[100249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-dc441ad4-2065-4632-a5cb-3054ac0c1ae3.308218c1-7537-4b6b-b055-7cecc00dc278 Aug 29 01:23:13 devstack sudo[100249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:23:13 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-6a1e07e4-364e-4d2b-b86b-ab1039b59a38 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Acquiring lock "cinder-2d74658c-ab26-4d21-9b51-6603bf309fa6-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:23:13 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-6a1e07e4-364e-4d2b-b86b-ab1039b59a38 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Lock "cinder-2d74658c-ab26-4d21-9b51-6603bf309fa6-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:23:13 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-6a1e07e4-364e-4d2b-b86b-ab1039b59a38 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Acquiring lock "cinder-quobyte-2d74658c-ab26-4d21-9b51-6603bf309fa6" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:23:13 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-6a1e07e4-364e-4d2b-b86b-ab1039b59a38 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Lock "cinder-quobyte-2d74658c-ab26-4d21-9b51-6603bf309fa6" acquired by "delete_volume" :: waited 0.014s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:23:13 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[50b627ba-faa5-459b-ba79-932180e46fd9]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:23:13 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-6a1e07e4-364e-4d2b-b86b-ab1039b59a38 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-2d74658c-ab26-4d21-9b51-6603bf309fa6 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:23:13 devstack sudo[100249]: pam_unix(sudo:session): session closed for user root Aug 29 01:23:13 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-cc83b7bb-67af-427b-ba54-bd3d828c4e88 tempest-VolumesGetTest-954660907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-dc441ad4-2065-4632-a5cb-3054ac0c1ae3.308218c1-7537-4b6b-b055-7cecc00dc278" returned: 0 in 0.385s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:23:13 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-cc83b7bb-67af-427b-ba54-bd3d828c4e88 tempest-VolumesGetTest-954660907 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dc441ad4-2065-4632-a5cb-3054ac0c1ae3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 29 01:23:13 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[343caef7-db9d-4b51-a3d0-f4424a1bab76]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:23:13 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-cc83b7bb-67af-427b-ba54-bd3d828c4e88 tempest-VolumesGetTest-954660907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-dc441ad4-2065-4632-a5cb-3054ac0c1ae3 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:23:13 devstack sudo[100254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-2d74658c-ab26-4d21-9b51-6603bf309fa6 Aug 29 01:23:13 devstack sudo[100254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:23:14 devstack sudo[100255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-dc441ad4-2065-4632-a5cb-3054ac0c1ae3 Aug 29 01:23:14 devstack sudo[100255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:23:14 devstack sudo[100254]: pam_unix(sudo:session): session closed for user root Aug 29 01:23:14 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-6a1e07e4-364e-4d2b-b86b-ab1039b59a38 tempest-CreateVolumesFromSnapshotTest-1872904588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-2d74658c-ab26-4d21-9b51-6603bf309fa6" returned: 0 in 0.393s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:23:14 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-6a1e07e4-364e-4d2b-b86b-ab1039b59a38 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-2d74658c-ab26-4d21-9b51-6603bf309fa6 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:23:14 devstack sudo[100263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-2d74658c-ab26-4d21-9b51-6603bf309fa6 Aug 29 01:23:14 devstack sudo[100263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:23:14 devstack sudo[100255]: pam_unix(sudo:session): session closed for user root Aug 29 01:23:14 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-cc83b7bb-67af-427b-ba54-bd3d828c4e88 tempest-VolumesGetTest-954660907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-dc441ad4-2065-4632-a5cb-3054ac0c1ae3" returned: 0 in 0.583s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:23:14 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-cc83b7bb-67af-427b-ba54-bd3d828c4e88 tempest-VolumesGetTest-954660907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-dc441ad4-2065-4632-a5cb-3054ac0c1ae3.308218c1-7537-4b6b-b055-7cecc00dc278 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:23:14 devstack sudo[100263]: pam_unix(sudo:session): session closed for user root Aug 29 01:23:14 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-6a1e07e4-364e-4d2b-b86b-ab1039b59a38 tempest-CreateVolumesFromSnapshotTest-1872904588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-2d74658c-ab26-4d21-9b51-6603bf309fa6" returned: 0 in 0.299s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:23:14 devstack sudo[100267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-dc441ad4-2065-4632-a5cb-3054ac0c1ae3.308218c1-7537-4b6b-b055-7cecc00dc278 Aug 29 01:23:14 devstack sudo[100267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:23:14 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-6a1e07e4-364e-4d2b-b86b-ab1039b59a38 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Lock "cinder-quobyte-2d74658c-ab26-4d21-9b51-6603bf309fa6" released by "delete_volume" :: held 0.735s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:23:14 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-6a1e07e4-364e-4d2b-b86b-ab1039b59a38 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Created reservations ['085fe6e8-2528-4674-8924-a1059218333f', '11986d6d-e812-4efa-92da-147919422453', '212a160f-18f4-4653-a531-dc1d730a925f', 'eedf7685-6bc3-4ce9-a9c4-6edcda6dae28'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:23:14 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-6a1e07e4-364e-4d2b-b86b-ab1039b59a38 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:23:14 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-6a1e07e4-364e-4d2b-b86b-ab1039b59a38 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:23:14 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-6a1e07e4-364e-4d2b-b86b-ab1039b59a38 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:23:14 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-6a1e07e4-364e-4d2b-b86b-ab1039b59a38 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:23:14 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-6a1e07e4-364e-4d2b-b86b-ab1039b59a38 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:23:14 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-6a1e07e4-364e-4d2b-b86b-ab1039b59a38 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:23:14 devstack sudo[100269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:23:14 devstack sudo[100269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:23:14 devstack sudo[100267]: pam_unix(sudo:session): session closed for user root Aug 29 01:23:14 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-cc83b7bb-67af-427b-ba54-bd3d828c4e88 tempest-VolumesGetTest-954660907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-dc441ad4-2065-4632-a5cb-3054ac0c1ae3.308218c1-7537-4b6b-b055-7cecc00dc278" returned: 0 in 0.375s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:23:14 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-cc83b7bb-67af-427b-ba54-bd3d828c4e88 tempest-VolumesGetTest-954660907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-dc441ad4-2065-4632-a5cb-3054ac0c1ae3.308218c1-7537-4b6b-b055-7cecc00dc278 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:23:14 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-b7201e87-af8b-4255-ba90-371964e4c146 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Acquiring lock "cinder-2d46897a-786e-42e8-9264-4132ab40dc56-delete_snapshot" by "delete_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:23:14 devstack sudo[100274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-dc441ad4-2065-4632-a5cb-3054ac0c1ae3.308218c1-7537-4b6b-b055-7cecc00dc278 Aug 29 01:23:14 devstack sudo[100274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:23:14 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-b7201e87-af8b-4255-ba90-371964e4c146 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Lock "cinder-2d46897a-786e-42e8-9264-4132ab40dc56-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:23:14 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-b7201e87-af8b-4255-ba90-371964e4c146 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Acquiring lock "cinder-quobyte-3ece0894-d177-4a56-8078-bd9352672608" by "delete_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:23:14 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-b7201e87-af8b-4255-ba90-371964e4c146 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Lock "cinder-quobyte-3ece0894-d177-4a56-8078-bd9352672608" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:23:14 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-b7201e87-af8b-4255-ba90-371964e4c146 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Acquiring lock "cinder-quobyte-2d46897a-786e-42e8-9264-4132ab40dc56" by "_delete_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:23:14 devstack sudo[100269]: pam_unix(sudo:session): session closed for user root Aug 29 01:23:14 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-6a1e07e4-364e-4d2b-b86b-ab1039b59a38 tempest-CreateVolumesFromSnapshotTest-1872904588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.295s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:23:14 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-6a1e07e4-364e-4d2b-b86b-ab1039b59a38 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:23:14 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-6a1e07e4-364e-4d2b-b86b-ab1039b59a38 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Deleted volume successfully. Aug 29 01:23:14 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-b7201e87-af8b-4255-ba90-371964e4c146 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Lock "cinder-quobyte-2d46897a-786e-42e8-9264-4132ab40dc56" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:23:14 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-b7201e87-af8b-4255-ba90-371964e4c146 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Deleting offline snapshot 2d46897a-786e-42e8-9264-4132ab40dc56 of volume 3ece0894-d177-4a56-8078-bd9352672608 {{(pid=86111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 29 01:23:15 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-b7201e87-af8b-4255-ba90-371964e4c146 tempest-CreateVolumesFromSnapshotTest-1872904588 None] snapshot_file for this snap is: volume-3ece0894-d177-4a56-8078-bd9352672608.2d46897a-786e-42e8-9264-4132ab40dc56 {{(pid=86111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 29 01:23:15 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[00a8bab3-6fef-4c90-98dd-8130f605fd73]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:23:15 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-b7201e87-af8b-4255-ba90-371964e4c146 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3ece0894-d177-4a56-8078-bd9352672608.2d46897a-786e-42e8-9264-4132ab40dc56 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:23:15 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-6a1e07e4-364e-4d2b-b86b-ab1039b59a38 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Lock "cinder-2d74658c-ab26-4d21-9b51-6603bf309fa6-delete_volume" released by "delete_volume" :: held 1.324s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:23:15 devstack sudo[100277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3ece0894-d177-4a56-8078-bd9352672608.2d46897a-786e-42e8-9264-4132ab40dc56 Aug 29 01:23:15 devstack sudo[100277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:23:15 devstack sudo[100274]: pam_unix(sudo:session): session closed for user root Aug 29 01:23:15 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-cc83b7bb-67af-427b-ba54-bd3d828c4e88 tempest-VolumesGetTest-954660907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-dc441ad4-2065-4632-a5cb-3054ac0c1ae3.308218c1-7537-4b6b-b055-7cecc00dc278" returned: 0 in 0.375s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:23:15 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-cc83b7bb-67af-427b-ba54-bd3d828c4e88 tempest-VolumesGetTest-954660907 None] Lock "cinder-quobyte-308218c1-7537-4b6b-b055-7cecc00dc278" released by "_delete_snapshot" :: held 1.834s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:23:15 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-cc83b7bb-67af-427b-ba54-bd3d828c4e88 tempest-VolumesGetTest-954660907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.540s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:23:15 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-3f3b11de-1fc4-47ae-a39c-400a653efeb4 tempest-ProjectReaderTests-1690395873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.864s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:23:15 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-3f3b11de-1fc4-47ae-a39c-400a653efeb4 tempest-ProjectReaderTests-1690395873 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:23:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1538911282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ceff73d2-2974-4d49-a220-43911129f546,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94d43c17f1544685a67db2bf45ebdca1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:23:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:23:07Z,use_quota=True,user_id='9c7b7dcd643440a792fbb37f30c2e7b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:23:15 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-3f3b11de-1fc4-47ae-a39c-400a653efeb4 tempest-ProjectReaderTests-1690395873 None] Creating volume ceff73d2-2974-4d49-a220-43911129f546 {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:23:15 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-3f3b11de-1fc4-47ae-a39c-400a653efeb4 tempest-ProjectReaderTests-1690395873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:23:15 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-3f3b11de-1fc4-47ae-a39c-400a653efeb4 tempest-ProjectReaderTests-1690395873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:23:15 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-3f3b11de-1fc4-47ae-a39c-400a653efeb4 tempest-ProjectReaderTests-1690395873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:23:15 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-3f3b11de-1fc4-47ae-a39c-400a653efeb4 tempest-ProjectReaderTests-1690395873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:23:15 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-3f3b11de-1fc4-47ae-a39c-400a653efeb4 tempest-ProjectReaderTests-1690395873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:23:15 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-3f3b11de-1fc4-47ae-a39c-400a653efeb4 tempest-ProjectReaderTests-1690395873 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:23:15 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-3f3b11de-1fc4-47ae-a39c-400a653efeb4 tempest-ProjectReaderTests-1690395873 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:23:15 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-3f3b11de-1fc4-47ae-a39c-400a653efeb4 tempest-ProjectReaderTests-1690395873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ceff73d2-2974-4d49-a220-43911129f546 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:23:15 devstack sudo[100280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ceff73d2-2974-4d49-a220-43911129f546 1073741824 Aug 29 01:23:15 devstack sudo[100280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:23:15 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-cc83b7bb-67af-427b-ba54-bd3d828c4e88 tempest-VolumesGetTest-954660907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35ba9f69-eb50-4c0a-8596-5d24bc38dae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07cffb9c-e2e8-40f3-9237-5be146c032e3', 'volume_size': 1, 'source_volid': 'dc441ad4-2065-4632-a5cb-3054ac0c1ae3', 'source_volstatus': 'available'}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:23:15 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-cc83b7bb-67af-427b-ba54-bd3d828c4e88 tempest-VolumesGetTest-954660907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40013284-240d-4e86-9e0c-e26b56993234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:23:15 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-cc83b7bb-67af-427b-ba54-bd3d828c4e88 tempest-VolumesGetTest-954660907 None] Volume volume-07cffb9c-e2e8-40f3-9237-5be146c032e3 (07cffb9c-e2e8-40f3-9237-5be146c032e3): created successfully Aug 29 01:23:15 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-cc83b7bb-67af-427b-ba54-bd3d828c4e88 tempest-VolumesGetTest-954660907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40013284-240d-4e86-9e0c-e26b56993234) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:23:15 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-cc83b7bb-67af-427b-ba54-bd3d828c4e88 tempest-VolumesGetTest-954660907 None] Flow 'volume_create_manager' (826f0ade-e7b6-455c-a6ed-6cb49f682db7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:23:15 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-cc83b7bb-67af-427b-ba54-bd3d828c4e88 tempest-VolumesGetTest-954660907 None] Created volume successfully. Aug 29 01:23:15 devstack sudo[100277]: pam_unix(sudo:session): session closed for user root Aug 29 01:23:15 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-b7201e87-af8b-4255-ba90-371964e4c146 tempest-CreateVolumesFromSnapshotTest-1872904588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3ece0894-d177-4a56-8078-bd9352672608.2d46897a-786e-42e8-9264-4132ab40dc56" returned: 0 in 0.417s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:23:15 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-b7201e87-af8b-4255-ba90-371964e4c146 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3ece0894-d177-4a56-8078-bd9352672608(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 29 01:23:15 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[c379bdf8-9ee9-4b7f-9720-0bcb0c67ab9e]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:23:15 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-b7201e87-af8b-4255-ba90-371964e4c146 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3ece0894-d177-4a56-8078-bd9352672608 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:23:15 devstack sudo[100285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3ece0894-d177-4a56-8078-bd9352672608 Aug 29 01:23:15 devstack sudo[100285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:23:15 devstack sudo[100280]: pam_unix(sudo:session): session closed for user root Aug 29 01:23:15 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-3f3b11de-1fc4-47ae-a39c-400a653efeb4 tempest-ProjectReaderTests-1690395873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ceff73d2-2974-4d49-a220-43911129f546 1073741824" returned: 0 in 0.484s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:23:15 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-3f3b11de-1fc4-47ae-a39c-400a653efeb4 tempest-ProjectReaderTests-1690395873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ceff73d2-2974-4d49-a220-43911129f546 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:23:15 devstack sudo[100292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ceff73d2-2974-4d49-a220-43911129f546 Aug 29 01:23:15 devstack sudo[100292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:23:15 devstack sudo[100285]: pam_unix(sudo:session): session closed for user root Aug 29 01:23:15 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-b7201e87-af8b-4255-ba90-371964e4c146 tempest-CreateVolumesFromSnapshotTest-1872904588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3ece0894-d177-4a56-8078-bd9352672608" returned: 0 in 0.434s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:23:15 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-b7201e87-af8b-4255-ba90-371964e4c146 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3ece0894-d177-4a56-8078-bd9352672608.2d46897a-786e-42e8-9264-4132ab40dc56 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:23:15 devstack sudo[100295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3ece0894-d177-4a56-8078-bd9352672608.2d46897a-786e-42e8-9264-4132ab40dc56 Aug 29 01:23:15 devstack sudo[100295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:23:16 devstack sudo[100292]: pam_unix(sudo:session): session closed for user root Aug 29 01:23:16 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-3f3b11de-1fc4-47ae-a39c-400a653efeb4 tempest-ProjectReaderTests-1690395873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ceff73d2-2974-4d49-a220-43911129f546" returned: 0 in 0.269s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:23:16 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-3f3b11de-1fc4-47ae-a39c-400a653efeb4 tempest-ProjectReaderTests-1690395873 None] <== create_volume: return (802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:23:16 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-3f3b11de-1fc4-47ae-a39c-400a653efeb4 tempest-ProjectReaderTests-1690395873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.805s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:23:16 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-3f3b11de-1fc4-47ae-a39c-400a653efeb4 tempest-ProjectReaderTests-1690395873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f456b6c8-a1ef-439f-a01e-47eec4ed8a22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ceff73d2-2974-4d49-a220-43911129f546', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:23:16 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-3f3b11de-1fc4-47ae-a39c-400a653efeb4 tempest-ProjectReaderTests-1690395873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f20126e-d952-4395-85c6-0974e5844bb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:23:16 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-3f3b11de-1fc4-47ae-a39c-400a653efeb4 tempest-ProjectReaderTests-1690395873 None] Volume volume-ceff73d2-2974-4d49-a220-43911129f546 (ceff73d2-2974-4d49-a220-43911129f546): created successfully Aug 29 01:23:16 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-3f3b11de-1fc4-47ae-a39c-400a653efeb4 tempest-ProjectReaderTests-1690395873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f20126e-d952-4395-85c6-0974e5844bb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:23:16 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-3f3b11de-1fc4-47ae-a39c-400a653efeb4 tempest-ProjectReaderTests-1690395873 None] Flow 'volume_create_manager' (bf49c7a3-e1ac-47ba-ac2f-b5a50c2b6fee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:23:16 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-3f3b11de-1fc4-47ae-a39c-400a653efeb4 tempest-ProjectReaderTests-1690395873 None] Created volume successfully. Aug 29 01:23:16 devstack sudo[100295]: pam_unix(sudo:session): session closed for user root Aug 29 01:23:16 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-b7201e87-af8b-4255-ba90-371964e4c146 tempest-CreateVolumesFromSnapshotTest-1872904588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3ece0894-d177-4a56-8078-bd9352672608.2d46897a-786e-42e8-9264-4132ab40dc56" returned: 0 in 0.388s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:23:16 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-b7201e87-af8b-4255-ba90-371964e4c146 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3ece0894-d177-4a56-8078-bd9352672608.2d46897a-786e-42e8-9264-4132ab40dc56 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:23:16 devstack sudo[100301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3ece0894-d177-4a56-8078-bd9352672608.2d46897a-786e-42e8-9264-4132ab40dc56 Aug 29 01:23:16 devstack sudo[100301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:23:16 devstack sudo[100301]: pam_unix(sudo:session): session closed for user root Aug 29 01:23:16 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-b7201e87-af8b-4255-ba90-371964e4c146 tempest-CreateVolumesFromSnapshotTest-1872904588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3ece0894-d177-4a56-8078-bd9352672608.2d46897a-786e-42e8-9264-4132ab40dc56" returned: 0 in 0.258s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:23:16 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-b7201e87-af8b-4255-ba90-371964e4c146 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Lock "cinder-quobyte-2d46897a-786e-42e8-9264-4132ab40dc56" released by "_delete_snapshot" :: held 1.633s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:23:16 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-b7201e87-af8b-4255-ba90-371964e4c146 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Lock "cinder-quobyte-3ece0894-d177-4a56-8078-bd9352672608" released by "delete_snapshot" :: held 1.679s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:23:16 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-b7201e87-af8b-4255-ba90-371964e4c146 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Created reservations ['c307f078-5f46-43ff-a65b-5f32b651e3ff', 'a0d49525-8c07-4a47-b5dd-f77ef8c5f23c', '3d7ed3dc-2140-409a-b0f9-2edda8d90276', 'c53be2d1-4d5b-4e46-8fa8-b608cc3d2282'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:23:16 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-b7201e87-af8b-4255-ba90-371964e4c146 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Delete snapshot completed successfully. Aug 29 01:23:16 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-b7201e87-af8b-4255-ba90-371964e4c146 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Lock "cinder-2d46897a-786e-42e8-9264-4132ab40dc56-delete_snapshot" released by "delete_snapshot" :: held 1.838s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:23:16 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-d77815c7-be83-465f-8c0f-f3d959011e60 tempest-VolumesGetTest-954660907 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:23:16 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-d77815c7-be83-465f-8c0f-f3d959011e60 tempest-VolumesGetTest-954660907 None] Flow 'volume_create_manager' (e10fcda9-8719-4d70-b364-18c94688a74e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:23:16 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-d77815c7-be83-465f-8c0f-f3d959011e60 tempest-VolumesGetTest-954660907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f789bb13-2ee7-4d39-82d9-a61fd0044237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:23:16 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-d77815c7-be83-465f-8c0f-f3d959011e60 tempest-VolumesGetTest-954660907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f789bb13-2ee7-4d39-82d9-a61fd0044237) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:23:17Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1130050059',display_name='tempest-VolumesGetTest-Volume-107479999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22a91a02-add2-405b-9ab2-8b2dc96b1555,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c4c32927df54b70ae25b85da6abe7ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:23:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:23:17Z,use_quota=True,user_id='6d651c7f6792483d90119c301b2dd999',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:23:16 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-d77815c7-be83-465f-8c0f-f3d959011e60 tempest-VolumesGetTest-954660907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6260f54-6cb8-4bb5-8856-c234b5f812ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:23:16 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-d77815c7-be83-465f-8c0f-f3d959011e60 tempest-VolumesGetTest-954660907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6260f54-6cb8-4bb5-8856-c234b5f812ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:23:16 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-d77815c7-be83-465f-8c0f-f3d959011e60 tempest-VolumesGetTest-954660907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56bfdddc-0283-40bd-974e-6f1cff4523e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:23:16 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-d77815c7-be83-465f-8c0f-f3d959011e60 tempest-VolumesGetTest-954660907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56bfdddc-0283-40bd-974e-6f1cff4523e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22a91a02-add2-405b-9ab2-8b2dc96b1555', 'volume_name': 'volume-22a91a02-add2-405b-9ab2-8b2dc96b1555', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:23:16 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-d77815c7-be83-465f-8c0f-f3d959011e60 tempest-VolumesGetTest-954660907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3592989c-7fae-4cb4-b0f3-17390884bb52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:23:16 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-d77815c7-be83-465f-8c0f-f3d959011e60 tempest-VolumesGetTest-954660907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3592989c-7fae-4cb4-b0f3-17390884bb52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:23:16 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-d77815c7-be83-465f-8c0f-f3d959011e60 tempest-VolumesGetTest-954660907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33dd581e-aee1-435b-8855-3dc02ad5b83a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:23:16 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-d77815c7-be83-465f-8c0f-f3d959011e60 tempest-VolumesGetTest-954660907 None] Volume 22a91a02-add2-405b-9ab2-8b2dc96b1555: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22a91a02-add2-405b-9ab2-8b2dc96b1555', 'volume_size': 1} Aug 29 01:23:16 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-d77815c7-be83-465f-8c0f-f3d959011e60 tempest-VolumesGetTest-954660907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:23:16 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-d77815c7-be83-465f-8c0f-f3d959011e60 tempest-VolumesGetTest-954660907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:23:16 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-d77815c7-be83-465f-8c0f-f3d959011e60 tempest-VolumesGetTest-954660907 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:23:17Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1130050059',display_name='tempest-VolumesGetTest-Volume-107479999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22a91a02-add2-405b-9ab2-8b2dc96b1555,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c4c32927df54b70ae25b85da6abe7ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:23:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:23:17Z,use_quota=True,user_id='6d651c7f6792483d90119c301b2dd999',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:23:16 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-d77815c7-be83-465f-8c0f-f3d959011e60 tempest-VolumesGetTest-954660907 None] Creating volume 22a91a02-add2-405b-9ab2-8b2dc96b1555 {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:23:16 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-d77815c7-be83-465f-8c0f-f3d959011e60 tempest-VolumesGetTest-954660907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:23:16 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-d77815c7-be83-465f-8c0f-f3d959011e60 tempest-VolumesGetTest-954660907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:23:16 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-d77815c7-be83-465f-8c0f-f3d959011e60 tempest-VolumesGetTest-954660907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:23:16 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-d77815c7-be83-465f-8c0f-f3d959011e60 tempest-VolumesGetTest-954660907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:23:16 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-d77815c7-be83-465f-8c0f-f3d959011e60 tempest-VolumesGetTest-954660907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:23:16 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-d77815c7-be83-465f-8c0f-f3d959011e60 tempest-VolumesGetTest-954660907 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:23:16 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-d77815c7-be83-465f-8c0f-f3d959011e60 tempest-VolumesGetTest-954660907 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:23:16 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d77815c7-be83-465f-8c0f-f3d959011e60 tempest-VolumesGetTest-954660907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-22a91a02-add2-405b-9ab2-8b2dc96b1555 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:23:17 devstack sudo[100304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-22a91a02-add2-405b-9ab2-8b2dc96b1555 1073741824 Aug 29 01:23:17 devstack sudo[100304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:23:17 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-5be2802a-158d-4586-8367-af2db2eb9785 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Acquiring lock "cinder-3ece0894-d177-4a56-8078-bd9352672608-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:23:17 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-5be2802a-158d-4586-8367-af2db2eb9785 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Lock "cinder-3ece0894-d177-4a56-8078-bd9352672608-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:23:17 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-5be2802a-158d-4586-8367-af2db2eb9785 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Acquiring lock "cinder-quobyte-3ece0894-d177-4a56-8078-bd9352672608" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:23:17 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-5be2802a-158d-4586-8367-af2db2eb9785 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Lock "cinder-quobyte-3ece0894-d177-4a56-8078-bd9352672608" acquired by "delete_volume" :: waited 0.014s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:23:17 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cee7cea-234f-4de4-a9f9-3fd98476182a]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:23:17 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-5be2802a-158d-4586-8367-af2db2eb9785 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3ece0894-d177-4a56-8078-bd9352672608 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:23:17 devstack sudo[100308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3ece0894-d177-4a56-8078-bd9352672608 Aug 29 01:23:17 devstack sudo[100308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:23:17 devstack sudo[100304]: pam_unix(sudo:session): session closed for user root Aug 29 01:23:17 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d77815c7-be83-465f-8c0f-f3d959011e60 tempest-VolumesGetTest-954660907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-22a91a02-add2-405b-9ab2-8b2dc96b1555 1073741824" returned: 0 in 0.485s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:23:17 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-d48051a0-6824-4c8d-91d8-53c3bd854be9 tempest-ProjectReaderTests-1690395873 None] Acquiring lock "cinder-ceff73d2-2974-4d49-a220-43911129f546-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:23:17 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d77815c7-be83-465f-8c0f-f3d959011e60 tempest-VolumesGetTest-954660907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-22a91a02-add2-405b-9ab2-8b2dc96b1555 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:23:17 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-d48051a0-6824-4c8d-91d8-53c3bd854be9 tempest-ProjectReaderTests-1690395873 None] Lock "cinder-ceff73d2-2974-4d49-a220-43911129f546-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:23:17 devstack sudo[100312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-22a91a02-add2-405b-9ab2-8b2dc96b1555 Aug 29 01:23:17 devstack sudo[100312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:23:17 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-d48051a0-6824-4c8d-91d8-53c3bd854be9 tempest-ProjectReaderTests-1690395873 None] Acquiring lock "cinder-quobyte-ceff73d2-2974-4d49-a220-43911129f546" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:23:17 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-d48051a0-6824-4c8d-91d8-53c3bd854be9 tempest-ProjectReaderTests-1690395873 None] Lock "cinder-quobyte-ceff73d2-2974-4d49-a220-43911129f546" acquired by "delete_volume" :: waited 0.017s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:23:17 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdf3f427-259a-44a4-b315-56244b8de89f]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:23:17 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d48051a0-6824-4c8d-91d8-53c3bd854be9 tempest-ProjectReaderTests-1690395873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ceff73d2-2974-4d49-a220-43911129f546 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:23:17 devstack sudo[100308]: pam_unix(sudo:session): session closed for user root Aug 29 01:23:17 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-5be2802a-158d-4586-8367-af2db2eb9785 tempest-CreateVolumesFromSnapshotTest-1872904588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3ece0894-d177-4a56-8078-bd9352672608" returned: 0 in 0.438s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:23:17 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-5be2802a-158d-4586-8367-af2db2eb9785 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3ece0894-d177-4a56-8078-bd9352672608 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:23:17 devstack sudo[100318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3ece0894-d177-4a56-8078-bd9352672608 Aug 29 01:23:17 devstack sudo[100318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:23:17 devstack sudo[100317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ceff73d2-2974-4d49-a220-43911129f546 Aug 29 01:23:17 devstack sudo[100317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:23:17 devstack sudo[100312]: pam_unix(sudo:session): session closed for user root Aug 29 01:23:17 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d77815c7-be83-465f-8c0f-f3d959011e60 tempest-VolumesGetTest-954660907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-22a91a02-add2-405b-9ab2-8b2dc96b1555" returned: 0 in 0.291s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:23:17 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-d77815c7-be83-465f-8c0f-f3d959011e60 tempest-VolumesGetTest-954660907 None] <== create_volume: return (829ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:23:17 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-d77815c7-be83-465f-8c0f-f3d959011e60 tempest-VolumesGetTest-954660907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.832s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:23:17 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-d77815c7-be83-465f-8c0f-f3d959011e60 tempest-VolumesGetTest-954660907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33dd581e-aee1-435b-8855-3dc02ad5b83a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22a91a02-add2-405b-9ab2-8b2dc96b1555', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:23:17 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-d77815c7-be83-465f-8c0f-f3d959011e60 tempest-VolumesGetTest-954660907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ca7e57f-cd99-45d0-a4e3-c5807f4e445c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:23:17 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-d77815c7-be83-465f-8c0f-f3d959011e60 tempest-VolumesGetTest-954660907 None] Volume volume-22a91a02-add2-405b-9ab2-8b2dc96b1555 (22a91a02-add2-405b-9ab2-8b2dc96b1555): created successfully Aug 29 01:23:17 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-d77815c7-be83-465f-8c0f-f3d959011e60 tempest-VolumesGetTest-954660907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ca7e57f-cd99-45d0-a4e3-c5807f4e445c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:23:17 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-d77815c7-be83-465f-8c0f-f3d959011e60 tempest-VolumesGetTest-954660907 None] Flow 'volume_create_manager' (e10fcda9-8719-4d70-b364-18c94688a74e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:23:17 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-d77815c7-be83-465f-8c0f-f3d959011e60 tempest-VolumesGetTest-954660907 None] Created volume successfully. Aug 29 01:23:17 devstack sudo[100318]: pam_unix(sudo:session): session closed for user root Aug 29 01:23:17 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-5be2802a-158d-4586-8367-af2db2eb9785 tempest-CreateVolumesFromSnapshotTest-1872904588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3ece0894-d177-4a56-8078-bd9352672608" returned: 0 in 0.266s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:23:17 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-5be2802a-158d-4586-8367-af2db2eb9785 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Lock "cinder-quobyte-3ece0894-d177-4a56-8078-bd9352672608" released by "delete_volume" :: held 0.775s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:23:17 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-5be2802a-158d-4586-8367-af2db2eb9785 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Created reservations ['9c5930c4-a956-41f5-822a-f63f14cf073a', '06369317-9241-4cf8-8830-ff10daf068e1', 'b6c718cc-ddec-4754-bc0a-257948cf4a39', 'cbe750b0-3515-4df2-8d30-1260ea7bad1a'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:23:18 devstack sudo[100317]: pam_unix(sudo:session): session closed for user root Aug 29 01:23:18 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d48051a0-6824-4c8d-91d8-53c3bd854be9 tempest-ProjectReaderTests-1690395873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ceff73d2-2974-4d49-a220-43911129f546" returned: 0 in 0.404s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:23:18 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d48051a0-6824-4c8d-91d8-53c3bd854be9 tempest-ProjectReaderTests-1690395873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ceff73d2-2974-4d49-a220-43911129f546 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:23:18 devstack sudo[100326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ceff73d2-2974-4d49-a220-43911129f546 Aug 29 01:23:18 devstack sudo[100326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:23:18 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-5be2802a-158d-4586-8367-af2db2eb9785 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:23:18 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-5be2802a-158d-4586-8367-af2db2eb9785 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:23:18 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-5be2802a-158d-4586-8367-af2db2eb9785 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:23:18 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-5be2802a-158d-4586-8367-af2db2eb9785 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:23:18 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-5be2802a-158d-4586-8367-af2db2eb9785 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:23:18 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-5be2802a-158d-4586-8367-af2db2eb9785 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:23:18 devstack sudo[100328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:23:18 devstack sudo[100328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:23:18 devstack sudo[100326]: pam_unix(sudo:session): session closed for user root Aug 29 01:23:18 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d48051a0-6824-4c8d-91d8-53c3bd854be9 tempest-ProjectReaderTests-1690395873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ceff73d2-2974-4d49-a220-43911129f546" returned: 0 in 0.250s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:23:18 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-d48051a0-6824-4c8d-91d8-53c3bd854be9 tempest-ProjectReaderTests-1690395873 None] Lock "cinder-quobyte-ceff73d2-2974-4d49-a220-43911129f546" released by "delete_volume" :: held 0.698s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:23:18 devstack sudo[100328]: pam_unix(sudo:session): session closed for user root Aug 29 01:23:18 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-5be2802a-158d-4586-8367-af2db2eb9785 tempest-CreateVolumesFromSnapshotTest-1872904588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.262s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:23:18 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-5be2802a-158d-4586-8367-af2db2eb9785 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:23:18 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-5be2802a-158d-4586-8367-af2db2eb9785 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Deleted volume successfully. Aug 29 01:23:18 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-d48051a0-6824-4c8d-91d8-53c3bd854be9 tempest-ProjectReaderTests-1690395873 None] Created reservations ['d5b14667-4188-4f6f-a394-05721efc91a6', '662665d8-213d-4521-afee-0bc00d4adec2', 'd4a53b4c-d45b-4664-b76a-dc9c8a7d6cc1', 'f93136b2-440a-4c81-90b6-f22c2ffa3dfb'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:23:18 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-5be2802a-158d-4586-8367-af2db2eb9785 tempest-CreateVolumesFromSnapshotTest-1872904588 None] Lock "cinder-3ece0894-d177-4a56-8078-bd9352672608-delete_volume" released by "delete_volume" :: held 1.298s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:23:18 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-d48051a0-6824-4c8d-91d8-53c3bd854be9 tempest-ProjectReaderTests-1690395873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:23:18 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-d48051a0-6824-4c8d-91d8-53c3bd854be9 tempest-ProjectReaderTests-1690395873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:23:18 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-d48051a0-6824-4c8d-91d8-53c3bd854be9 tempest-ProjectReaderTests-1690395873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:23:18 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-d48051a0-6824-4c8d-91d8-53c3bd854be9 tempest-ProjectReaderTests-1690395873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:23:18 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-d48051a0-6824-4c8d-91d8-53c3bd854be9 tempest-ProjectReaderTests-1690395873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:23:18 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d48051a0-6824-4c8d-91d8-53c3bd854be9 tempest-ProjectReaderTests-1690395873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:23:18 devstack sudo[100332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:23:18 devstack sudo[100332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:23:18 devstack sudo[100332]: pam_unix(sudo:session): session closed for user root Aug 29 01:23:18 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d48051a0-6824-4c8d-91d8-53c3bd854be9 tempest-ProjectReaderTests-1690395873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.258s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:23:18 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-d48051a0-6824-4c8d-91d8-53c3bd854be9 tempest-ProjectReaderTests-1690395873 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:23:18 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-d48051a0-6824-4c8d-91d8-53c3bd854be9 tempest-ProjectReaderTests-1690395873 None] Deleted volume successfully. Aug 29 01:23:18 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-d48051a0-6824-4c8d-91d8-53c3bd854be9 tempest-ProjectReaderTests-1690395873 None] Lock "cinder-ceff73d2-2974-4d49-a220-43911129f546-delete_volume" released by "delete_volume" :: held 1.195s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:23:19 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-707593ac-1fda-49e2-ba8c-ba6870a93441 tempest-VolumesGetTest-954660907 None] Acquiring lock "cinder-22a91a02-add2-405b-9ab2-8b2dc96b1555-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:23:19 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-707593ac-1fda-49e2-ba8c-ba6870a93441 tempest-VolumesGetTest-954660907 None] Lock "cinder-22a91a02-add2-405b-9ab2-8b2dc96b1555-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:23:19 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-40c8b4ae-3708-4de9-907f-6b5926434f81 tempest-ProjectReaderTests-1690395873 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:23:19 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-40c8b4ae-3708-4de9-907f-6b5926434f81 tempest-ProjectReaderTests-1690395873 None] Flow 'volume_create_manager' (d09b3363-69bf-43ec-8092-3410d6d52962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:23:19 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-40c8b4ae-3708-4de9-907f-6b5926434f81 tempest-ProjectReaderTests-1690395873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (255b9d8a-b6e6-426d-8238-ad3ee77e3dbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:23:19 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-707593ac-1fda-49e2-ba8c-ba6870a93441 tempest-VolumesGetTest-954660907 None] Acquiring lock "cinder-quobyte-22a91a02-add2-405b-9ab2-8b2dc96b1555" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:23:19 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-40c8b4ae-3708-4de9-907f-6b5926434f81 tempest-ProjectReaderTests-1690395873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (255b9d8a-b6e6-426d-8238-ad3ee77e3dbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:23:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1610851444',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd100276-713e-4093-a628-809d3c2e8981,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94d43c17f1544685a67db2bf45ebdca1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:23:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:23:19Z,use_quota=True,user_id='9c7b7dcd643440a792fbb37f30c2e7b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:23:19 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-40c8b4ae-3708-4de9-907f-6b5926434f81 tempest-ProjectReaderTests-1690395873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37571476-a763-4844-816a-7d4db854b63a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:23:19 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-40c8b4ae-3708-4de9-907f-6b5926434f81 tempest-ProjectReaderTests-1690395873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37571476-a763-4844-816a-7d4db854b63a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:23:19 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-40c8b4ae-3708-4de9-907f-6b5926434f81 tempest-ProjectReaderTests-1690395873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25d3443d-3bc3-4585-88ac-e92ceed72c16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:23:19 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-40c8b4ae-3708-4de9-907f-6b5926434f81 tempest-ProjectReaderTests-1690395873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25d3443d-3bc3-4585-88ac-e92ceed72c16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd100276-713e-4093-a628-809d3c2e8981', 'volume_name': 'volume-fd100276-713e-4093-a628-809d3c2e8981', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:23:19 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-40c8b4ae-3708-4de9-907f-6b5926434f81 tempest-ProjectReaderTests-1690395873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01154651-7954-4e06-ab52-4d1bca169c29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:23:19 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-40c8b4ae-3708-4de9-907f-6b5926434f81 tempest-ProjectReaderTests-1690395873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01154651-7954-4e06-ab52-4d1bca169c29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:23:19 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-40c8b4ae-3708-4de9-907f-6b5926434f81 tempest-ProjectReaderTests-1690395873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (649337e0-b921-466a-9a2a-0e1f3c3d6182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:23:19 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-40c8b4ae-3708-4de9-907f-6b5926434f81 tempest-ProjectReaderTests-1690395873 None] Volume fd100276-713e-4093-a628-809d3c2e8981: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd100276-713e-4093-a628-809d3c2e8981', 'volume_size': 1} Aug 29 01:23:19 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-40c8b4ae-3708-4de9-907f-6b5926434f81 tempest-ProjectReaderTests-1690395873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:23:19 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-40c8b4ae-3708-4de9-907f-6b5926434f81 tempest-ProjectReaderTests-1690395873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:23:19 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-40c8b4ae-3708-4de9-907f-6b5926434f81 tempest-ProjectReaderTests-1690395873 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:23:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1610851444',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd100276-713e-4093-a628-809d3c2e8981,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94d43c17f1544685a67db2bf45ebdca1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:23:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:23:19Z,use_quota=True,user_id='9c7b7dcd643440a792fbb37f30c2e7b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:23:19 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-40c8b4ae-3708-4de9-907f-6b5926434f81 tempest-ProjectReaderTests-1690395873 None] Creating volume fd100276-713e-4093-a628-809d3c2e8981 {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:23:19 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-40c8b4ae-3708-4de9-907f-6b5926434f81 tempest-ProjectReaderTests-1690395873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:23:19 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-40c8b4ae-3708-4de9-907f-6b5926434f81 tempest-ProjectReaderTests-1690395873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:23:19 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-40c8b4ae-3708-4de9-907f-6b5926434f81 tempest-ProjectReaderTests-1690395873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:23:19 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-40c8b4ae-3708-4de9-907f-6b5926434f81 tempest-ProjectReaderTests-1690395873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:23:19 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-40c8b4ae-3708-4de9-907f-6b5926434f81 tempest-ProjectReaderTests-1690395873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:23:19 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-40c8b4ae-3708-4de9-907f-6b5926434f81 tempest-ProjectReaderTests-1690395873 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:23:19 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-40c8b4ae-3708-4de9-907f-6b5926434f81 tempest-ProjectReaderTests-1690395873 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:23:19 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-40c8b4ae-3708-4de9-907f-6b5926434f81 tempest-ProjectReaderTests-1690395873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-fd100276-713e-4093-a628-809d3c2e8981 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:23:19 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-707593ac-1fda-49e2-ba8c-ba6870a93441 tempest-VolumesGetTest-954660907 None] Lock "cinder-quobyte-22a91a02-add2-405b-9ab2-8b2dc96b1555" acquired by "delete_volume" :: waited 0.101s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:23:19 devstack sudo[100336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-fd100276-713e-4093-a628-809d3c2e8981 1073741824 Aug 29 01:23:19 devstack sudo[100336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:23:19 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[3666950e-4f34-409e-9239-2a4965c9d4a8]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:23:19 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-707593ac-1fda-49e2-ba8c-ba6870a93441 tempest-VolumesGetTest-954660907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-22a91a02-add2-405b-9ab2-8b2dc96b1555 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:23:19 devstack sudo[100338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-22a91a02-add2-405b-9ab2-8b2dc96b1555 Aug 29 01:23:19 devstack sudo[100338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:23:19 devstack sudo[100338]: pam_unix(sudo:session): session closed for user root Aug 29 01:23:19 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-707593ac-1fda-49e2-ba8c-ba6870a93441 tempest-VolumesGetTest-954660907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-22a91a02-add2-405b-9ab2-8b2dc96b1555" returned: 0 in 0.417s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:23:19 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-707593ac-1fda-49e2-ba8c-ba6870a93441 tempest-VolumesGetTest-954660907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-22a91a02-add2-405b-9ab2-8b2dc96b1555 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:23:19 devstack sudo[100336]: pam_unix(sudo:session): session closed for user root Aug 29 01:23:19 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-40c8b4ae-3708-4de9-907f-6b5926434f81 tempest-ProjectReaderTests-1690395873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-fd100276-713e-4093-a628-809d3c2e8981 1073741824" returned: 0 in 0.494s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:23:19 devstack sudo[100347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-22a91a02-add2-405b-9ab2-8b2dc96b1555 Aug 29 01:23:19 devstack sudo[100347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:23:19 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-40c8b4ae-3708-4de9-907f-6b5926434f81 tempest-ProjectReaderTests-1690395873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-fd100276-713e-4093-a628-809d3c2e8981 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:23:19 devstack sudo[100349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-fd100276-713e-4093-a628-809d3c2e8981 Aug 29 01:23:19 devstack sudo[100349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:23:20 devstack sudo[100347]: pam_unix(sudo:session): session closed for user root Aug 29 01:23:20 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-707593ac-1fda-49e2-ba8c-ba6870a93441 tempest-VolumesGetTest-954660907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-22a91a02-add2-405b-9ab2-8b2dc96b1555" returned: 0 in 0.261s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:23:20 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-707593ac-1fda-49e2-ba8c-ba6870a93441 tempest-VolumesGetTest-954660907 None] Lock "cinder-quobyte-22a91a02-add2-405b-9ab2-8b2dc96b1555" released by "delete_volume" :: held 0.744s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:23:20 devstack sudo[100349]: pam_unix(sudo:session): session closed for user root Aug 29 01:23:20 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-40c8b4ae-3708-4de9-907f-6b5926434f81 tempest-ProjectReaderTests-1690395873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-fd100276-713e-4093-a628-809d3c2e8981" returned: 0 in 0.288s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:23:20 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-40c8b4ae-3708-4de9-907f-6b5926434f81 tempest-ProjectReaderTests-1690395873 None] <== create_volume: return (834ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:23:20 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-40c8b4ae-3708-4de9-907f-6b5926434f81 tempest-ProjectReaderTests-1690395873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.837s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:23:20 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-707593ac-1fda-49e2-ba8c-ba6870a93441 tempest-VolumesGetTest-954660907 None] Created reservations ['8e5701d6-fc3a-4fd9-a555-491991d9a273', 'df752980-0bd8-4f2b-a857-e1e7721f6c00', 'c2e52c3e-9dd1-4832-bc9d-7345b02652ad', 'b9f0e579-5cd5-476d-b86b-0c547b50cbe2'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:23:20 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-40c8b4ae-3708-4de9-907f-6b5926434f81 tempest-ProjectReaderTests-1690395873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (649337e0-b921-466a-9a2a-0e1f3c3d6182) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd100276-713e-4093-a628-809d3c2e8981', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:23:20 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-40c8b4ae-3708-4de9-907f-6b5926434f81 tempest-ProjectReaderTests-1690395873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b13ed36c-c282-4e30-a98a-abc07aeaaacd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:23:20 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-40c8b4ae-3708-4de9-907f-6b5926434f81 tempest-ProjectReaderTests-1690395873 None] Volume volume-fd100276-713e-4093-a628-809d3c2e8981 (fd100276-713e-4093-a628-809d3c2e8981): created successfully Aug 29 01:23:20 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-40c8b4ae-3708-4de9-907f-6b5926434f81 tempest-ProjectReaderTests-1690395873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b13ed36c-c282-4e30-a98a-abc07aeaaacd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:23:20 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-40c8b4ae-3708-4de9-907f-6b5926434f81 tempest-ProjectReaderTests-1690395873 None] Flow 'volume_create_manager' (d09b3363-69bf-43ec-8092-3410d6d52962) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:23:20 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-40c8b4ae-3708-4de9-907f-6b5926434f81 tempest-ProjectReaderTests-1690395873 None] Created volume successfully. Aug 29 01:23:20 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-707593ac-1fda-49e2-ba8c-ba6870a93441 tempest-VolumesGetTest-954660907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:23:20 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-707593ac-1fda-49e2-ba8c-ba6870a93441 tempest-VolumesGetTest-954660907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:23:20 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-707593ac-1fda-49e2-ba8c-ba6870a93441 tempest-VolumesGetTest-954660907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:23:20 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-707593ac-1fda-49e2-ba8c-ba6870a93441 tempest-VolumesGetTest-954660907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:23:20 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-707593ac-1fda-49e2-ba8c-ba6870a93441 tempest-VolumesGetTest-954660907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:23:20 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-707593ac-1fda-49e2-ba8c-ba6870a93441 tempest-VolumesGetTest-954660907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:23:20 devstack sudo[100355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:23:20 devstack sudo[100355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:23:20 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-851010d6-2501-46d6-93c4-312346757115 tempest-VolumesGetTest-954660907 None] Acquiring lock "cinder-07cffb9c-e2e8-40f3-9237-5be146c032e3-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:23:20 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-851010d6-2501-46d6-93c4-312346757115 tempest-VolumesGetTest-954660907 None] Lock "cinder-07cffb9c-e2e8-40f3-9237-5be146c032e3-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:23:20 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-851010d6-2501-46d6-93c4-312346757115 tempest-VolumesGetTest-954660907 None] Acquiring lock "cinder-quobyte-07cffb9c-e2e8-40f3-9237-5be146c032e3" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:23:20 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-851010d6-2501-46d6-93c4-312346757115 tempest-VolumesGetTest-954660907 None] Lock "cinder-quobyte-07cffb9c-e2e8-40f3-9237-5be146c032e3" acquired by "delete_volume" :: waited 0.020s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:23:20 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[02627424-a24e-4421-927a-85aaf62b6577]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:23:20 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-851010d6-2501-46d6-93c4-312346757115 tempest-VolumesGetTest-954660907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-07cffb9c-e2e8-40f3-9237-5be146c032e3 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:23:20 devstack sudo[100355]: pam_unix(sudo:session): session closed for user root Aug 29 01:23:20 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-707593ac-1fda-49e2-ba8c-ba6870a93441 tempest-VolumesGetTest-954660907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.364s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:23:20 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-707593ac-1fda-49e2-ba8c-ba6870a93441 tempest-VolumesGetTest-954660907 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:23:20 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-707593ac-1fda-49e2-ba8c-ba6870a93441 tempest-VolumesGetTest-954660907 None] Deleted volume successfully. Aug 29 01:23:20 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-707593ac-1fda-49e2-ba8c-ba6870a93441 tempest-VolumesGetTest-954660907 None] Lock "cinder-22a91a02-add2-405b-9ab2-8b2dc96b1555-delete_volume" released by "delete_volume" :: held 1.580s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:23:20 devstack sudo[100358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-07cffb9c-e2e8-40f3-9237-5be146c032e3 Aug 29 01:23:20 devstack sudo[100358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:23:21 devstack sudo[100358]: pam_unix(sudo:session): session closed for user root Aug 29 01:23:21 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-851010d6-2501-46d6-93c4-312346757115 tempest-VolumesGetTest-954660907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-07cffb9c-e2e8-40f3-9237-5be146c032e3" returned: 0 in 0.419s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:23:21 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-851010d6-2501-46d6-93c4-312346757115 tempest-VolumesGetTest-954660907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-07cffb9c-e2e8-40f3-9237-5be146c032e3 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:23:21 devstack sudo[100364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-07cffb9c-e2e8-40f3-9237-5be146c032e3 Aug 29 01:23:21 devstack sudo[100364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:23:21 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-33ce56e8-2e2f-4fa7-b21a-8af89b1c818a tempest-ProjectReaderTests-1690395873 None] Acquiring lock "cinder-fd100276-713e-4093-a628-809d3c2e8981-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:23:21 devstack sudo[100364]: pam_unix(sudo:session): session closed for user root Aug 29 01:23:21 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-33ce56e8-2e2f-4fa7-b21a-8af89b1c818a tempest-ProjectReaderTests-1690395873 None] Lock "cinder-fd100276-713e-4093-a628-809d3c2e8981-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:23:21 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-851010d6-2501-46d6-93c4-312346757115 tempest-VolumesGetTest-954660907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-07cffb9c-e2e8-40f3-9237-5be146c032e3" returned: 0 in 0.372s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:23:21 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-851010d6-2501-46d6-93c4-312346757115 tempest-VolumesGetTest-954660907 None] Lock "cinder-quobyte-07cffb9c-e2e8-40f3-9237-5be146c032e3" released by "delete_volume" :: held 0.860s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:23:21 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-33ce56e8-2e2f-4fa7-b21a-8af89b1c818a tempest-ProjectReaderTests-1690395873 None] Acquiring lock "cinder-quobyte-fd100276-713e-4093-a628-809d3c2e8981" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:23:21 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-33ce56e8-2e2f-4fa7-b21a-8af89b1c818a tempest-ProjectReaderTests-1690395873 None] Lock "cinder-quobyte-fd100276-713e-4093-a628-809d3c2e8981" acquired by "delete_volume" :: waited 0.040s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:23:21 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-851010d6-2501-46d6-93c4-312346757115 tempest-VolumesGetTest-954660907 None] Created reservations ['c476af7c-0a35-4d5c-a835-6c260c924c23', '1cfba301-d910-4b69-9bf7-3b26052098b4', '778906b5-46c0-4b03-b5b8-773caa11a24f', '0693df07-d294-4bd1-a1b7-78e311277a78'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:23:21 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7c07934-8ca5-46fd-a3e7-ad8770b455c3]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:23:21 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-33ce56e8-2e2f-4fa7-b21a-8af89b1c818a tempest-ProjectReaderTests-1690395873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-fd100276-713e-4093-a628-809d3c2e8981 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:23:21 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-2bcca83c-975f-4496-9cf8-0f026b89d215 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:23:21 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-2bcca83c-975f-4496-9cf8-0f026b89d215 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Flow 'volume_create_manager' (5344874d-b0de-40fe-a58f-371532ca7883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:23:21 devstack sudo[100371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-fd100276-713e-4093-a628-809d3c2e8981 Aug 29 01:23:21 devstack sudo[100371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:23:21 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-2bcca83c-975f-4496-9cf8-0f026b89d215 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61d44bf7-e93e-4a3f-9997-50000536876b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:23:21 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-851010d6-2501-46d6-93c4-312346757115 tempest-VolumesGetTest-954660907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:23:21 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-851010d6-2501-46d6-93c4-312346757115 tempest-VolumesGetTest-954660907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:23:21 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-851010d6-2501-46d6-93c4-312346757115 tempest-VolumesGetTest-954660907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:23:21 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-851010d6-2501-46d6-93c4-312346757115 tempest-VolumesGetTest-954660907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:23:21 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-851010d6-2501-46d6-93c4-312346757115 tempest-VolumesGetTest-954660907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:23:21 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-851010d6-2501-46d6-93c4-312346757115 tempest-VolumesGetTest-954660907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:23:21 devstack sudo[100379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:23:21 devstack sudo[100379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:23:21 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-2bcca83c-975f-4496-9cf8-0f026b89d215 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61d44bf7-e93e-4a3f-9997-50000536876b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:23:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-422860268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da0c53c6-7e9b-4076-90b4-fa55939c742c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1798ae82367a42e4b2bc9fbd88b8448b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:23:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:23:22Z,use_quota=True,user_id='68815acc6f024579827c67e4d6dfb03c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:23:21 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-2bcca83c-975f-4496-9cf8-0f026b89d215 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b6e4720-376a-482d-9e15-3dc32f274bb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:23:21 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-2bcca83c-975f-4496-9cf8-0f026b89d215 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b6e4720-376a-482d-9e15-3dc32f274bb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:23:21 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-2bcca83c-975f-4496-9cf8-0f026b89d215 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (286b868a-5d96-4d49-a827-f064e9441eec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:23:21 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-2bcca83c-975f-4496-9cf8-0f026b89d215 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (286b868a-5d96-4d49-a827-f064e9441eec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da0c53c6-7e9b-4076-90b4-fa55939c742c', 'volume_name': 'volume-da0c53c6-7e9b-4076-90b4-fa55939c742c', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:23:21 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-2bcca83c-975f-4496-9cf8-0f026b89d215 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8bfb800-be61-4efc-9f0e-de2ee6511588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:23:21 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-2bcca83c-975f-4496-9cf8-0f026b89d215 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8bfb800-be61-4efc-9f0e-de2ee6511588) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:23:21 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-2bcca83c-975f-4496-9cf8-0f026b89d215 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2783b6d7-e3b1-460e-9210-00a24f4d2671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:23:21 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-2bcca83c-975f-4496-9cf8-0f026b89d215 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Volume da0c53c6-7e9b-4076-90b4-fa55939c742c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da0c53c6-7e9b-4076-90b4-fa55939c742c', 'volume_size': 1} Aug 29 01:23:21 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-2bcca83c-975f-4496-9cf8-0f026b89d215 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:23:21 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-2bcca83c-975f-4496-9cf8-0f026b89d215 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:23:21 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-2bcca83c-975f-4496-9cf8-0f026b89d215 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:23:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-422860268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da0c53c6-7e9b-4076-90b4-fa55939c742c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1798ae82367a42e4b2bc9fbd88b8448b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:23:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:23:22Z,use_quota=True,user_id='68815acc6f024579827c67e4d6dfb03c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:23:21 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-2bcca83c-975f-4496-9cf8-0f026b89d215 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Creating volume da0c53c6-7e9b-4076-90b4-fa55939c742c {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:23:21 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-2bcca83c-975f-4496-9cf8-0f026b89d215 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:23:21 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-2bcca83c-975f-4496-9cf8-0f026b89d215 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:23:21 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-2bcca83c-975f-4496-9cf8-0f026b89d215 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:23:21 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-2bcca83c-975f-4496-9cf8-0f026b89d215 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:23:21 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-2bcca83c-975f-4496-9cf8-0f026b89d215 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:23:21 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-2bcca83c-975f-4496-9cf8-0f026b89d215 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:23:21 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-2bcca83c-975f-4496-9cf8-0f026b89d215 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:23:21 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-2bcca83c-975f-4496-9cf8-0f026b89d215 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-da0c53c6-7e9b-4076-90b4-fa55939c742c 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:23:21 devstack sudo[100383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-da0c53c6-7e9b-4076-90b4-fa55939c742c 1073741824 Aug 29 01:23:21 devstack sudo[100383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:23:22 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [req-0b0c04d9-b72b-4bab-865c-e2f6ad5ddd31 req-3189ddea-ab7d-40f3-a71e-101708b13275 tempest-TestServerVolumeAttachmentScenario-1287155210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:23:22 devstack sudo[100371]: pam_unix(sudo:session): session closed for user root Aug 29 01:23:22 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-33ce56e8-2e2f-4fa7-b21a-8af89b1c818a tempest-ProjectReaderTests-1690395873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-fd100276-713e-4093-a628-809d3c2e8981" returned: 0 in 0.460s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:23:22 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-33ce56e8-2e2f-4fa7-b21a-8af89b1c818a tempest-ProjectReaderTests-1690395873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-fd100276-713e-4093-a628-809d3c2e8981 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:23:22 devstack sudo[100379]: pam_unix(sudo:session): session closed for user root Aug 29 01:23:22 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-851010d6-2501-46d6-93c4-312346757115 tempest-VolumesGetTest-954660907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.268s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:23:22 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-851010d6-2501-46d6-93c4-312346757115 tempest-VolumesGetTest-954660907 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:23:22 devstack sudo[100389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-fd100276-713e-4093-a628-809d3c2e8981 Aug 29 01:23:22 devstack sudo[100389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:23:22 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-851010d6-2501-46d6-93c4-312346757115 tempest-VolumesGetTest-954660907 None] Deleted volume successfully. Aug 29 01:23:22 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-851010d6-2501-46d6-93c4-312346757115 tempest-VolumesGetTest-954660907 None] Lock "cinder-07cffb9c-e2e8-40f3-9237-5be146c032e3-delete_volume" released by "delete_volume" :: held 1.641s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:23:22 devstack sudo[100389]: pam_unix(sudo:session): session closed for user root Aug 29 01:23:22 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-33ce56e8-2e2f-4fa7-b21a-8af89b1c818a tempest-ProjectReaderTests-1690395873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-fd100276-713e-4093-a628-809d3c2e8981" returned: 0 in 0.289s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:23:22 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-33ce56e8-2e2f-4fa7-b21a-8af89b1c818a tempest-ProjectReaderTests-1690395873 None] Lock "cinder-quobyte-fd100276-713e-4093-a628-809d3c2e8981" released by "delete_volume" :: held 0.823s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:23:22 devstack sudo[100383]: pam_unix(sudo:session): session closed for user root Aug 29 01:23:22 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-2bcca83c-975f-4496-9cf8-0f026b89d215 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-da0c53c6-7e9b-4076-90b4-fa55939c742c 1073741824" returned: 0 in 0.502s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:23:22 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-33ce56e8-2e2f-4fa7-b21a-8af89b1c818a tempest-ProjectReaderTests-1690395873 None] Created reservations ['12652528-1d41-4619-a42d-496c8c07d7f4', 'be7b85c0-01d1-4b0b-9b19-9cd99a2683f8', 'eb172fb6-e1e1-4d3a-8984-0b0337838b4f', '17b15dbb-9c3c-4bc8-adb8-ef9fbeb8aae9'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:23:22 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-2bcca83c-975f-4496-9cf8-0f026b89d215 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-da0c53c6-7e9b-4076-90b4-fa55939c742c {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:23:22 devstack sudo[100401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-da0c53c6-7e9b-4076-90b4-fa55939c742c Aug 29 01:23:22 devstack sudo[100401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:23:22 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-33ce56e8-2e2f-4fa7-b21a-8af89b1c818a tempest-ProjectReaderTests-1690395873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:23:22 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-33ce56e8-2e2f-4fa7-b21a-8af89b1c818a tempest-ProjectReaderTests-1690395873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:23:22 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-33ce56e8-2e2f-4fa7-b21a-8af89b1c818a tempest-ProjectReaderTests-1690395873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:23:22 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-33ce56e8-2e2f-4fa7-b21a-8af89b1c818a tempest-ProjectReaderTests-1690395873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:23:22 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-33ce56e8-2e2f-4fa7-b21a-8af89b1c818a tempest-ProjectReaderTests-1690395873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:23:22 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-33ce56e8-2e2f-4fa7-b21a-8af89b1c818a tempest-ProjectReaderTests-1690395873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:23:22 devstack sudo[100403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:23:22 devstack sudo[100403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:23:22 devstack sudo[100401]: pam_unix(sudo:session): session closed for user root Aug 29 01:23:22 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-2bcca83c-975f-4496-9cf8-0f026b89d215 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-da0c53c6-7e9b-4076-90b4-fa55939c742c" returned: 0 in 0.270s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:23:22 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-2bcca83c-975f-4496-9cf8-0f026b89d215 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] <== create_volume: return (818ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:23:22 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-2bcca83c-975f-4496-9cf8-0f026b89d215 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.820s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:23:22 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [req-0b0c04d9-b72b-4bab-865c-e2f6ad5ddd31 req-3189ddea-ab7d-40f3-a71e-101708b13275 tempest-TestServerVolumeAttachmentScenario-1287155210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.707s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:23:22 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-2bcca83c-975f-4496-9cf8-0f026b89d215 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2783b6d7-e3b1-460e-9210-00a24f4d2671) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da0c53c6-7e9b-4076-90b4-fa55939c742c', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:23:22 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-2bcca83c-975f-4496-9cf8-0f026b89d215 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19c449d4-863d-4eea-afc7-58327858694e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:23:22 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [req-0b0c04d9-b72b-4bab-865c-e2f6ad5ddd31 req-3189ddea-ab7d-40f3-a71e-101708b13275 tempest-TestServerVolumeAttachmentScenario-1287155210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.037s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:23:22 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-2bcca83c-975f-4496-9cf8-0f026b89d215 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Volume volume-da0c53c6-7e9b-4076-90b4-fa55939c742c (da0c53c6-7e9b-4076-90b4-fa55939c742c): created successfully Aug 29 01:23:22 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-2bcca83c-975f-4496-9cf8-0f026b89d215 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19c449d4-863d-4eea-afc7-58327858694e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:23:22 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-2bcca83c-975f-4496-9cf8-0f026b89d215 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Flow 'volume_create_manager' (5344874d-b0de-40fe-a58f-371532ca7883) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:23:22 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-2bcca83c-975f-4496-9cf8-0f026b89d215 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Created volume successfully. Aug 29 01:23:22 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [req-0b0c04d9-b72b-4bab-865c-e2f6ad5ddd31 req-3189ddea-ab7d-40f3-a71e-101708b13275 tempest-TestServerVolumeAttachmentScenario-1287155210 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630', 'name': 'volume-494081d0-dc9d-41a5-805f-77a09960fe59', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1b09512d-1625-4e29-b014-472a32d60461', 'enforce_multipath': True} {{(pid=86111) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 29 01:23:22 devstack sudo[100403]: pam_unix(sudo:session): session closed for user root Aug 29 01:23:22 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-33ce56e8-2e2f-4fa7-b21a-8af89b1c818a tempest-ProjectReaderTests-1690395873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.359s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:23:22 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-33ce56e8-2e2f-4fa7-b21a-8af89b1c818a tempest-ProjectReaderTests-1690395873 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:23:22 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-33ce56e8-2e2f-4fa7-b21a-8af89b1c818a tempest-ProjectReaderTests-1690395873 None] Deleted volume successfully. Aug 29 01:23:22 devstack cinder-volume[86111]: INFO cinder.volume.manager [req-0b0c04d9-b72b-4bab-865c-e2f6ad5ddd31 req-3189ddea-ab7d-40f3-a71e-101708b13275 tempest-TestServerVolumeAttachmentScenario-1287155210 None] attachment_update completed successfully. Aug 29 01:23:22 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-f3f9222a-9100-4857-a571-3992d53e05cc tempest-VolumesGetTest-954660907 None] Acquiring lock "cinder-dc441ad4-2065-4632-a5cb-3054ac0c1ae3-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:23:22 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-33ce56e8-2e2f-4fa7-b21a-8af89b1c818a tempest-ProjectReaderTests-1690395873 None] Lock "cinder-fd100276-713e-4093-a628-809d3c2e8981-delete_volume" released by "delete_volume" :: held 1.526s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:23:22 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-f3f9222a-9100-4857-a571-3992d53e05cc tempest-VolumesGetTest-954660907 None] Lock "cinder-dc441ad4-2065-4632-a5cb-3054ac0c1ae3-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:23:23 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-f3f9222a-9100-4857-a571-3992d53e05cc tempest-VolumesGetTest-954660907 None] Acquiring lock "cinder-quobyte-dc441ad4-2065-4632-a5cb-3054ac0c1ae3" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:23:23 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-f3f9222a-9100-4857-a571-3992d53e05cc tempest-VolumesGetTest-954660907 None] Lock "cinder-quobyte-dc441ad4-2065-4632-a5cb-3054ac0c1ae3" acquired by "delete_volume" :: waited 0.016s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:23:23 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[e60ba829-954f-4d4a-a35a-eaeed596d6f0]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:23:23 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-f3f9222a-9100-4857-a571-3992d53e05cc tempest-VolumesGetTest-954660907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-dc441ad4-2065-4632-a5cb-3054ac0c1ae3 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:23:23 devstack sudo[100429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-dc441ad4-2065-4632-a5cb-3054ac0c1ae3 Aug 29 01:23:23 devstack sudo[100429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:23:23 devstack sudo[100429]: pam_unix(sudo:session): session closed for user root Aug 29 01:23:23 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-f3f9222a-9100-4857-a571-3992d53e05cc tempest-VolumesGetTest-954660907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-dc441ad4-2065-4632-a5cb-3054ac0c1ae3" returned: 0 in 0.440s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:23:23 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-f3f9222a-9100-4857-a571-3992d53e05cc tempest-VolumesGetTest-954660907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-dc441ad4-2065-4632-a5cb-3054ac0c1ae3 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:23:23 devstack sudo[100795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-dc441ad4-2065-4632-a5cb-3054ac0c1ae3 Aug 29 01:23:23 devstack sudo[100795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:23:23 devstack sudo[100795]: pam_unix(sudo:session): session closed for user root Aug 29 01:23:23 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-f3f9222a-9100-4857-a571-3992d53e05cc tempest-VolumesGetTest-954660907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-dc441ad4-2065-4632-a5cb-3054ac0c1ae3" returned: 0 in 0.340s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:23:23 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-f3f9222a-9100-4857-a571-3992d53e05cc tempest-VolumesGetTest-954660907 None] Lock "cinder-quobyte-dc441ad4-2065-4632-a5cb-3054ac0c1ae3" released by "delete_volume" :: held 0.852s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:23:23 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-f3f9222a-9100-4857-a571-3992d53e05cc tempest-VolumesGetTest-954660907 None] Created reservations ['f7e93bbf-3bb9-4249-9a5b-9d3c005b068f', 'aef364f9-0d5c-425b-9b46-2d80de644dc8', '904b0b44-0cf6-46cf-b28e-0c3bbde38c39', '3c519fbf-3552-4c93-a576-3724842d7ed9'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:23:24 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-f3f9222a-9100-4857-a571-3992d53e05cc tempest-VolumesGetTest-954660907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:23:24 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-f3f9222a-9100-4857-a571-3992d53e05cc tempest-VolumesGetTest-954660907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:23:24 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-f3f9222a-9100-4857-a571-3992d53e05cc tempest-VolumesGetTest-954660907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:23:24 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-f3f9222a-9100-4857-a571-3992d53e05cc tempest-VolumesGetTest-954660907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:23:24 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-f3f9222a-9100-4857-a571-3992d53e05cc tempest-VolumesGetTest-954660907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:23:24 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-f3f9222a-9100-4857-a571-3992d53e05cc tempest-VolumesGetTest-954660907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:23:24 devstack sudo[100800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:23:24 devstack sudo[100800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:23:24 devstack sudo[100800]: pam_unix(sudo:session): session closed for user root Aug 29 01:23:24 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-f3f9222a-9100-4857-a571-3992d53e05cc tempest-VolumesGetTest-954660907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.319s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:23:24 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-f3f9222a-9100-4857-a571-3992d53e05cc tempest-VolumesGetTest-954660907 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:23:24 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-f3f9222a-9100-4857-a571-3992d53e05cc tempest-VolumesGetTest-954660907 None] Deleted volume successfully. Aug 29 01:23:24 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-f3f9222a-9100-4857-a571-3992d53e05cc tempest-VolumesGetTest-954660907 None] Lock "cinder-dc441ad4-2065-4632-a5cb-3054ac0c1ae3-delete_volume" released by "delete_volume" :: held 1.507s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:23:24 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c7d4ac9-bce4-436c-9cb6-4bbaf5d3b7ad tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:23:24 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-8c7d4ac9-bce4-436c-9cb6-4bbaf5d3b7ad tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Flow 'volume_create_manager' (11fe7f67-19da-46f0-adc3-b47fb471e38b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:23:24 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-8c7d4ac9-bce4-436c-9cb6-4bbaf5d3b7ad tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb28956a-59cf-4dd4-a8be-7419773bd46c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:23:24 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-8c7d4ac9-bce4-436c-9cb6-4bbaf5d3b7ad tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb28956a-59cf-4dd4-a8be-7419773bd46c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:23:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1596230668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b6ebe00-36a5-4369-8f3a-b2f79d194562,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1798ae82367a42e4b2bc9fbd88b8448b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:23:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:23:24Z,use_quota=True,user_id='68815acc6f024579827c67e4d6dfb03c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:23:24 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-8c7d4ac9-bce4-436c-9cb6-4bbaf5d3b7ad tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (873087ef-8521-4b28-ad3d-0f6fe15fe16c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:23:24 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-8c7d4ac9-bce4-436c-9cb6-4bbaf5d3b7ad tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (873087ef-8521-4b28-ad3d-0f6fe15fe16c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:23:24 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-8c7d4ac9-bce4-436c-9cb6-4bbaf5d3b7ad tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfc08f39-096a-4055-b7d9-62bb44f7ee5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:23:24 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-8c7d4ac9-bce4-436c-9cb6-4bbaf5d3b7ad tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfc08f39-096a-4055-b7d9-62bb44f7ee5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b6ebe00-36a5-4369-8f3a-b2f79d194562', 'volume_name': 'volume-0b6ebe00-36a5-4369-8f3a-b2f79d194562', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:23:24 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-8c7d4ac9-bce4-436c-9cb6-4bbaf5d3b7ad tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (008afcdd-5087-4e3c-940e-a910380fccec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:23:24 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-8c7d4ac9-bce4-436c-9cb6-4bbaf5d3b7ad tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (008afcdd-5087-4e3c-940e-a910380fccec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:23:24 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-8c7d4ac9-bce4-436c-9cb6-4bbaf5d3b7ad tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10a03812-e88f-4a45-9b17-447985749e7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:23:24 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-8c7d4ac9-bce4-436c-9cb6-4bbaf5d3b7ad tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Volume 0b6ebe00-36a5-4369-8f3a-b2f79d194562: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b6ebe00-36a5-4369-8f3a-b2f79d194562', 'volume_size': 1} Aug 29 01:23:24 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-8c7d4ac9-bce4-436c-9cb6-4bbaf5d3b7ad tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:23:24 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-8c7d4ac9-bce4-436c-9cb6-4bbaf5d3b7ad tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:23:24 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-8c7d4ac9-bce4-436c-9cb6-4bbaf5d3b7ad tempest-CreateVolumesFromSourceVolumeTest-722111983 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:23:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1596230668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b6ebe00-36a5-4369-8f3a-b2f79d194562,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1798ae82367a42e4b2bc9fbd88b8448b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:23:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:23:24Z,use_quota=True,user_id='68815acc6f024579827c67e4d6dfb03c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:23:24 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-8c7d4ac9-bce4-436c-9cb6-4bbaf5d3b7ad tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Creating volume 0b6ebe00-36a5-4369-8f3a-b2f79d194562 {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:23:24 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-8c7d4ac9-bce4-436c-9cb6-4bbaf5d3b7ad tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:23:24 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-8c7d4ac9-bce4-436c-9cb6-4bbaf5d3b7ad tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:23:24 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-8c7d4ac9-bce4-436c-9cb6-4bbaf5d3b7ad tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:23:24 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-8c7d4ac9-bce4-436c-9cb6-4bbaf5d3b7ad tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:23:24 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-8c7d4ac9-bce4-436c-9cb6-4bbaf5d3b7ad tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:23:24 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-8c7d4ac9-bce4-436c-9cb6-4bbaf5d3b7ad tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:23:24 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-8c7d4ac9-bce4-436c-9cb6-4bbaf5d3b7ad tempest-CreateVolumesFromSourceVolumeTest-722111983 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:23:24 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8c7d4ac9-bce4-436c-9cb6-4bbaf5d3b7ad tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-0b6ebe00-36a5-4369-8f3a-b2f79d194562 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:23:24 devstack sudo[100803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-0b6ebe00-36a5-4369-8f3a-b2f79d194562 1073741824 Aug 29 01:23:24 devstack sudo[100803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:23:25 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-7331c21e-aa97-49a8-9436-94a96d1d07a6 tempest-VolumesGetTest-954660907 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:23:25 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-7331c21e-aa97-49a8-9436-94a96d1d07a6 tempest-VolumesGetTest-954660907 None] Flow 'volume_create_manager' (ed77f88d-528a-4699-9968-395b2b806f56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:23:25 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-7331c21e-aa97-49a8-9436-94a96d1d07a6 tempest-VolumesGetTest-954660907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b095b500-1c8a-4a9b-a7e0-15464a456b92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:23:25 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-7331c21e-aa97-49a8-9436-94a96d1d07a6 tempest-VolumesGetTest-954660907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b095b500-1c8a-4a9b-a7e0-15464a456b92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:23:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1247223193',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ae628b3-d6c1-4110-83dd-905d5aad2dde,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='5c4c32927df54b70ae25b85da6abe7ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:23:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:23:25Z,use_quota=True,user_id='6d651c7f6792483d90119c301b2dd999',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:23:25 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-7331c21e-aa97-49a8-9436-94a96d1d07a6 tempest-VolumesGetTest-954660907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94891fa6-2388-4827-9f44-5047f6080829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:23:25 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-7331c21e-aa97-49a8-9436-94a96d1d07a6 tempest-VolumesGetTest-954660907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94891fa6-2388-4827-9f44-5047f6080829) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:23:25 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-7331c21e-aa97-49a8-9436-94a96d1d07a6 tempest-VolumesGetTest-954660907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4f9103f-accc-4b36-b167-b153166ce1f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:23:25 devstack cinder-volume[86111]: DEBUG cinder.image.glance [None req-7331c21e-aa97-49a8-9436-94a96d1d07a6 tempest-VolumesGetTest-954660907 None] Creating Keystone auth plugin from conf {{(pid=86111) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 29 01:23:25 devstack sudo[100803]: pam_unix(sudo:session): session closed for user root Aug 29 01:23:25 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8c7d4ac9-bce4-436c-9cb6-4bbaf5d3b7ad tempest-CreateVolumesFromSourceVolumeTest-722111983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-0b6ebe00-36a5-4369-8f3a-b2f79d194562 1073741824" returned: 0 in 0.705s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:23:25 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8c7d4ac9-bce4-436c-9cb6-4bbaf5d3b7ad tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-0b6ebe00-36a5-4369-8f3a-b2f79d194562 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:23:25 devstack sudo[100809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-0b6ebe00-36a5-4369-8f3a-b2f79d194562 Aug 29 01:23:25 devstack sudo[100809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:23:25 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-98ba3229-e3d8-4f8c-ab6f-7b76a296ced3 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:23:25 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-98ba3229-e3d8-4f8c-ab6f-7b76a296ced3 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Flow 'volume_create_manager' (74b7c5a2-eb08-4ab5-b279-7747778d5882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:23:25 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-98ba3229-e3d8-4f8c-ab6f-7b76a296ced3 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (146cba68-afa3-469e-834a-0c2c82a01628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:23:25 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-98ba3229-e3d8-4f8c-ab6f-7b76a296ced3 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (146cba68-afa3-469e-834a-0c2c82a01628) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:23:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-16167045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=620646ab-1eaa-4c18-9992-565d344cdedc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1798ae82367a42e4b2bc9fbd88b8448b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:23:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:23:26Z,use_quota=True,user_id='68815acc6f024579827c67e4d6dfb03c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:23:25 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-98ba3229-e3d8-4f8c-ab6f-7b76a296ced3 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f44449b3-f278-4d55-95af-7b693349b531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:23:25 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-98ba3229-e3d8-4f8c-ab6f-7b76a296ced3 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f44449b3-f278-4d55-95af-7b693349b531) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:23:25 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-98ba3229-e3d8-4f8c-ab6f-7b76a296ced3 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97e39787-1260-4946-8d52-d4e8a762ab6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:23:25 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-98ba3229-e3d8-4f8c-ab6f-7b76a296ced3 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97e39787-1260-4946-8d52-d4e8a762ab6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '620646ab-1eaa-4c18-9992-565d344cdedc', 'volume_name': 'volume-620646ab-1eaa-4c18-9992-565d344cdedc', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:23:25 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-98ba3229-e3d8-4f8c-ab6f-7b76a296ced3 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a85b062-7b49-442b-9b7e-d6b6617e2a3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:23:25 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-98ba3229-e3d8-4f8c-ab6f-7b76a296ced3 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a85b062-7b49-442b-9b7e-d6b6617e2a3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:23:25 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-98ba3229-e3d8-4f8c-ab6f-7b76a296ced3 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a3229eb-8ae7-4329-b396-927575818fd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:23:25 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-98ba3229-e3d8-4f8c-ab6f-7b76a296ced3 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Volume 620646ab-1eaa-4c18-9992-565d344cdedc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-620646ab-1eaa-4c18-9992-565d344cdedc', 'volume_size': 1} Aug 29 01:23:25 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-98ba3229-e3d8-4f8c-ab6f-7b76a296ced3 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:23:26 devstack sudo[100809]: pam_unix(sudo:session): session closed for user root Aug 29 01:23:26 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8c7d4ac9-bce4-436c-9cb6-4bbaf5d3b7ad tempest-CreateVolumesFromSourceVolumeTest-722111983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-0b6ebe00-36a5-4369-8f3a-b2f79d194562" returned: 0 in 0.538s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:23:26 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-8c7d4ac9-bce4-436c-9cb6-4bbaf5d3b7ad tempest-CreateVolumesFromSourceVolumeTest-722111983 None] <== create_volume: return (1346ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:23:26 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-8c7d4ac9-bce4-436c-9cb6-4bbaf5d3b7ad tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.350s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:23:26 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-98ba3229-e3d8-4f8c-ab6f-7b76a296ced3 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.140s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:23:26 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-98ba3229-e3d8-4f8c-ab6f-7b76a296ced3 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:23:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-16167045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=620646ab-1eaa-4c18-9992-565d344cdedc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1798ae82367a42e4b2bc9fbd88b8448b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:23:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:23:26Z,use_quota=True,user_id='68815acc6f024579827c67e4d6dfb03c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:23:26 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-98ba3229-e3d8-4f8c-ab6f-7b76a296ced3 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Creating volume 620646ab-1eaa-4c18-9992-565d344cdedc {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:23:26 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-98ba3229-e3d8-4f8c-ab6f-7b76a296ced3 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:23:26 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-98ba3229-e3d8-4f8c-ab6f-7b76a296ced3 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:23:26 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-98ba3229-e3d8-4f8c-ab6f-7b76a296ced3 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:23:26 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-98ba3229-e3d8-4f8c-ab6f-7b76a296ced3 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:23:26 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-98ba3229-e3d8-4f8c-ab6f-7b76a296ced3 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:23:26 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-98ba3229-e3d8-4f8c-ab6f-7b76a296ced3 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:23:26 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-98ba3229-e3d8-4f8c-ab6f-7b76a296ced3 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:23:26 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-98ba3229-e3d8-4f8c-ab6f-7b76a296ced3 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-620646ab-1eaa-4c18-9992-565d344cdedc 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:23:26 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-8c7d4ac9-bce4-436c-9cb6-4bbaf5d3b7ad tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10a03812-e88f-4a45-9b17-447985749e7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b6ebe00-36a5-4369-8f3a-b2f79d194562', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:23:26 devstack sudo[100812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-620646ab-1eaa-4c18-9992-565d344cdedc 1073741824 Aug 29 01:23:26 devstack sudo[100812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:23:26 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-8c7d4ac9-bce4-436c-9cb6-4bbaf5d3b7ad tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bf22300-a82f-4446-aff5-d1b52ef78cc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:23:26 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-8c7d4ac9-bce4-436c-9cb6-4bbaf5d3b7ad tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Volume volume-0b6ebe00-36a5-4369-8f3a-b2f79d194562 (0b6ebe00-36a5-4369-8f3a-b2f79d194562): created successfully Aug 29 01:23:26 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-8c7d4ac9-bce4-436c-9cb6-4bbaf5d3b7ad tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bf22300-a82f-4446-aff5-d1b52ef78cc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:23:26 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-8c7d4ac9-bce4-436c-9cb6-4bbaf5d3b7ad tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Flow 'volume_create_manager' (11fe7f67-19da-46f0-adc3-b47fb471e38b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:23:26 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-8c7d4ac9-bce4-436c-9cb6-4bbaf5d3b7ad tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Created volume successfully. Aug 29 01:23:26 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-4aefcd76-4602-480f-94c4-976e5c47b176 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:23:26 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-4aefcd76-4602-480f-94c4-976e5c47b176 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Flow 'volume_create_manager' (c7bfadf3-547c-442a-93cc-d0c008b812bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:23:26 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-4aefcd76-4602-480f-94c4-976e5c47b176 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc75bf71-48e6-459c-9e03-4ca7ef71db47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:23:26 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-4aefcd76-4602-480f-94c4-976e5c47b176 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc75bf71-48e6-459c-9e03-4ca7ef71db47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:23:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1830559646',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adacf612-3612-490a-8bd7-2370fc34e46a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1798ae82367a42e4b2bc9fbd88b8448b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:23:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:23:26Z,use_quota=True,user_id='68815acc6f024579827c67e4d6dfb03c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:23:26 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-4aefcd76-4602-480f-94c4-976e5c47b176 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48a8d540-3c3d-4677-83a7-cf07c1b83daa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:23:26 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-4aefcd76-4602-480f-94c4-976e5c47b176 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48a8d540-3c3d-4677-83a7-cf07c1b83daa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:23:26 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-4aefcd76-4602-480f-94c4-976e5c47b176 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89383a14-8d20-457c-9df9-85742d5f08ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:23:26 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-4aefcd76-4602-480f-94c4-976e5c47b176 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89383a14-8d20-457c-9df9-85742d5f08ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'adacf612-3612-490a-8bd7-2370fc34e46a', 'volume_name': 'volume-adacf612-3612-490a-8bd7-2370fc34e46a', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:23:26 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-4aefcd76-4602-480f-94c4-976e5c47b176 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bf041db-0f29-48e5-9faa-e1558107e195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:23:26 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-4aefcd76-4602-480f-94c4-976e5c47b176 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bf041db-0f29-48e5-9faa-e1558107e195) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:23:26 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-4aefcd76-4602-480f-94c4-976e5c47b176 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e58504e-323b-4383-bcb9-166d2eee8182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:23:26 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-4aefcd76-4602-480f-94c4-976e5c47b176 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Volume adacf612-3612-490a-8bd7-2370fc34e46a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-adacf612-3612-490a-8bd7-2370fc34e46a', 'volume_size': 1} Aug 29 01:23:26 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-4aefcd76-4602-480f-94c4-976e5c47b176 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:23:26 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-7331c21e-aa97-49a8-9436-94a96d1d07a6 tempest-VolumesGetTest-954660907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4f9103f-accc-4b36-b167-b153166ce1f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7ae628b3-d6c1-4110-83dd-905d5aad2dde', 'volume_name': 'volume-7ae628b3-d6c1-4110-83dd-905d5aad2dde', 'volume_size': 1, 'image_id': 'f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8d940113004947258ae710723d273006', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab', 'created_at': datetime.datetime(2026, 8, 28, 23, 3, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 23, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:23:26 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-7331c21e-aa97-49a8-9436-94a96d1d07a6 tempest-VolumesGetTest-954660907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5531ac80-8176-47f1-8a5c-9815827b8719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:23:26 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-7331c21e-aa97-49a8-9436-94a96d1d07a6 tempest-VolumesGetTest-954660907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5531ac80-8176-47f1-8a5c-9815827b8719) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:23:26 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-7331c21e-aa97-49a8-9436-94a96d1d07a6 tempest-VolumesGetTest-954660907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0785a7a2-283c-44e5-aa14-619e112113ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:23:26 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-7331c21e-aa97-49a8-9436-94a96d1d07a6 tempest-VolumesGetTest-954660907 None] Volume 7ae628b3-d6c1-4110-83dd-905d5aad2dde: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7ae628b3-d6c1-4110-83dd-905d5aad2dde', 'volume_size': 1, 'image_id': 'f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8d940113004947258ae710723d273006', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab', 'created_at': datetime.datetime(2026, 8, 28, 23, 3, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 23, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 29 01:23:26 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-7331c21e-aa97-49a8-9436-94a96d1d07a6 tempest-VolumesGetTest-954660907 None] Trying to clone 7ae628b3-d6c1-4110-83dd-905d5aad2dde from image f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab at location (None, [{'url': 'file:///opt/stack/data/glance/images/f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab', 'metadata': {}}]). {{(pid=86111) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 29 01:23:26 devstack sudo[100812]: pam_unix(sudo:session): session closed for user root Aug 29 01:23:26 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-98ba3229-e3d8-4f8c-ab6f-7b76a296ced3 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-620646ab-1eaa-4c18-9992-565d344cdedc 1073741824" returned: 0 in 0.755s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:23:26 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-15e46708-c190-430b-a9ca-95e1b15d0e4c tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:23:26 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-15e46708-c190-430b-a9ca-95e1b15d0e4c tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Flow 'volume_create_manager' (7963bdfa-47b6-41e7-980e-e51290a8bdff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:23:26 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-15e46708-c190-430b-a9ca-95e1b15d0e4c tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb459ff8-6851-4205-82c0-e00f5c754a53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:23:26 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-98ba3229-e3d8-4f8c-ab6f-7b76a296ced3 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-620646ab-1eaa-4c18-9992-565d344cdedc {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:23:27 devstack sudo[100817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-620646ab-1eaa-4c18-9992-565d344cdedc Aug 29 01:23:27 devstack sudo[100817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:23:27 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-15e46708-c190-430b-a9ca-95e1b15d0e4c tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb459ff8-6851-4205-82c0-e00f5c754a53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:23:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1148192145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91c50c78-a1f9-483d-ae95-ea122f47c048,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1798ae82367a42e4b2bc9fbd88b8448b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:23:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:23:27Z,use_quota=True,user_id='68815acc6f024579827c67e4d6dfb03c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:23:27 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-15e46708-c190-430b-a9ca-95e1b15d0e4c tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (506f6eb8-b688-423a-8490-ce34a81701b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:23:27 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-15e46708-c190-430b-a9ca-95e1b15d0e4c tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (506f6eb8-b688-423a-8490-ce34a81701b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:23:27 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-15e46708-c190-430b-a9ca-95e1b15d0e4c tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91e96356-2fef-4c0f-bb6a-de437cedf408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:23:27 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-15e46708-c190-430b-a9ca-95e1b15d0e4c tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91e96356-2fef-4c0f-bb6a-de437cedf408) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91c50c78-a1f9-483d-ae95-ea122f47c048', 'volume_name': 'volume-91c50c78-a1f9-483d-ae95-ea122f47c048', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:23:27 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-15e46708-c190-430b-a9ca-95e1b15d0e4c tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2eec2d53-d6a6-4bfc-acc4-ae578ff096fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:23:27 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-15e46708-c190-430b-a9ca-95e1b15d0e4c tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2eec2d53-d6a6-4bfc-acc4-ae578ff096fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:23:27 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-15e46708-c190-430b-a9ca-95e1b15d0e4c tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce8c3e19-c038-4a5b-9e7d-c56139285985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:23:27 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-15e46708-c190-430b-a9ca-95e1b15d0e4c tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Volume 91c50c78-a1f9-483d-ae95-ea122f47c048: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91c50c78-a1f9-483d-ae95-ea122f47c048', 'volume_size': 1} Aug 29 01:23:27 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-15e46708-c190-430b-a9ca-95e1b15d0e4c tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:23:27 devstack cinder-volume[86111]: DEBUG cinder.image.image_utils [None req-7331c21e-aa97-49a8-9436-94a96d1d07a6 tempest-VolumesGetTest-954660907 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab_754vlkn0devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86111) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 29 01:23:27 devstack cinder-volume[86111]: INFO cinder.image.image_utils [None req-7331c21e-aa97-49a8-9436-94a96d1d07a6 tempest-VolumesGetTest-954660907 None] Image download 20.69 MB at 20.69 MB/s Aug 29 01:23:27 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa9362b1-b8d6-45be-ae17-5c674bd78aa1]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:23:27 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-7331c21e-aa97-49a8-9436-94a96d1d07a6 tempest-VolumesGetTest-954660907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab_754vlkn0devstack@QuobyteHD {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:23:27 devstack sudo[100817]: pam_unix(sudo:session): session closed for user root Aug 29 01:23:27 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-98ba3229-e3d8-4f8c-ab6f-7b76a296ced3 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-620646ab-1eaa-4c18-9992-565d344cdedc" returned: 0 in 0.457s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:23:27 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-98ba3229-e3d8-4f8c-ab6f-7b76a296ced3 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] <== create_volume: return (1415ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:23:27 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-98ba3229-e3d8-4f8c-ab6f-7b76a296ced3 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.421s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:23:27 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-4aefcd76-4602-480f-94c4-976e5c47b176 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.890s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:23:27 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-4aefcd76-4602-480f-94c4-976e5c47b176 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:23:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1830559646',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adacf612-3612-490a-8bd7-2370fc34e46a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1798ae82367a42e4b2bc9fbd88b8448b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:23:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:23:26Z,use_quota=True,user_id='68815acc6f024579827c67e4d6dfb03c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:23:27 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-4aefcd76-4602-480f-94c4-976e5c47b176 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Creating volume adacf612-3612-490a-8bd7-2370fc34e46a {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:23:27 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-4aefcd76-4602-480f-94c4-976e5c47b176 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:23:27 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-4aefcd76-4602-480f-94c4-976e5c47b176 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:23:27 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-4aefcd76-4602-480f-94c4-976e5c47b176 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:23:27 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-4aefcd76-4602-480f-94c4-976e5c47b176 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:23:27 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-4aefcd76-4602-480f-94c4-976e5c47b176 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:23:27 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-4aefcd76-4602-480f-94c4-976e5c47b176 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:23:27 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-4aefcd76-4602-480f-94c4-976e5c47b176 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:23:27 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-4aefcd76-4602-480f-94c4-976e5c47b176 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-adacf612-3612-490a-8bd7-2370fc34e46a 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:23:27 devstack sudo[100821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab_754vlkn0devstack@QuobyteHD Aug 29 01:23:27 devstack sudo[100821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:23:27 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-72627726-fb2f-4825-b7ed-ea7686f31e4c tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:23:27 devstack sudo[100822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-adacf612-3612-490a-8bd7-2370fc34e46a 1073741824 Aug 29 01:23:27 devstack sudo[100822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:23:27 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-72627726-fb2f-4825-b7ed-ea7686f31e4c tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Flow 'volume_create_manager' (8748428b-db11-48f8-8393-137222aab974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:23:27 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-72627726-fb2f-4825-b7ed-ea7686f31e4c tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c30e7322-9837-42f0-ba99-781d3d6312c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:23:27 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-98ba3229-e3d8-4f8c-ab6f-7b76a296ced3 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a3229eb-8ae7-4329-b396-927575818fd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-620646ab-1eaa-4c18-9992-565d344cdedc', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:23:27 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-98ba3229-e3d8-4f8c-ab6f-7b76a296ced3 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0574fa36-20c6-48a2-9745-19389a872a39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:23:27 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-72627726-fb2f-4825-b7ed-ea7686f31e4c tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c30e7322-9837-42f0-ba99-781d3d6312c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:23:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1763986717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=143ff940-fc54-4aef-8aef-37661b0f3c70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1798ae82367a42e4b2bc9fbd88b8448b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:23:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:23:27Z,use_quota=True,user_id='68815acc6f024579827c67e4d6dfb03c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:23:27 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-72627726-fb2f-4825-b7ed-ea7686f31e4c tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ea8a36f-24b3-4cb3-99b2-966c5f540162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:23:27 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-72627726-fb2f-4825-b7ed-ea7686f31e4c tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ea8a36f-24b3-4cb3-99b2-966c5f540162) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:23:27 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-72627726-fb2f-4825-b7ed-ea7686f31e4c tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b46d67f0-de90-416e-842a-80d7b1334ec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:23:27 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-72627726-fb2f-4825-b7ed-ea7686f31e4c tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b46d67f0-de90-416e-842a-80d7b1334ec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '143ff940-fc54-4aef-8aef-37661b0f3c70', 'volume_name': 'volume-143ff940-fc54-4aef-8aef-37661b0f3c70', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:23:27 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-72627726-fb2f-4825-b7ed-ea7686f31e4c tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90109ffa-f213-4e84-b425-f3b9022150bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:23:27 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-72627726-fb2f-4825-b7ed-ea7686f31e4c tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90109ffa-f213-4e84-b425-f3b9022150bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:23:27 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-72627726-fb2f-4825-b7ed-ea7686f31e4c tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c23d2fcd-7fb8-40fc-9900-e0ee825f0b99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:23:27 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-72627726-fb2f-4825-b7ed-ea7686f31e4c tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Volume 143ff940-fc54-4aef-8aef-37661b0f3c70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-143ff940-fc54-4aef-8aef-37661b0f3c70', 'volume_size': 1} Aug 29 01:23:27 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-72627726-fb2f-4825-b7ed-ea7686f31e4c tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:23:27 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-98ba3229-e3d8-4f8c-ab6f-7b76a296ced3 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Volume volume-620646ab-1eaa-4c18-9992-565d344cdedc (620646ab-1eaa-4c18-9992-565d344cdedc): created successfully Aug 29 01:23:27 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-98ba3229-e3d8-4f8c-ab6f-7b76a296ced3 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0574fa36-20c6-48a2-9745-19389a872a39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:23:27 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-98ba3229-e3d8-4f8c-ab6f-7b76a296ced3 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Flow 'volume_create_manager' (74b7c5a2-eb08-4ab5-b279-7747778d5882) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:23:27 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-98ba3229-e3d8-4f8c-ab6f-7b76a296ced3 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Created volume successfully. Aug 29 01:23:27 devstack sudo[100821]: pam_unix(sudo:session): session closed for user root Aug 29 01:23:27 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-7331c21e-aa97-49a8-9436-94a96d1d07a6 tempest-VolumesGetTest-954660907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab_754vlkn0devstack@QuobyteHD" returned: 0 in 0.407s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:23:27 devstack cinder-volume[86111]: DEBUG cinder.image.image_utils [None req-7331c21e-aa97-49a8-9436-94a96d1d07a6 tempest-VolumesGetTest-954660907 None] Temporary image f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab is fetched for user 6d651c7f6792483d90119c301b2dd999. {{(pid=86111) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 29 01:23:27 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf64a8c3-301c-4bb4-b96c-fce106fef372]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:23:27 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-7331c21e-aa97-49a8-9436-94a96d1d07a6 tempest-VolumesGetTest-954660907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab_754vlkn0devstack@QuobyteHD {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:23:27 devstack sudo[100831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab_754vlkn0devstack@QuobyteHD Aug 29 01:23:27 devstack sudo[100831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:23:28 devstack sudo[100822]: pam_unix(sudo:session): session closed for user root Aug 29 01:23:28 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-4aefcd76-4602-480f-94c4-976e5c47b176 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-adacf612-3612-490a-8bd7-2370fc34e46a 1073741824" returned: 0 in 0.614s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:23:28 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-4aefcd76-4602-480f-94c4-976e5c47b176 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-adacf612-3612-490a-8bd7-2370fc34e46a {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:23:28 devstack sudo[100834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-adacf612-3612-490a-8bd7-2370fc34e46a Aug 29 01:23:28 devstack sudo[100834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:23:28 devstack sudo[100831]: pam_unix(sudo:session): session closed for user root Aug 29 01:23:28 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-7331c21e-aa97-49a8-9436-94a96d1d07a6 tempest-VolumesGetTest-954660907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab_754vlkn0devstack@QuobyteHD" returned: 0 in 0.421s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:23:28 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-7331c21e-aa97-49a8-9436-94a96d1d07a6 tempest-VolumesGetTest-954660907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:23:28 devstack sudo[100834]: pam_unix(sudo:session): session closed for user root Aug 29 01:23:28 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-4aefcd76-4602-480f-94c4-976e5c47b176 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-adacf612-3612-490a-8bd7-2370fc34e46a" returned: 0 in 0.319s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:23:28 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-4aefcd76-4602-480f-94c4-976e5c47b176 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] <== create_volume: return (992ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:23:28 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-4aefcd76-4602-480f-94c4-976e5c47b176 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.995s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:23:28 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-15e46708-c190-430b-a9ca-95e1b15d0e4c tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.353s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:23:28 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-15e46708-c190-430b-a9ca-95e1b15d0e4c tempest-CreateVolumesFromSourceVolumeTest-722111983 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:23:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1148192145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91c50c78-a1f9-483d-ae95-ea122f47c048,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1798ae82367a42e4b2bc9fbd88b8448b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:23:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:23:27Z,use_quota=True,user_id='68815acc6f024579827c67e4d6dfb03c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:23:28 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-15e46708-c190-430b-a9ca-95e1b15d0e4c tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Creating volume 91c50c78-a1f9-483d-ae95-ea122f47c048 {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:23:28 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-15e46708-c190-430b-a9ca-95e1b15d0e4c tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:23:28 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-15e46708-c190-430b-a9ca-95e1b15d0e4c tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:23:28 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-15e46708-c190-430b-a9ca-95e1b15d0e4c tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:23:28 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-15e46708-c190-430b-a9ca-95e1b15d0e4c tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:23:28 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-15e46708-c190-430b-a9ca-95e1b15d0e4c tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:23:28 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-15e46708-c190-430b-a9ca-95e1b15d0e4c tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:23:28 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-15e46708-c190-430b-a9ca-95e1b15d0e4c tempest-CreateVolumesFromSourceVolumeTest-722111983 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:23:28 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-15e46708-c190-430b-a9ca-95e1b15d0e4c tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-91c50c78-a1f9-483d-ae95-ea122f47c048 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:23:28 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-4aefcd76-4602-480f-94c4-976e5c47b176 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e58504e-323b-4383-bcb9-166d2eee8182) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-adacf612-3612-490a-8bd7-2370fc34e46a', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:23:28 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-4aefcd76-4602-480f-94c4-976e5c47b176 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fffb829-1e2b-40e4-a20b-2e1f4b73662d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:23:28 devstack sudo[100840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-91c50c78-a1f9-483d-ae95-ea122f47c048 1073741824 Aug 29 01:23:28 devstack sudo[100840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:23:28 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-4aefcd76-4602-480f-94c4-976e5c47b176 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Volume volume-adacf612-3612-490a-8bd7-2370fc34e46a (adacf612-3612-490a-8bd7-2370fc34e46a): created successfully Aug 29 01:23:28 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-4aefcd76-4602-480f-94c4-976e5c47b176 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fffb829-1e2b-40e4-a20b-2e1f4b73662d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:23:28 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-4aefcd76-4602-480f-94c4-976e5c47b176 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Flow 'volume_create_manager' (c7bfadf3-547c-442a-93cc-d0c008b812bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:23:28 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-4aefcd76-4602-480f-94c4-976e5c47b176 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Created volume successfully. Aug 29 01:23:29 devstack sudo[100840]: pam_unix(sudo:session): session closed for user root Aug 29 01:23:29 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-15e46708-c190-430b-a9ca-95e1b15d0e4c tempest-CreateVolumesFromSourceVolumeTest-722111983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-91c50c78-a1f9-483d-ae95-ea122f47c048 1073741824" returned: 0 in 0.644s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:23:29 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-15e46708-c190-430b-a9ca-95e1b15d0e4c tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-91c50c78-a1f9-483d-ae95-ea122f47c048 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:23:29 devstack sudo[100850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-91c50c78-a1f9-483d-ae95-ea122f47c048 Aug 29 01:23:29 devstack sudo[100850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:23:29 devstack sudo[100850]: pam_unix(sudo:session): session closed for user root Aug 29 01:23:29 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-15e46708-c190-430b-a9ca-95e1b15d0e4c tempest-CreateVolumesFromSourceVolumeTest-722111983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-91c50c78-a1f9-483d-ae95-ea122f47c048" returned: 0 in 0.319s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:23:29 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-15e46708-c190-430b-a9ca-95e1b15d0e4c tempest-CreateVolumesFromSourceVolumeTest-722111983 None] <== create_volume: return (1015ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:23:29 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-15e46708-c190-430b-a9ca-95e1b15d0e4c tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.019s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:23:29 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-72627726-fb2f-4825-b7ed-ea7686f31e4c tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.832s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:23:29 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-72627726-fb2f-4825-b7ed-ea7686f31e4c tempest-CreateVolumesFromSourceVolumeTest-722111983 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:23:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1763986717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=143ff940-fc54-4aef-8aef-37661b0f3c70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1798ae82367a42e4b2bc9fbd88b8448b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:23:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:23:27Z,use_quota=True,user_id='68815acc6f024579827c67e4d6dfb03c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:23:29 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-72627726-fb2f-4825-b7ed-ea7686f31e4c tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Creating volume 143ff940-fc54-4aef-8aef-37661b0f3c70 {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:23:29 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-72627726-fb2f-4825-b7ed-ea7686f31e4c tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:23:29 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-72627726-fb2f-4825-b7ed-ea7686f31e4c tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:23:29 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-72627726-fb2f-4825-b7ed-ea7686f31e4c tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:23:29 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-72627726-fb2f-4825-b7ed-ea7686f31e4c tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:23:29 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-72627726-fb2f-4825-b7ed-ea7686f31e4c tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:23:29 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-72627726-fb2f-4825-b7ed-ea7686f31e4c tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:23:29 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-72627726-fb2f-4825-b7ed-ea7686f31e4c tempest-CreateVolumesFromSourceVolumeTest-722111983 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:23:29 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-72627726-fb2f-4825-b7ed-ea7686f31e4c tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-143ff940-fc54-4aef-8aef-37661b0f3c70 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:23:29 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-15e46708-c190-430b-a9ca-95e1b15d0e4c tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce8c3e19-c038-4a5b-9e7d-c56139285985) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91c50c78-a1f9-483d-ae95-ea122f47c048', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:23:29 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-15e46708-c190-430b-a9ca-95e1b15d0e4c tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fdac3a6-01b7-4982-ab45-e0f76c61bebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:23:29 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-15e46708-c190-430b-a9ca-95e1b15d0e4c tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Volume volume-91c50c78-a1f9-483d-ae95-ea122f47c048 (91c50c78-a1f9-483d-ae95-ea122f47c048): created successfully Aug 29 01:23:29 devstack sudo[100870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-143ff940-fc54-4aef-8aef-37661b0f3c70 1073741824 Aug 29 01:23:29 devstack sudo[100870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:23:29 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-15e46708-c190-430b-a9ca-95e1b15d0e4c tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fdac3a6-01b7-4982-ab45-e0f76c61bebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:23:29 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-15e46708-c190-430b-a9ca-95e1b15d0e4c tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Flow 'volume_create_manager' (7963bdfa-47b6-41e7-980e-e51290a8bdff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:23:29 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-15e46708-c190-430b-a9ca-95e1b15d0e4c tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Created volume successfully. Aug 29 01:23:29 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [req-0d831ebe-080b-4be1-88da-d61e72efd510 req-71ef6bd8-3307-48b0-911c-00479e5cad9c tempest-TestServerVolumeAttachmentScenario-1287155210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:23:30 devstack sudo[100870]: pam_unix(sudo:session): session closed for user root Aug 29 01:23:30 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-72627726-fb2f-4825-b7ed-ea7686f31e4c tempest-CreateVolumesFromSourceVolumeTest-722111983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-143ff940-fc54-4aef-8aef-37661b0f3c70 1073741824" returned: 0 in 0.577s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:23:30 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-72627726-fb2f-4825-b7ed-ea7686f31e4c tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-143ff940-fc54-4aef-8aef-37661b0f3c70 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:23:30 devstack sudo[100902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-143ff940-fc54-4aef-8aef-37661b0f3c70 Aug 29 01:23:30 devstack sudo[100902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:23:30 devstack sudo[100902]: pam_unix(sudo:session): session closed for user root Aug 29 01:23:30 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-72627726-fb2f-4825-b7ed-ea7686f31e4c tempest-CreateVolumesFromSourceVolumeTest-722111983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-143ff940-fc54-4aef-8aef-37661b0f3c70" returned: 0 in 0.262s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:23:30 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-72627726-fb2f-4825-b7ed-ea7686f31e4c tempest-CreateVolumesFromSourceVolumeTest-722111983 None] <== create_volume: return (881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:23:30 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-72627726-fb2f-4825-b7ed-ea7686f31e4c tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.886s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:23:30 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-7331c21e-aa97-49a8-9436-94a96d1d07a6 tempest-VolumesGetTest-954660907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.092s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:23:30 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-7331c21e-aa97-49a8-9436-94a96d1d07a6 tempest-VolumesGetTest-954660907 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:23:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1247223193',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ae628b3-d6c1-4110-83dd-905d5aad2dde,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='5c4c32927df54b70ae25b85da6abe7ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:23:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:23:25Z,use_quota=True,user_id='6d651c7f6792483d90119c301b2dd999',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:23:30 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-7331c21e-aa97-49a8-9436-94a96d1d07a6 tempest-VolumesGetTest-954660907 None] Creating volume 7ae628b3-d6c1-4110-83dd-905d5aad2dde {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:23:30 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-7331c21e-aa97-49a8-9436-94a96d1d07a6 tempest-VolumesGetTest-954660907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:23:30 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-7331c21e-aa97-49a8-9436-94a96d1d07a6 tempest-VolumesGetTest-954660907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:23:30 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-7331c21e-aa97-49a8-9436-94a96d1d07a6 tempest-VolumesGetTest-954660907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:23:30 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-7331c21e-aa97-49a8-9436-94a96d1d07a6 tempest-VolumesGetTest-954660907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:23:30 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-7331c21e-aa97-49a8-9436-94a96d1d07a6 tempest-VolumesGetTest-954660907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:23:30 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-7331c21e-aa97-49a8-9436-94a96d1d07a6 tempest-VolumesGetTest-954660907 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:23:30 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-7331c21e-aa97-49a8-9436-94a96d1d07a6 tempest-VolumesGetTest-954660907 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:23:30 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-7331c21e-aa97-49a8-9436-94a96d1d07a6 tempest-VolumesGetTest-954660907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-7ae628b3-d6c1-4110-83dd-905d5aad2dde 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:23:30 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-72627726-fb2f-4825-b7ed-ea7686f31e4c tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c23d2fcd-7fb8-40fc-9900-e0ee825f0b99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-143ff940-fc54-4aef-8aef-37661b0f3c70', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:23:30 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-72627726-fb2f-4825-b7ed-ea7686f31e4c tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57246913-c670-451b-adf2-68947b45c781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:23:30 devstack sudo[100905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-7ae628b3-d6c1-4110-83dd-905d5aad2dde 1073741824 Aug 29 01:23:30 devstack sudo[100905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:23:30 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-72627726-fb2f-4825-b7ed-ea7686f31e4c tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Volume volume-143ff940-fc54-4aef-8aef-37661b0f3c70 (143ff940-fc54-4aef-8aef-37661b0f3c70): created successfully Aug 29 01:23:30 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-72627726-fb2f-4825-b7ed-ea7686f31e4c tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57246913-c670-451b-adf2-68947b45c781) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:23:30 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-72627726-fb2f-4825-b7ed-ea7686f31e4c tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Flow 'volume_create_manager' (8748428b-db11-48f8-8393-137222aab974) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:23:30 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-72627726-fb2f-4825-b7ed-ea7686f31e4c tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Created volume successfully. Aug 29 01:23:30 devstack sudo[100905]: pam_unix(sudo:session): session closed for user root Aug 29 01:23:30 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-7331c21e-aa97-49a8-9436-94a96d1d07a6 tempest-VolumesGetTest-954660907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-7ae628b3-d6c1-4110-83dd-905d5aad2dde 1073741824" returned: 0 in 0.485s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:23:30 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-7331c21e-aa97-49a8-9436-94a96d1d07a6 tempest-VolumesGetTest-954660907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-7ae628b3-d6c1-4110-83dd-905d5aad2dde {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:23:30 devstack sudo[100911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-7ae628b3-d6c1-4110-83dd-905d5aad2dde Aug 29 01:23:30 devstack sudo[100911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:23:31 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-2b51c713-422a-4829-875d-972644575517 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Acquiring lock "cinder-143ff940-fc54-4aef-8aef-37661b0f3c70-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:23:31 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-2b51c713-422a-4829-875d-972644575517 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Lock "cinder-143ff940-fc54-4aef-8aef-37661b0f3c70-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:23:31 devstack sudo[100911]: pam_unix(sudo:session): session closed for user root Aug 29 01:23:31 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-7331c21e-aa97-49a8-9436-94a96d1d07a6 tempest-VolumesGetTest-954660907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-7ae628b3-d6c1-4110-83dd-905d5aad2dde" returned: 0 in 0.298s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:23:31 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-7331c21e-aa97-49a8-9436-94a96d1d07a6 tempest-VolumesGetTest-954660907 None] <== create_volume: return (820ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:23:31 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-7331c21e-aa97-49a8-9436-94a96d1d07a6 tempest-VolumesGetTest-954660907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.824s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:23:31 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [req-0d831ebe-080b-4be1-88da-d61e72efd510 req-71ef6bd8-3307-48b0-911c-00479e5cad9c tempest-TestServerVolumeAttachmentScenario-1287155210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.412s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:23:31 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-2b51c713-422a-4829-875d-972644575517 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Acquiring lock "cinder-quobyte-143ff940-fc54-4aef-8aef-37661b0f3c70" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:23:31 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [req-0d831ebe-080b-4be1-88da-d61e72efd510 req-71ef6bd8-3307-48b0-911c-00479e5cad9c tempest-TestServerVolumeAttachmentScenario-1287155210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.032s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:23:31 devstack cinder-volume[86111]: DEBUG cinder.volume.volume_utils [None req-7331c21e-aa97-49a8-9436-94a96d1d07a6 tempest-VolumesGetTest-954660907 None] Attempting download of f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab ((None, [{'url': 'file:///opt/stack/data/glance/images/f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab', 'metadata': {}}])) to volume 7ae628b3-d6c1-4110-83dd-905d5aad2dde. {{(pid=86111) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 29 01:23:31 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-2b51c713-422a-4829-875d-972644575517 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Lock "cinder-quobyte-143ff940-fc54-4aef-8aef-37661b0f3c70" acquired by "delete_volume" :: waited 0.028s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:23:31 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[5472bbb8-a7b4-4ce4-a21f-1c28a26124ac]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:23:31 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-2b51c713-422a-4829-875d-972644575517 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-143ff940-fc54-4aef-8aef-37661b0f3c70 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:23:31 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[b348c0e9-5c9d-4bb6-b988-53bb3efbb7a3]: (4, 'raw') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:23:31 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-7331c21e-aa97-49a8-9436-94a96d1d07a6 tempest-VolumesGetTest-954660907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab_mtd0xlhm {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:23:31 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [req-0d831ebe-080b-4be1-88da-d61e72efd510 req-71ef6bd8-3307-48b0-911c-00479e5cad9c tempest-TestServerVolumeAttachmentScenario-1287155210 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630', 'name': 'volume-ad972605-1a2f-492a-85cf-b624da47d1e8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cba3e603-0880-40ef-a35f-1187f0f1d7c1', 'enforce_multipath': True} {{(pid=86111) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 29 01:23:31 devstack sudo[100914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-143ff940-fc54-4aef-8aef-37661b0f3c70 Aug 29 01:23:31 devstack sudo[100914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:23:31 devstack cinder-volume[86111]: INFO cinder.volume.manager [req-0d831ebe-080b-4be1-88da-d61e72efd510 req-71ef6bd8-3307-48b0-911c-00479e5cad9c tempest-TestServerVolumeAttachmentScenario-1287155210 None] attachment_update completed successfully. Aug 29 01:23:31 devstack sudo[100915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab_mtd0xlhm Aug 29 01:23:31 devstack sudo[100915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:23:31 devstack sudo[100914]: pam_unix(sudo:session): session closed for user root Aug 29 01:23:31 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-2b51c713-422a-4829-875d-972644575517 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-143ff940-fc54-4aef-8aef-37661b0f3c70" returned: 0 in 0.458s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:23:31 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-2b51c713-422a-4829-875d-972644575517 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-143ff940-fc54-4aef-8aef-37661b0f3c70 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:23:31 devstack sudo[100927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-143ff940-fc54-4aef-8aef-37661b0f3c70 Aug 29 01:23:31 devstack sudo[100927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:23:31 devstack sudo[100915]: pam_unix(sudo:session): session closed for user root Aug 29 01:23:31 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-7331c21e-aa97-49a8-9436-94a96d1d07a6 tempest-VolumesGetTest-954660907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab_mtd0xlhm" returned: 0 in 0.487s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:23:31 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-7331c21e-aa97-49a8-9436-94a96d1d07a6 tempest-VolumesGetTest-954660907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab_mtd0xlhm {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:23:31 devstack sudo[100929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab_mtd0xlhm Aug 29 01:23:31 devstack sudo[100929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:23:32 devstack sudo[100927]: pam_unix(sudo:session): session closed for user root Aug 29 01:23:32 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-2b51c713-422a-4829-875d-972644575517 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-143ff940-fc54-4aef-8aef-37661b0f3c70" returned: 0 in 0.306s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:23:32 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-2b51c713-422a-4829-875d-972644575517 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Lock "cinder-quobyte-143ff940-fc54-4aef-8aef-37661b0f3c70" released by "delete_volume" :: held 0.843s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:23:32 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-2b51c713-422a-4829-875d-972644575517 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Created reservations ['a0658acc-8000-4c9e-b599-f47c386d5a56', '85613118-6906-4080-b41a-2a87943f1e42', '2a18baff-b05f-4321-b2bd-14a27346c1d4', '9b026221-8b4c-400b-b7dd-b65c1e2ce2b2'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:23:32 devstack sudo[100929]: pam_unix(sudo:session): session closed for user root Aug 29 01:23:32 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-2b51c713-422a-4829-875d-972644575517 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:23:32 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-2b51c713-422a-4829-875d-972644575517 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:23:32 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-2b51c713-422a-4829-875d-972644575517 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:23:32 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-2b51c713-422a-4829-875d-972644575517 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:23:32 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-2b51c713-422a-4829-875d-972644575517 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:23:32 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-2b51c713-422a-4829-875d-972644575517 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:23:32 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-7331c21e-aa97-49a8-9436-94a96d1d07a6 tempest-VolumesGetTest-954660907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab_mtd0xlhm" returned: 1 in 0.503s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:23:32 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-7331c21e-aa97-49a8-9436-94a96d1d07a6 tempest-VolumesGetTest-954660907 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab_mtd0xlhm' failed. Not Retrying. {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 29 01:23:32 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[20a713ae-5847-444a-a719-eab0b077da82]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:23:32 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-7331c21e-aa97-49a8-9436-94a96d1d07a6 tempest-VolumesGetTest-954660907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab_754vlkn0devstack@QuobyteHD {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:23:32 devstack sudo[100934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:23:32 devstack sudo[100934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:23:32 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-fe3d3b49-40b2-4905-a6d4-3ba424a156f6 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Acquiring lock "cinder-91c50c78-a1f9-483d-ae95-ea122f47c048-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:23:32 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-fe3d3b49-40b2-4905-a6d4-3ba424a156f6 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Lock "cinder-91c50c78-a1f9-483d-ae95-ea122f47c048-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:23:32 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-fe3d3b49-40b2-4905-a6d4-3ba424a156f6 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Acquiring lock "cinder-quobyte-91c50c78-a1f9-483d-ae95-ea122f47c048" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:23:32 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-fe3d3b49-40b2-4905-a6d4-3ba424a156f6 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Lock "cinder-quobyte-91c50c78-a1f9-483d-ae95-ea122f47c048" acquired by "delete_volume" :: waited 0.020s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:23:32 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[60bae275-8364-4603-99ec-5e01d52e6e41]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:23:32 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-fe3d3b49-40b2-4905-a6d4-3ba424a156f6 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-91c50c78-a1f9-483d-ae95-ea122f47c048 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:23:32 devstack sudo[100935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab_754vlkn0devstack@QuobyteHD Aug 29 01:23:32 devstack sudo[100935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:23:32 devstack sudo[100934]: pam_unix(sudo:session): session closed for user root Aug 29 01:23:32 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-2b51c713-422a-4829-875d-972644575517 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.323s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:23:32 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-2b51c713-422a-4829-875d-972644575517 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:23:32 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-2b51c713-422a-4829-875d-972644575517 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Deleted volume successfully. Aug 29 01:23:32 devstack sudo[100938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-91c50c78-a1f9-483d-ae95-ea122f47c048 Aug 29 01:23:32 devstack sudo[100938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:23:32 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-2b51c713-422a-4829-875d-972644575517 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Lock "cinder-143ff940-fc54-4aef-8aef-37661b0f3c70-delete_volume" released by "delete_volume" :: held 1.528s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:23:32 devstack sudo[100935]: pam_unix(sudo:session): session closed for user root Aug 29 01:23:32 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-7331c21e-aa97-49a8-9436-94a96d1d07a6 tempest-VolumesGetTest-954660907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab_754vlkn0devstack@QuobyteHD" returned: 0 in 0.495s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:23:32 devstack cinder-volume[86111]: DEBUG cinder.image.image_utils [None req-7331c21e-aa97-49a8-9436-94a96d1d07a6 tempest-VolumesGetTest-954660907 None] f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab was qcow2, converting to qcow2 {{(pid=86111) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 29 01:23:32 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-7331c21e-aa97-49a8-9436-94a96d1d07a6 tempest-VolumesGetTest-954660907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab_754vlkn0devstack@QuobyteHD /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-7ae628b3-d6c1-4110-83dd-905d5aad2dde {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:23:32 devstack sudo[100945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab_754vlkn0devstack@QuobyteHD /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-7ae628b3-d6c1-4110-83dd-905d5aad2dde Aug 29 01:23:32 devstack sudo[100945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:23:33 devstack sudo[100938]: pam_unix(sudo:session): session closed for user root Aug 29 01:23:33 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-fe3d3b49-40b2-4905-a6d4-3ba424a156f6 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-91c50c78-a1f9-483d-ae95-ea122f47c048" returned: 0 in 0.484s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:23:33 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-fe3d3b49-40b2-4905-a6d4-3ba424a156f6 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-91c50c78-a1f9-483d-ae95-ea122f47c048 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:23:33 devstack sudo[100950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-91c50c78-a1f9-483d-ae95-ea122f47c048 Aug 29 01:23:33 devstack sudo[100950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:23:33 devstack sudo[100950]: pam_unix(sudo:session): session closed for user root Aug 29 01:23:33 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-fe3d3b49-40b2-4905-a6d4-3ba424a156f6 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-91c50c78-a1f9-483d-ae95-ea122f47c048" returned: 0 in 0.343s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:23:33 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-fe3d3b49-40b2-4905-a6d4-3ba424a156f6 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Lock "cinder-quobyte-91c50c78-a1f9-483d-ae95-ea122f47c048" released by "delete_volume" :: held 0.879s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:23:33 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-fe3d3b49-40b2-4905-a6d4-3ba424a156f6 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Created reservations ['7f63e1ff-d5ca-4d0f-a400-ce68b4b6e38d', 'f7564714-dc4e-42d7-825c-2cd706e74a7b', '930f375b-9ed0-4467-a774-a499c53a66a5', '835573d7-bd45-4f50-99bb-46df98d8d702'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:23:33 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-fe3d3b49-40b2-4905-a6d4-3ba424a156f6 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:23:33 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-fe3d3b49-40b2-4905-a6d4-3ba424a156f6 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:23:33 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-fe3d3b49-40b2-4905-a6d4-3ba424a156f6 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:23:33 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-fe3d3b49-40b2-4905-a6d4-3ba424a156f6 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:23:33 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-fe3d3b49-40b2-4905-a6d4-3ba424a156f6 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:23:33 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-fe3d3b49-40b2-4905-a6d4-3ba424a156f6 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:23:33 devstack sudo[100962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:23:33 devstack sudo[100962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:23:33 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-318ac8f1-642c-40e7-a9c4-ce59d4e72489 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Acquiring lock "cinder-adacf612-3612-490a-8bd7-2370fc34e46a-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:23:33 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-318ac8f1-642c-40e7-a9c4-ce59d4e72489 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Lock "cinder-adacf612-3612-490a-8bd7-2370fc34e46a-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:23:33 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-318ac8f1-642c-40e7-a9c4-ce59d4e72489 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Acquiring lock "cinder-quobyte-adacf612-3612-490a-8bd7-2370fc34e46a" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:23:33 devstack cinder-volume[86111]: INFO cinder.volume.manager [req-cddc7322-4671-4311-a774-42094d27c585 req-5ee6a078-2cd2-439a-85c9-f06e4b8ee780 tempest-TestServerVolumeAttachmentScenario-1287155210 None] Terminate volume connection completed successfully. Aug 29 01:23:33 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [req-cddc7322-4671-4311-a774-42094d27c585 req-5ee6a078-2cd2-439a-85c9-f06e4b8ee780 tempest-TestServerVolumeAttachmentScenario-1287155210 None] Deleting attachment cba3e603-0880-40ef-a35f-1187f0f1d7c1. {{(pid=86111) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 29 01:23:33 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-318ac8f1-642c-40e7-a9c4-ce59d4e72489 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Lock "cinder-quobyte-adacf612-3612-490a-8bd7-2370fc34e46a" acquired by "delete_volume" :: waited 0.033s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:23:33 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[e85eaba4-4fa1-4c01-83e2-bef280fd8cb0]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:23:33 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-318ac8f1-642c-40e7-a9c4-ce59d4e72489 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-adacf612-3612-490a-8bd7-2370fc34e46a {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:23:33 devstack sudo[100962]: pam_unix(sudo:session): session closed for user root Aug 29 01:23:33 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-fe3d3b49-40b2-4905-a6d4-3ba424a156f6 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.386s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:23:33 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-fe3d3b49-40b2-4905-a6d4-3ba424a156f6 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:23:33 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-fe3d3b49-40b2-4905-a6d4-3ba424a156f6 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Deleted volume successfully. Aug 29 01:23:33 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-fe3d3b49-40b2-4905-a6d4-3ba424a156f6 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Lock "cinder-91c50c78-a1f9-483d-ae95-ea122f47c048-delete_volume" released by "delete_volume" :: held 1.567s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:23:33 devstack sudo[100965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-adacf612-3612-490a-8bd7-2370fc34e46a Aug 29 01:23:33 devstack sudo[100965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:23:34 devstack sudo[100965]: pam_unix(sudo:session): session closed for user root Aug 29 01:23:34 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-318ac8f1-642c-40e7-a9c4-ce59d4e72489 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-adacf612-3612-490a-8bd7-2370fc34e46a" returned: 0 in 0.512s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:23:34 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-318ac8f1-642c-40e7-a9c4-ce59d4e72489 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-adacf612-3612-490a-8bd7-2370fc34e46a {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:23:34 devstack sudo[100971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-adacf612-3612-490a-8bd7-2370fc34e46a Aug 29 01:23:34 devstack sudo[100971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:23:34 devstack sudo[100971]: pam_unix(sudo:session): session closed for user root Aug 29 01:23:34 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-318ac8f1-642c-40e7-a9c4-ce59d4e72489 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-adacf612-3612-490a-8bd7-2370fc34e46a" returned: 0 in 0.342s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:23:34 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-318ac8f1-642c-40e7-a9c4-ce59d4e72489 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Lock "cinder-quobyte-adacf612-3612-490a-8bd7-2370fc34e46a" released by "delete_volume" :: held 0.916s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:23:34 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-318ac8f1-642c-40e7-a9c4-ce59d4e72489 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Created reservations ['16a4beca-0980-473a-9a0c-83abffd29efa', 'f99484f8-9b22-4d5a-8992-32ee07c8e691', 'a6e97f23-8aa6-46d2-b3b0-b2d9f7def8ab', '4f37b178-af8a-4772-8b85-29d34827384e'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:23:34 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-318ac8f1-642c-40e7-a9c4-ce59d4e72489 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:23:34 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-318ac8f1-642c-40e7-a9c4-ce59d4e72489 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:23:34 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-318ac8f1-642c-40e7-a9c4-ce59d4e72489 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:23:34 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-318ac8f1-642c-40e7-a9c4-ce59d4e72489 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:23:34 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-318ac8f1-642c-40e7-a9c4-ce59d4e72489 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:23:34 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-318ac8f1-642c-40e7-a9c4-ce59d4e72489 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:23:34 devstack sudo[100974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:23:34 devstack sudo[100974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:23:35 devstack sudo[100974]: pam_unix(sudo:session): session closed for user root Aug 29 01:23:35 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-318ac8f1-642c-40e7-a9c4-ce59d4e72489 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.335s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:23:35 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-318ac8f1-642c-40e7-a9c4-ce59d4e72489 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:23:35 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-318ac8f1-642c-40e7-a9c4-ce59d4e72489 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Deleted volume successfully. Aug 29 01:23:35 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-318ac8f1-642c-40e7-a9c4-ce59d4e72489 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Lock "cinder-adacf612-3612-490a-8bd7-2370fc34e46a-delete_volume" released by "delete_volume" :: held 1.546s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:23:35 devstack sudo[100945]: pam_unix(sudo:session): session closed for user root Aug 29 01:23:35 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-7331c21e-aa97-49a8-9436-94a96d1d07a6 tempest-VolumesGetTest-954660907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab_754vlkn0devstack@QuobyteHD /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-7ae628b3-d6c1-4110-83dd-905d5aad2dde" returned: 0 in 2.449s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:23:35 devstack cinder-volume[86111]: DEBUG cinder.image.image_utils [None req-7331c21e-aa97-49a8-9436-94a96d1d07a6 tempest-VolumesGetTest-954660907 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab_754vlkn0devstack@QuobyteHD, size 112.00 MB, duration 2.45 sec, destination /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-7ae628b3-d6c1-4110-83dd-905d5aad2dde {{(pid=86111) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 29 01:23:35 devstack cinder-volume[86111]: INFO cinder.image.image_utils [None req-7331c21e-aa97-49a8-9436-94a96d1d07a6 tempest-VolumesGetTest-954660907 None] Converted 112.00 MB image at 45.67 MB/s Aug 29 01:23:35 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-7331c21e-aa97-49a8-9436-94a96d1d07a6 tempest-VolumesGetTest-954660907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-7ae628b3-d6c1-4110-83dd-905d5aad2dde 1G {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:23:35 devstack sudo[100977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-7ae628b3-d6c1-4110-83dd-905d5aad2dde 1G Aug 29 01:23:35 devstack sudo[100977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:23:35 devstack cinder-volume[86111]: INFO cinder.volume.manager [req-cf1fa4cb-2827-4daa-aee3-ddc0c83eb7d6 req-afeede7e-0845-4c2c-9e8f-2e5b8d90a93e tempest-TestServerVolumeAttachmentScenario-1287155210 None] Terminate volume connection completed successfully. Aug 29 01:23:35 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [req-cf1fa4cb-2827-4daa-aee3-ddc0c83eb7d6 req-afeede7e-0845-4c2c-9e8f-2e5b8d90a93e tempest-TestServerVolumeAttachmentScenario-1287155210 None] Deleting attachment 1b09512d-1625-4e29-b014-472a32d60461. {{(pid=86111) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 29 01:23:35 devstack sudo[100977]: pam_unix(sudo:session): session closed for user root Aug 29 01:23:35 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-7331c21e-aa97-49a8-9436-94a96d1d07a6 tempest-VolumesGetTest-954660907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-7ae628b3-d6c1-4110-83dd-905d5aad2dde 1G" returned: 0 in 0.432s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:23:35 devstack cinder-volume[86111]: DEBUG cinder.volume.volume_utils [None req-7331c21e-aa97-49a8-9436-94a96d1d07a6 tempest-VolumesGetTest-954660907 None] Downloaded image f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab ((None, [{'url': 'file:///opt/stack/data/glance/images/f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab', 'metadata': {}}])) to volume 7ae628b3-d6c1-4110-83dd-905d5aad2dde successfully. {{(pid=86111) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 29 01:23:35 devstack cinder-volume[86111]: DEBUG cinder.image.image_utils [None req-7331c21e-aa97-49a8-9436-94a96d1d07a6 tempest-VolumesGetTest-954660907 None] Temporary image f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab for user 6d651c7f6792483d90119c301b2dd999 is deleted. {{(pid=86111) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 29 01:23:35 devstack cinder-volume[86111]: DEBUG cinder.volume.volume_utils [None req-7331c21e-aa97-49a8-9436-94a96d1d07a6 tempest-VolumesGetTest-954660907 None] Marking volume 7ae628b3-d6c1-4110-83dd-905d5aad2dde as bootable. {{(pid=86111) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 29 01:23:35 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-7331c21e-aa97-49a8-9436-94a96d1d07a6 tempest-VolumesGetTest-954660907 None] Copying metadata from image f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab to 7ae628b3-d6c1-4110-83dd-905d5aad2dde. {{(pid=86111) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 29 01:23:35 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-7331c21e-aa97-49a8-9436-94a96d1d07a6 tempest-VolumesGetTest-954660907 None] Creating volume glance metadata for volume 7ae628b3-d6c1-4110-83dd-905d5aad2dde backed by image f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86111) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 29 01:23:35 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-7331c21e-aa97-49a8-9436-94a96d1d07a6 tempest-VolumesGetTest-954660907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0785a7a2-283c-44e5-aa14-619e112113ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ae628b3-d6c1-4110-83dd-905d5aad2dde', 'volume_size': 1, 'image_id': 'f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8d940113004947258ae710723d273006', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab', 'created_at': datetime.datetime(2026, 8, 28, 23, 3, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 23, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:23:35 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-7331c21e-aa97-49a8-9436-94a96d1d07a6 tempest-VolumesGetTest-954660907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c6e3b75-e0a8-435f-ad3f-c23d859c5532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:23:35 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-7331c21e-aa97-49a8-9436-94a96d1d07a6 tempest-VolumesGetTest-954660907 None] Volume volume-7ae628b3-d6c1-4110-83dd-905d5aad2dde (7ae628b3-d6c1-4110-83dd-905d5aad2dde): created successfully Aug 29 01:23:35 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-7331c21e-aa97-49a8-9436-94a96d1d07a6 tempest-VolumesGetTest-954660907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c6e3b75-e0a8-435f-ad3f-c23d859c5532) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:23:35 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-7331c21e-aa97-49a8-9436-94a96d1d07a6 tempest-VolumesGetTest-954660907 None] Flow 'volume_create_manager' (ed77f88d-528a-4699-9968-395b2b806f56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:23:35 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-7331c21e-aa97-49a8-9436-94a96d1d07a6 tempest-VolumesGetTest-954660907 None] Created volume successfully. Aug 29 01:23:35 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-af5a7fab-f306-4ba3-a18b-afd1d91e200a tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Acquiring lock "cinder-620646ab-1eaa-4c18-9992-565d344cdedc-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:23:35 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-af5a7fab-f306-4ba3-a18b-afd1d91e200a tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Lock "cinder-620646ab-1eaa-4c18-9992-565d344cdedc-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:23:35 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-af5a7fab-f306-4ba3-a18b-afd1d91e200a tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Acquiring lock "cinder-quobyte-620646ab-1eaa-4c18-9992-565d344cdedc" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:23:36 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-af5a7fab-f306-4ba3-a18b-afd1d91e200a tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Lock "cinder-quobyte-620646ab-1eaa-4c18-9992-565d344cdedc" acquired by "delete_volume" :: waited 0.014s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:23:36 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[099473a3-69ff-4b66-ab2a-7ea13822b07c]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:23:36 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-af5a7fab-f306-4ba3-a18b-afd1d91e200a tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-620646ab-1eaa-4c18-9992-565d344cdedc {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:23:36 devstack sudo[101010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-620646ab-1eaa-4c18-9992-565d344cdedc Aug 29 01:23:36 devstack sudo[101010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:23:36 devstack sudo[101010]: pam_unix(sudo:session): session closed for user root Aug 29 01:23:36 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-af5a7fab-f306-4ba3-a18b-afd1d91e200a tempest-CreateVolumesFromSourceVolumeTest-722111983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-620646ab-1eaa-4c18-9992-565d344cdedc" returned: 0 in 0.447s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:23:36 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-af5a7fab-f306-4ba3-a18b-afd1d91e200a tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-620646ab-1eaa-4c18-9992-565d344cdedc {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:23:36 devstack sudo[101015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-620646ab-1eaa-4c18-9992-565d344cdedc Aug 29 01:23:36 devstack sudo[101015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:23:36 devstack sudo[101015]: pam_unix(sudo:session): session closed for user root Aug 29 01:23:36 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-af5a7fab-f306-4ba3-a18b-afd1d91e200a tempest-CreateVolumesFromSourceVolumeTest-722111983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-620646ab-1eaa-4c18-9992-565d344cdedc" returned: 0 in 0.424s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:23:36 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-af5a7fab-f306-4ba3-a18b-afd1d91e200a tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Lock "cinder-quobyte-620646ab-1eaa-4c18-9992-565d344cdedc" released by "delete_volume" :: held 0.981s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:23:37 devstack cinder-volume[86111]: DEBUG dbcounter [-] [86111] Writing DB stats cinder:UPDATE=209,cinder:SELECT=176,cinder:INSERT=56,cinder:DELETE=14 {{(pid=86111) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 29 01:23:37 devstack cinder-volume[86111]: DEBUG dbcounter [-] [86111] Writing DB stats cinder:SELECT=153,cinder:UPDATE=222,cinder:DELETE=26,cinder:INSERT=54 {{(pid=86111) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 29 01:23:37 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-af5a7fab-f306-4ba3-a18b-afd1d91e200a tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Created reservations ['05509448-cfbf-4646-b628-108dde5dea5b', 'a543818c-eb2c-48d5-88b9-b6b1c2c6dc38', '577c4698-719c-4610-aaab-0b411d7fea9c', '43cb72bc-4350-4faf-9479-720fe2feb3f0'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:23:37 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-af5a7fab-f306-4ba3-a18b-afd1d91e200a tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:23:37 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-af5a7fab-f306-4ba3-a18b-afd1d91e200a tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:23:37 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-af5a7fab-f306-4ba3-a18b-afd1d91e200a tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:23:37 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-af5a7fab-f306-4ba3-a18b-afd1d91e200a tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:23:37 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-af5a7fab-f306-4ba3-a18b-afd1d91e200a tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:23:37 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-af5a7fab-f306-4ba3-a18b-afd1d91e200a tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:23:37 devstack sudo[101037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:23:37 devstack sudo[101037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:23:37 devstack sudo[101037]: pam_unix(sudo:session): session closed for user root Aug 29 01:23:37 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-af5a7fab-f306-4ba3-a18b-afd1d91e200a tempest-CreateVolumesFromSourceVolumeTest-722111983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.434s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:23:37 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-af5a7fab-f306-4ba3-a18b-afd1d91e200a tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:23:37 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-af5a7fab-f306-4ba3-a18b-afd1d91e200a tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Deleted volume successfully. Aug 29 01:23:37 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-af5a7fab-f306-4ba3-a18b-afd1d91e200a tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Lock "cinder-620646ab-1eaa-4c18-9992-565d344cdedc-delete_volume" released by "delete_volume" :: held 1.779s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:23:37 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8964403-01f0-4df1-8668-5a9843b1647f tempest-VolumesGetTest-954660907 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:23:37 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-e8964403-01f0-4df1-8668-5a9843b1647f tempest-VolumesGetTest-954660907 None] Flow 'volume_create_manager' (f81dffe6-a171-41ad-b390-8d81fb93f4dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:23:37 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-e8964403-01f0-4df1-8668-5a9843b1647f tempest-VolumesGetTest-954660907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02809e84-7c88-4b75-95f6-75b636e02fac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:23:37 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-e8964403-01f0-4df1-8668-5a9843b1647f tempest-VolumesGetTest-954660907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02809e84-7c88-4b75-95f6-75b636e02fac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:23:37Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1908901087',display_name='tempest-VolumesGetTest-Volume-410244060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91b42cc2-bc4f-4ca0-a8c9-5cd30036ec49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c4c32927df54b70ae25b85da6abe7ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:23:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:23:38Z,use_quota=True,user_id='6d651c7f6792483d90119c301b2dd999',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:23:37 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-e8964403-01f0-4df1-8668-5a9843b1647f tempest-VolumesGetTest-954660907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (841daae0-86fd-434b-8540-c8d7ca0a2dbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:23:37 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-e8964403-01f0-4df1-8668-5a9843b1647f tempest-VolumesGetTest-954660907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (841daae0-86fd-434b-8540-c8d7ca0a2dbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:23:37 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-e8964403-01f0-4df1-8668-5a9843b1647f tempest-VolumesGetTest-954660907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbd57b71-f522-474d-bd61-62cb6bc3a349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:23:37 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-e8964403-01f0-4df1-8668-5a9843b1647f tempest-VolumesGetTest-954660907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbd57b71-f522-474d-bd61-62cb6bc3a349) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91b42cc2-bc4f-4ca0-a8c9-5cd30036ec49', 'volume_name': 'volume-91b42cc2-bc4f-4ca0-a8c9-5cd30036ec49', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:23:37 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-e8964403-01f0-4df1-8668-5a9843b1647f tempest-VolumesGetTest-954660907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd593686-8c4f-4c20-8f86-5e28c59e93c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:23:37 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-e8964403-01f0-4df1-8668-5a9843b1647f tempest-VolumesGetTest-954660907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd593686-8c4f-4c20-8f86-5e28c59e93c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:23:37 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-e8964403-01f0-4df1-8668-5a9843b1647f tempest-VolumesGetTest-954660907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0589a07-000a-40c4-b53e-5d431afc8a65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:23:37 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-e8964403-01f0-4df1-8668-5a9843b1647f tempest-VolumesGetTest-954660907 None] Volume 91b42cc2-bc4f-4ca0-a8c9-5cd30036ec49: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91b42cc2-bc4f-4ca0-a8c9-5cd30036ec49', 'volume_size': 1} Aug 29 01:23:37 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-e8964403-01f0-4df1-8668-5a9843b1647f tempest-VolumesGetTest-954660907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:23:37 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-e8964403-01f0-4df1-8668-5a9843b1647f tempest-VolumesGetTest-954660907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:23:37 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-e8964403-01f0-4df1-8668-5a9843b1647f tempest-VolumesGetTest-954660907 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:23:37Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1908901087',display_name='tempest-VolumesGetTest-Volume-410244060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91b42cc2-bc4f-4ca0-a8c9-5cd30036ec49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c4c32927df54b70ae25b85da6abe7ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:23:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:23:38Z,use_quota=True,user_id='6d651c7f6792483d90119c301b2dd999',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:23:37 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-e8964403-01f0-4df1-8668-5a9843b1647f tempest-VolumesGetTest-954660907 None] Creating volume 91b42cc2-bc4f-4ca0-a8c9-5cd30036ec49 {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:23:37 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-e8964403-01f0-4df1-8668-5a9843b1647f tempest-VolumesGetTest-954660907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:23:37 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-e8964403-01f0-4df1-8668-5a9843b1647f tempest-VolumesGetTest-954660907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:23:37 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-e8964403-01f0-4df1-8668-5a9843b1647f tempest-VolumesGetTest-954660907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:23:37 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-e8964403-01f0-4df1-8668-5a9843b1647f tempest-VolumesGetTest-954660907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:23:37 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-e8964403-01f0-4df1-8668-5a9843b1647f tempest-VolumesGetTest-954660907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:23:37 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-e8964403-01f0-4df1-8668-5a9843b1647f tempest-VolumesGetTest-954660907 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:23:37 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-e8964403-01f0-4df1-8668-5a9843b1647f tempest-VolumesGetTest-954660907 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:23:37 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-e8964403-01f0-4df1-8668-5a9843b1647f tempest-VolumesGetTest-954660907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-91b42cc2-bc4f-4ca0-a8c9-5cd30036ec49 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:23:37 devstack sudo[101041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-91b42cc2-bc4f-4ca0-a8c9-5cd30036ec49 1073741824 Aug 29 01:23:37 devstack sudo[101041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:23:38 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-12f93aa1-e818-43ef-b966-b265cf7bd253 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Acquiring lock "cinder-0b6ebe00-36a5-4369-8f3a-b2f79d194562-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:23:38 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-12f93aa1-e818-43ef-b966-b265cf7bd253 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Lock "cinder-0b6ebe00-36a5-4369-8f3a-b2f79d194562-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:23:38 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-12f93aa1-e818-43ef-b966-b265cf7bd253 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Acquiring lock "cinder-quobyte-0b6ebe00-36a5-4369-8f3a-b2f79d194562" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:23:38 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-12f93aa1-e818-43ef-b966-b265cf7bd253 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Lock "cinder-quobyte-0b6ebe00-36a5-4369-8f3a-b2f79d194562" acquired by "delete_volume" :: waited 0.025s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:23:38 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[834822e3-a6e5-4302-8c44-310a3e716305]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:23:38 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-12f93aa1-e818-43ef-b966-b265cf7bd253 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-0b6ebe00-36a5-4369-8f3a-b2f79d194562 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:23:38 devstack sudo[101041]: pam_unix(sudo:session): session closed for user root Aug 29 01:23:38 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-e8964403-01f0-4df1-8668-5a9843b1647f tempest-VolumesGetTest-954660907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-91b42cc2-bc4f-4ca0-a8c9-5cd30036ec49 1073741824" returned: 0 in 0.718s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:23:38 devstack sudo[101049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-0b6ebe00-36a5-4369-8f3a-b2f79d194562 Aug 29 01:23:38 devstack sudo[101049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:23:38 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-e8964403-01f0-4df1-8668-5a9843b1647f tempest-VolumesGetTest-954660907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-91b42cc2-bc4f-4ca0-a8c9-5cd30036ec49 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:23:38 devstack sudo[101051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-91b42cc2-bc4f-4ca0-a8c9-5cd30036ec49 Aug 29 01:23:38 devstack sudo[101051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:23:39 devstack sudo[101049]: pam_unix(sudo:session): session closed for user root Aug 29 01:23:39 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-12f93aa1-e818-43ef-b966-b265cf7bd253 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-0b6ebe00-36a5-4369-8f3a-b2f79d194562" returned: 0 in 0.521s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:23:39 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-12f93aa1-e818-43ef-b966-b265cf7bd253 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-0b6ebe00-36a5-4369-8f3a-b2f79d194562 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:23:39 devstack sudo[101051]: pam_unix(sudo:session): session closed for user root Aug 29 01:23:39 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-e8964403-01f0-4df1-8668-5a9843b1647f tempest-VolumesGetTest-954660907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-91b42cc2-bc4f-4ca0-a8c9-5cd30036ec49" returned: 0 in 0.371s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:23:39 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-e8964403-01f0-4df1-8668-5a9843b1647f tempest-VolumesGetTest-954660907 None] <== create_volume: return (1166ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:23:39 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-e8964403-01f0-4df1-8668-5a9843b1647f tempest-VolumesGetTest-954660907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.169s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:23:39 devstack sudo[101058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-0b6ebe00-36a5-4369-8f3a-b2f79d194562 Aug 29 01:23:39 devstack sudo[101058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:23:39 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-e8964403-01f0-4df1-8668-5a9843b1647f tempest-VolumesGetTest-954660907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0589a07-000a-40c4-b53e-5d431afc8a65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91b42cc2-bc4f-4ca0-a8c9-5cd30036ec49', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:23:39 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-e8964403-01f0-4df1-8668-5a9843b1647f tempest-VolumesGetTest-954660907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6827aae4-4854-47bd-872d-d98fa8aaa938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:23:39 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-e8964403-01f0-4df1-8668-5a9843b1647f tempest-VolumesGetTest-954660907 None] Volume volume-91b42cc2-bc4f-4ca0-a8c9-5cd30036ec49 (91b42cc2-bc4f-4ca0-a8c9-5cd30036ec49): created successfully Aug 29 01:23:39 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-e8964403-01f0-4df1-8668-5a9843b1647f tempest-VolumesGetTest-954660907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6827aae4-4854-47bd-872d-d98fa8aaa938) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:23:39 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-e8964403-01f0-4df1-8668-5a9843b1647f tempest-VolumesGetTest-954660907 None] Flow 'volume_create_manager' (f81dffe6-a171-41ad-b390-8d81fb93f4dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:23:39 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-e8964403-01f0-4df1-8668-5a9843b1647f tempest-VolumesGetTest-954660907 None] Created volume successfully. Aug 29 01:23:39 devstack sudo[101058]: pam_unix(sudo:session): session closed for user root Aug 29 01:23:39 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-12f93aa1-e818-43ef-b966-b265cf7bd253 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-0b6ebe00-36a5-4369-8f3a-b2f79d194562" returned: 0 in 0.309s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:23:39 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-12f93aa1-e818-43ef-b966-b265cf7bd253 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Lock "cinder-quobyte-0b6ebe00-36a5-4369-8f3a-b2f79d194562" released by "delete_volume" :: held 0.889s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:23:39 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-12f93aa1-e818-43ef-b966-b265cf7bd253 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Created reservations ['90a692d3-f704-4b70-8bf5-766d2a734c85', 'aa6645ed-0dab-4966-a9de-5a8af958072b', 'ad0836d6-53ce-4926-aaa6-9b2899fe8a93', '07ff3a7d-a134-49fa-aa36-47e352e34962'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:23:39 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-12f93aa1-e818-43ef-b966-b265cf7bd253 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:23:39 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-12f93aa1-e818-43ef-b966-b265cf7bd253 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:23:39 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-12f93aa1-e818-43ef-b966-b265cf7bd253 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:23:39 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-12f93aa1-e818-43ef-b966-b265cf7bd253 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:23:39 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-12f93aa1-e818-43ef-b966-b265cf7bd253 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:23:39 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-12f93aa1-e818-43ef-b966-b265cf7bd253 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:23:39 devstack sudo[101062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:23:39 devstack sudo[101062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:23:40 devstack sudo[101062]: pam_unix(sudo:session): session closed for user root Aug 29 01:23:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-12f93aa1-e818-43ef-b966-b265cf7bd253 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.355s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:23:40 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-12f93aa1-e818-43ef-b966-b265cf7bd253 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:23:40 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-12f93aa1-e818-43ef-b966-b265cf7bd253 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Deleted volume successfully. Aug 29 01:23:40 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-12f93aa1-e818-43ef-b966-b265cf7bd253 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Lock "cinder-0b6ebe00-36a5-4369-8f3a-b2f79d194562-delete_volume" released by "delete_volume" :: held 1.668s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:23:40 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-a4acb0d8-13d3-4d8c-881d-c94346573648 tempest-VolumesGetTest-954660907 None] Acquiring lock "cinder-91b42cc2-bc4f-4ca0-a8c9-5cd30036ec49-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:23:40 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-a4acb0d8-13d3-4d8c-881d-c94346573648 tempest-VolumesGetTest-954660907 None] Lock "cinder-91b42cc2-bc4f-4ca0-a8c9-5cd30036ec49-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:23:40 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-a4acb0d8-13d3-4d8c-881d-c94346573648 tempest-VolumesGetTest-954660907 None] Acquiring lock "cinder-quobyte-91b42cc2-bc4f-4ca0-a8c9-5cd30036ec49" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:23:40 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-a4acb0d8-13d3-4d8c-881d-c94346573648 tempest-VolumesGetTest-954660907 None] Lock "cinder-quobyte-91b42cc2-bc4f-4ca0-a8c9-5cd30036ec49" acquired by "delete_volume" :: waited 0.022s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:23:40 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[c712a218-8f6b-4512-8af3-e38dffeab532]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:23:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-a4acb0d8-13d3-4d8c-881d-c94346573648 tempest-VolumesGetTest-954660907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-91b42cc2-bc4f-4ca0-a8c9-5cd30036ec49 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:23:40 devstack sudo[101067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-91b42cc2-bc4f-4ca0-a8c9-5cd30036ec49 Aug 29 01:23:40 devstack sudo[101067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:23:40 devstack sudo[101067]: pam_unix(sudo:session): session closed for user root Aug 29 01:23:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-a4acb0d8-13d3-4d8c-881d-c94346573648 tempest-VolumesGetTest-954660907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-91b42cc2-bc4f-4ca0-a8c9-5cd30036ec49" returned: 0 in 0.433s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:23:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-a4acb0d8-13d3-4d8c-881d-c94346573648 tempest-VolumesGetTest-954660907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-91b42cc2-bc4f-4ca0-a8c9-5cd30036ec49 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:23:40 devstack sudo[101072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-91b42cc2-bc4f-4ca0-a8c9-5cd30036ec49 Aug 29 01:23:40 devstack sudo[101072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:23:40 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-8edb8712-3632-4217-8a9b-75e87e91c422 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Acquiring lock "cinder-da0c53c6-7e9b-4076-90b4-fa55939c742c-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:23:40 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-8edb8712-3632-4217-8a9b-75e87e91c422 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Lock "cinder-da0c53c6-7e9b-4076-90b4-fa55939c742c-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:23:40 devstack cinder-volume[86111]: DEBUG oslo_service.periodic_task [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86111) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 29 01:23:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:23:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:23:40 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:23:40 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:23:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:23:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:23:40 devstack sudo[101074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:23:40 devstack sudo[101074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:23:40 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-8edb8712-3632-4217-8a9b-75e87e91c422 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Acquiring lock "cinder-quobyte-da0c53c6-7e9b-4076-90b4-fa55939c742c" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:23:40 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-8edb8712-3632-4217-8a9b-75e87e91c422 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Lock "cinder-quobyte-da0c53c6-7e9b-4076-90b4-fa55939c742c" acquired by "delete_volume" :: waited 0.034s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:23:40 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-8f84f778-deaf-4502-8505-b3371058897b tempest-TestServerVolumeAttachmentScenario-1287155210 None] Acquiring lock "cinder-ad972605-1a2f-492a-85cf-b624da47d1e8-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:23:40 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cbdce47-a5a4-4dd9-9a32-1919da560584]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:23:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8edb8712-3632-4217-8a9b-75e87e91c422 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-da0c53c6-7e9b-4076-90b4-fa55939c742c {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:23:40 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-8f84f778-deaf-4502-8505-b3371058897b tempest-TestServerVolumeAttachmentScenario-1287155210 None] Lock "cinder-ad972605-1a2f-492a-85cf-b624da47d1e8-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:23:41 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-8f84f778-deaf-4502-8505-b3371058897b tempest-TestServerVolumeAttachmentScenario-1287155210 None] Acquiring lock "cinder-quobyte-ad972605-1a2f-492a-85cf-b624da47d1e8" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:23:41 devstack sudo[101072]: pam_unix(sudo:session): session closed for user root Aug 29 01:23:41 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-8f84f778-deaf-4502-8505-b3371058897b tempest-TestServerVolumeAttachmentScenario-1287155210 None] Lock "cinder-quobyte-ad972605-1a2f-492a-85cf-b624da47d1e8" acquired by "delete_volume" :: waited 0.023s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:23:41 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-a4acb0d8-13d3-4d8c-881d-c94346573648 tempest-VolumesGetTest-954660907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-91b42cc2-bc4f-4ca0-a8c9-5cd30036ec49" returned: 0 in 0.387s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:23:41 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-a4acb0d8-13d3-4d8c-881d-c94346573648 tempest-VolumesGetTest-954660907 None] Lock "cinder-quobyte-91b42cc2-bc4f-4ca0-a8c9-5cd30036ec49" released by "delete_volume" :: held 0.867s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:23:41 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d46cfe8-edd1-4136-bdca-1690d7d8b72b]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:23:41 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8f84f778-deaf-4502-8505-b3371058897b tempest-TestServerVolumeAttachmentScenario-1287155210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ad972605-1a2f-492a-85cf-b624da47d1e8 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:23:41 devstack sudo[101076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-da0c53c6-7e9b-4076-90b4-fa55939c742c Aug 29 01:23:41 devstack sudo[101076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:23:41 devstack sudo[101074]: pam_unix(sudo:session): session closed for user root Aug 29 01:23:41 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-de752545-d617-440e-8362-d04fae0901a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.389s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:23:41 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:23:41 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-a4acb0d8-13d3-4d8c-881d-c94346573648 tempest-VolumesGetTest-954660907 None] Created reservations ['f017f3f0-c553-4cb3-87df-9f4c822c5aa1', 'a0f70602-a8a2-4cc8-a409-7e2a82ec4282', '9d30fe01-8c9f-4ad6-904c-91d470af5c5e', '236b1cab-e2f6-4a4c-9437-a5097b94e17a'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:23:41 devstack cinder-volume[86111]: DEBUG oslo_service.periodic_task [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Running periodic task VolumeManager._thread_info {{(pid=86111) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 29 01:23:41 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-de752545-d617-440e-8362-d04fae0901a5 None None] thread count: 28 {{(pid=86111) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 29 01:23:41 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-de752545-d617-440e-8362-d04fae0901a5 None None] thread info: [<_MainThread(MainThread, started 129173440548992)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86111) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 29 01:23:41 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-a4acb0d8-13d3-4d8c-881d-c94346573648 tempest-VolumesGetTest-954660907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:23:41 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-a4acb0d8-13d3-4d8c-881d-c94346573648 tempest-VolumesGetTest-954660907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:23:41 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-a4acb0d8-13d3-4d8c-881d-c94346573648 tempest-VolumesGetTest-954660907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:23:41 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-a4acb0d8-13d3-4d8c-881d-c94346573648 tempest-VolumesGetTest-954660907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:23:41 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-a4acb0d8-13d3-4d8c-881d-c94346573648 tempest-VolumesGetTest-954660907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:23:41 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-a4acb0d8-13d3-4d8c-881d-c94346573648 tempest-VolumesGetTest-954660907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:23:41 devstack sudo[101078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ad972605-1a2f-492a-85cf-b624da47d1e8 Aug 29 01:23:41 devstack sudo[101078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:23:41 devstack sudo[101081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:23:41 devstack sudo[101081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:23:41 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-2377e64c-b5c2-41df-ad45-aad8a0a8bd0c tempest-VolumesGetTest-954660907 None] Acquiring lock "cinder-7ae628b3-d6c1-4110-83dd-905d5aad2dde-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:23:41 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-2377e64c-b5c2-41df-ad45-aad8a0a8bd0c tempest-VolumesGetTest-954660907 None] Lock "cinder-7ae628b3-d6c1-4110-83dd-905d5aad2dde-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:23:41 devstack sudo[101076]: pam_unix(sudo:session): session closed for user root Aug 29 01:23:41 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8edb8712-3632-4217-8a9b-75e87e91c422 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-da0c53c6-7e9b-4076-90b4-fa55939c742c" returned: 0 in 0.675s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:23:41 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8edb8712-3632-4217-8a9b-75e87e91c422 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-da0c53c6-7e9b-4076-90b4-fa55939c742c {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:23:41 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-2377e64c-b5c2-41df-ad45-aad8a0a8bd0c tempest-VolumesGetTest-954660907 None] Acquiring lock "cinder-quobyte-7ae628b3-d6c1-4110-83dd-905d5aad2dde" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:23:41 devstack sudo[101090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-da0c53c6-7e9b-4076-90b4-fa55939c742c Aug 29 01:23:41 devstack sudo[101090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:23:41 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-2377e64c-b5c2-41df-ad45-aad8a0a8bd0c tempest-VolumesGetTest-954660907 None] Lock "cinder-quobyte-7ae628b3-d6c1-4110-83dd-905d5aad2dde" acquired by "delete_volume" :: waited 0.024s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:23:41 devstack sudo[101078]: pam_unix(sudo:session): session closed for user root Aug 29 01:23:41 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b7d1b99-e859-46d3-9766-aa87d213c796]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:23:41 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-2377e64c-b5c2-41df-ad45-aad8a0a8bd0c tempest-VolumesGetTest-954660907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-7ae628b3-d6c1-4110-83dd-905d5aad2dde {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:23:41 devstack sudo[101081]: pam_unix(sudo:session): session closed for user root Aug 29 01:23:41 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8f84f778-deaf-4502-8505-b3371058897b tempest-TestServerVolumeAttachmentScenario-1287155210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ad972605-1a2f-492a-85cf-b624da47d1e8" returned: 0 in 0.659s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:23:41 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8f84f778-deaf-4502-8505-b3371058897b tempest-TestServerVolumeAttachmentScenario-1287155210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ad972605-1a2f-492a-85cf-b624da47d1e8 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:23:41 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-a4acb0d8-13d3-4d8c-881d-c94346573648 tempest-VolumesGetTest-954660907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.482s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:23:41 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-a4acb0d8-13d3-4d8c-881d-c94346573648 tempest-VolumesGetTest-954660907 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:23:41 devstack sudo[101094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ad972605-1a2f-492a-85cf-b624da47d1e8 Aug 29 01:23:41 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-a4acb0d8-13d3-4d8c-881d-c94346573648 tempest-VolumesGetTest-954660907 None] Deleted volume successfully. Aug 29 01:23:41 devstack sudo[101094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:23:41 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-a4acb0d8-13d3-4d8c-881d-c94346573648 tempest-VolumesGetTest-954660907 None] Lock "cinder-91b42cc2-bc4f-4ca0-a8c9-5cd30036ec49-delete_volume" released by "delete_volume" :: held 1.678s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:23:41 devstack sudo[101093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-7ae628b3-d6c1-4110-83dd-905d5aad2dde Aug 29 01:23:41 devstack sudo[101093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:23:41 devstack sudo[101090]: pam_unix(sudo:session): session closed for user root Aug 29 01:23:41 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8edb8712-3632-4217-8a9b-75e87e91c422 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-da0c53c6-7e9b-4076-90b4-fa55939c742c" returned: 0 in 0.339s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:23:41 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-8edb8712-3632-4217-8a9b-75e87e91c422 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Lock "cinder-quobyte-da0c53c6-7e9b-4076-90b4-fa55939c742c" released by "delete_volume" :: held 1.077s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:23:42 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-8edb8712-3632-4217-8a9b-75e87e91c422 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Created reservations ['33233dad-7641-48de-b5af-722fed95e791', 'f7d65152-ed35-42cc-bc27-b53c6adfa75a', 'c9195c5c-9c0a-4796-a272-8ea0c694733b', 'db1d29f3-c7ff-4971-8001-f6fcd5bf288a'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:23:42 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-8edb8712-3632-4217-8a9b-75e87e91c422 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:23:42 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-8edb8712-3632-4217-8a9b-75e87e91c422 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:23:42 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-8edb8712-3632-4217-8a9b-75e87e91c422 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:23:42 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-8edb8712-3632-4217-8a9b-75e87e91c422 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:23:42 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-8edb8712-3632-4217-8a9b-75e87e91c422 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:23:42 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8edb8712-3632-4217-8a9b-75e87e91c422 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:23:42 devstack sudo[101094]: pam_unix(sudo:session): session closed for user root Aug 29 01:23:42 devstack sudo[101101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:23:42 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8f84f778-deaf-4502-8505-b3371058897b tempest-TestServerVolumeAttachmentScenario-1287155210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ad972605-1a2f-492a-85cf-b624da47d1e8" returned: 0 in 0.418s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:23:42 devstack sudo[101101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:23:42 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-8f84f778-deaf-4502-8505-b3371058897b tempest-TestServerVolumeAttachmentScenario-1287155210 None] Lock "cinder-quobyte-ad972605-1a2f-492a-85cf-b624da47d1e8" released by "delete_volume" :: held 1.149s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:23:42 devstack sudo[101093]: pam_unix(sudo:session): session closed for user root Aug 29 01:23:42 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-2377e64c-b5c2-41df-ad45-aad8a0a8bd0c tempest-VolumesGetTest-954660907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-7ae628b3-d6c1-4110-83dd-905d5aad2dde" returned: 0 in 0.497s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:23:42 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-2377e64c-b5c2-41df-ad45-aad8a0a8bd0c tempest-VolumesGetTest-954660907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-7ae628b3-d6c1-4110-83dd-905d5aad2dde {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:23:42 devstack sudo[101104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-7ae628b3-d6c1-4110-83dd-905d5aad2dde Aug 29 01:23:42 devstack sudo[101104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:23:42 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-8f84f778-deaf-4502-8505-b3371058897b tempest-TestServerVolumeAttachmentScenario-1287155210 None] Created reservations ['e6a8bdb9-ab00-4054-a6bc-4d1cf845a3c3', '73f20f56-fdb6-4460-967b-b796ca46a053', '711ad454-2f8c-4ef3-bbd3-8435ac642cc0', '4af82da4-8e40-46a9-b13c-f1126d555f6b'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:23:42 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-8f84f778-deaf-4502-8505-b3371058897b tempest-TestServerVolumeAttachmentScenario-1287155210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:23:42 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-8f84f778-deaf-4502-8505-b3371058897b tempest-TestServerVolumeAttachmentScenario-1287155210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:23:42 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-8f84f778-deaf-4502-8505-b3371058897b tempest-TestServerVolumeAttachmentScenario-1287155210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:23:42 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-8f84f778-deaf-4502-8505-b3371058897b tempest-TestServerVolumeAttachmentScenario-1287155210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:23:42 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-8f84f778-deaf-4502-8505-b3371058897b tempest-TestServerVolumeAttachmentScenario-1287155210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:23:42 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8f84f778-deaf-4502-8505-b3371058897b tempest-TestServerVolumeAttachmentScenario-1287155210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:23:42 devstack sudo[101101]: pam_unix(sudo:session): session closed for user root Aug 29 01:23:42 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8edb8712-3632-4217-8a9b-75e87e91c422 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.279s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:23:42 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-8edb8712-3632-4217-8a9b-75e87e91c422 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:23:42 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-8edb8712-3632-4217-8a9b-75e87e91c422 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Deleted volume successfully. Aug 29 01:23:42 devstack sudo[101107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:23:42 devstack sudo[101107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:23:42 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-8edb8712-3632-4217-8a9b-75e87e91c422 tempest-CreateVolumesFromSourceVolumeTest-722111983 None] Lock "cinder-da0c53c6-7e9b-4076-90b4-fa55939c742c-delete_volume" released by "delete_volume" :: held 1.713s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:23:42 devstack sudo[101104]: pam_unix(sudo:session): session closed for user root Aug 29 01:23:42 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-2377e64c-b5c2-41df-ad45-aad8a0a8bd0c tempest-VolumesGetTest-954660907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-7ae628b3-d6c1-4110-83dd-905d5aad2dde" returned: 0 in 0.305s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:23:42 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-2377e64c-b5c2-41df-ad45-aad8a0a8bd0c tempest-VolumesGetTest-954660907 None] Lock "cinder-quobyte-7ae628b3-d6c1-4110-83dd-905d5aad2dde" released by "delete_volume" :: held 0.875s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:23:42 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-2377e64c-b5c2-41df-ad45-aad8a0a8bd0c tempest-VolumesGetTest-954660907 None] Created reservations ['8c77c7bf-4d2c-4467-a88c-e1b74ccedcb4', 'ce7971c1-a2d1-4c7b-8984-7f52dd91ecd2', '3a438c26-d2b4-4315-b88c-dbf1a4ff060c', 'ac41f493-bc69-46a3-a5f9-1cac9292220e'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:23:42 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-2377e64c-b5c2-41df-ad45-aad8a0a8bd0c tempest-VolumesGetTest-954660907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:23:42 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-2377e64c-b5c2-41df-ad45-aad8a0a8bd0c tempest-VolumesGetTest-954660907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:23:42 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-2377e64c-b5c2-41df-ad45-aad8a0a8bd0c tempest-VolumesGetTest-954660907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:23:42 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-2377e64c-b5c2-41df-ad45-aad8a0a8bd0c tempest-VolumesGetTest-954660907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:23:42 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-2377e64c-b5c2-41df-ad45-aad8a0a8bd0c tempest-VolumesGetTest-954660907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:23:42 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-2377e64c-b5c2-41df-ad45-aad8a0a8bd0c tempest-VolumesGetTest-954660907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:23:42 devstack sudo[101111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:23:42 devstack sudo[101111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:23:42 devstack sudo[101107]: pam_unix(sudo:session): session closed for user root Aug 29 01:23:42 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8f84f778-deaf-4502-8505-b3371058897b tempest-TestServerVolumeAttachmentScenario-1287155210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.307s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:23:42 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-8f84f778-deaf-4502-8505-b3371058897b tempest-TestServerVolumeAttachmentScenario-1287155210 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:23:42 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-8f84f778-deaf-4502-8505-b3371058897b tempest-TestServerVolumeAttachmentScenario-1287155210 None] Deleted volume successfully. Aug 29 01:23:42 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-8f84f778-deaf-4502-8505-b3371058897b tempest-TestServerVolumeAttachmentScenario-1287155210 None] Lock "cinder-ad972605-1a2f-492a-85cf-b624da47d1e8-delete_volume" released by "delete_volume" :: held 1.791s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:23:42 devstack sudo[101111]: pam_unix(sudo:session): session closed for user root Aug 29 01:23:42 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-2377e64c-b5c2-41df-ad45-aad8a0a8bd0c tempest-VolumesGetTest-954660907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.328s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:23:42 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-2377e64c-b5c2-41df-ad45-aad8a0a8bd0c tempest-VolumesGetTest-954660907 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:23:42 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-2377e64c-b5c2-41df-ad45-aad8a0a8bd0c tempest-VolumesGetTest-954660907 None] Deleted volume successfully. Aug 29 01:23:43 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-2377e64c-b5c2-41df-ad45-aad8a0a8bd0c tempest-VolumesGetTest-954660907 None] Lock "cinder-7ae628b3-d6c1-4110-83dd-905d5aad2dde-delete_volume" released by "delete_volume" :: held 1.491s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:23:43 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-435e5c28-84e3-442b-b868-149be6c80239 tempest-TestServerVolumeAttachmentScenario-1287155210 None] Acquiring lock "cinder-494081d0-dc9d-41a5-805f-77a09960fe59-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:23:43 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-435e5c28-84e3-442b-b868-149be6c80239 tempest-TestServerVolumeAttachmentScenario-1287155210 None] Lock "cinder-494081d0-dc9d-41a5-805f-77a09960fe59-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:23:43 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-435e5c28-84e3-442b-b868-149be6c80239 tempest-TestServerVolumeAttachmentScenario-1287155210 None] Acquiring lock "cinder-quobyte-494081d0-dc9d-41a5-805f-77a09960fe59" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:23:43 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-435e5c28-84e3-442b-b868-149be6c80239 tempest-TestServerVolumeAttachmentScenario-1287155210 None] Lock "cinder-quobyte-494081d0-dc9d-41a5-805f-77a09960fe59" acquired by "delete_volume" :: waited 0.024s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:23:43 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cf30318-97ba-4b37-a669-51f64d12517a]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:23:43 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-435e5c28-84e3-442b-b868-149be6c80239 tempest-TestServerVolumeAttachmentScenario-1287155210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-494081d0-dc9d-41a5-805f-77a09960fe59 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:23:43 devstack sudo[101114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-494081d0-dc9d-41a5-805f-77a09960fe59 Aug 29 01:23:43 devstack sudo[101114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:23:43 devstack sudo[101114]: pam_unix(sudo:session): session closed for user root Aug 29 01:23:43 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-435e5c28-84e3-442b-b868-149be6c80239 tempest-TestServerVolumeAttachmentScenario-1287155210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-494081d0-dc9d-41a5-805f-77a09960fe59" returned: 0 in 0.485s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:23:43 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-435e5c28-84e3-442b-b868-149be6c80239 tempest-TestServerVolumeAttachmentScenario-1287155210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-494081d0-dc9d-41a5-805f-77a09960fe59 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:23:43 devstack sudo[101119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-494081d0-dc9d-41a5-805f-77a09960fe59 Aug 29 01:23:43 devstack sudo[101119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:23:44 devstack sudo[101119]: pam_unix(sudo:session): session closed for user root Aug 29 01:23:44 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-435e5c28-84e3-442b-b868-149be6c80239 tempest-TestServerVolumeAttachmentScenario-1287155210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-494081d0-dc9d-41a5-805f-77a09960fe59" returned: 0 in 0.263s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:23:44 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-435e5c28-84e3-442b-b868-149be6c80239 tempest-TestServerVolumeAttachmentScenario-1287155210 None] Lock "cinder-quobyte-494081d0-dc9d-41a5-805f-77a09960fe59" released by "delete_volume" :: held 0.815s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:23:44 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-435e5c28-84e3-442b-b868-149be6c80239 tempest-TestServerVolumeAttachmentScenario-1287155210 None] Created reservations ['e50d71a6-b495-4faa-b019-3e5de20a851d', '5b9be233-f7ab-477f-89c4-25ab815714d6', '5b004bb8-1a20-4183-9a69-e43f55572489', '23a90b45-6d80-459a-9eb2-afc5139b397f'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:23:44 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-435e5c28-84e3-442b-b868-149be6c80239 tempest-TestServerVolumeAttachmentScenario-1287155210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:23:44 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-435e5c28-84e3-442b-b868-149be6c80239 tempest-TestServerVolumeAttachmentScenario-1287155210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:23:44 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-435e5c28-84e3-442b-b868-149be6c80239 tempest-TestServerVolumeAttachmentScenario-1287155210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:23:44 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-435e5c28-84e3-442b-b868-149be6c80239 tempest-TestServerVolumeAttachmentScenario-1287155210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:23:44 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-435e5c28-84e3-442b-b868-149be6c80239 tempest-TestServerVolumeAttachmentScenario-1287155210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:23:44 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-435e5c28-84e3-442b-b868-149be6c80239 tempest-TestServerVolumeAttachmentScenario-1287155210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:23:44 devstack sudo[101122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:23:44 devstack sudo[101122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:23:44 devstack sudo[101122]: pam_unix(sudo:session): session closed for user root Aug 29 01:23:44 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-435e5c28-84e3-442b-b868-149be6c80239 tempest-TestServerVolumeAttachmentScenario-1287155210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.345s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:23:44 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-435e5c28-84e3-442b-b868-149be6c80239 tempest-TestServerVolumeAttachmentScenario-1287155210 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:23:44 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-435e5c28-84e3-442b-b868-149be6c80239 tempest-TestServerVolumeAttachmentScenario-1287155210 None] Deleted volume successfully. Aug 29 01:23:44 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-435e5c28-84e3-442b-b868-149be6c80239 tempest-TestServerVolumeAttachmentScenario-1287155210 None] Lock "cinder-494081d0-dc9d-41a5-805f-77a09960fe59-delete_volume" released by "delete_volume" :: held 1.440s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:23:53 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-56e5f363-c4c5-458c-9df3-aae3f7ad3865 tempest-VolumesSnapshotNegativeTestJSON-586856708 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:23:53 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-56e5f363-c4c5-458c-9df3-aae3f7ad3865 tempest-VolumesSnapshotNegativeTestJSON-586856708 None] Flow 'volume_create_manager' (ef7d4a46-3585-4597-aae3-589850311626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:23:53 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-56e5f363-c4c5-458c-9df3-aae3f7ad3865 tempest-VolumesSnapshotNegativeTestJSON-586856708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0c94b7e-5129-4a26-8f83-f5bb511ed8d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:23:53 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-56e5f363-c4c5-458c-9df3-aae3f7ad3865 tempest-VolumesSnapshotNegativeTestJSON-586856708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0c94b7e-5129-4a26-8f83-f5bb511ed8d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:23:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1886485278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d3ae882-aec4-410e-b68e-787ff8ae884c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a4c8454c27a455299bfd909da671d99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:23:54Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:23:54Z,use_quota=True,user_id='d674afea40af44229aa0a2eb99163ccd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:23:53 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-56e5f363-c4c5-458c-9df3-aae3f7ad3865 tempest-VolumesSnapshotNegativeTestJSON-586856708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e455c0ba-d11e-45c4-8cbe-4f6236af40b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:23:53 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-56e5f363-c4c5-458c-9df3-aae3f7ad3865 tempest-VolumesSnapshotNegativeTestJSON-586856708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e455c0ba-d11e-45c4-8cbe-4f6236af40b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:23:53 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-56e5f363-c4c5-458c-9df3-aae3f7ad3865 tempest-VolumesSnapshotNegativeTestJSON-586856708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cacb1de7-53dc-4d27-b480-fe92cc9de2d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:23:53 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-56e5f363-c4c5-458c-9df3-aae3f7ad3865 tempest-VolumesSnapshotNegativeTestJSON-586856708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cacb1de7-53dc-4d27-b480-fe92cc9de2d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d3ae882-aec4-410e-b68e-787ff8ae884c', 'volume_name': 'volume-5d3ae882-aec4-410e-b68e-787ff8ae884c', 'volume_size': 2}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:23:53 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-56e5f363-c4c5-458c-9df3-aae3f7ad3865 tempest-VolumesSnapshotNegativeTestJSON-586856708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1717918-5170-4fcb-9eca-0ddfeb0bec95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:23:53 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-56e5f363-c4c5-458c-9df3-aae3f7ad3865 tempest-VolumesSnapshotNegativeTestJSON-586856708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1717918-5170-4fcb-9eca-0ddfeb0bec95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:23:53 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-56e5f363-c4c5-458c-9df3-aae3f7ad3865 tempest-VolumesSnapshotNegativeTestJSON-586856708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (915c7273-70b4-48c3-a3a1-aebfd07eff03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:23:53 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-56e5f363-c4c5-458c-9df3-aae3f7ad3865 tempest-VolumesSnapshotNegativeTestJSON-586856708 None] Volume 5d3ae882-aec4-410e-b68e-787ff8ae884c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d3ae882-aec4-410e-b68e-787ff8ae884c', 'volume_size': 2} Aug 29 01:23:53 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-56e5f363-c4c5-458c-9df3-aae3f7ad3865 tempest-VolumesSnapshotNegativeTestJSON-586856708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:23:53 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-56e5f363-c4c5-458c-9df3-aae3f7ad3865 tempest-VolumesSnapshotNegativeTestJSON-586856708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:23:53 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-56e5f363-c4c5-458c-9df3-aae3f7ad3865 tempest-VolumesSnapshotNegativeTestJSON-586856708 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:23:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1886485278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d3ae882-aec4-410e-b68e-787ff8ae884c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a4c8454c27a455299bfd909da671d99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:23:54Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:23:54Z,use_quota=True,user_id='d674afea40af44229aa0a2eb99163ccd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:23:53 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-56e5f363-c4c5-458c-9df3-aae3f7ad3865 tempest-VolumesSnapshotNegativeTestJSON-586856708 None] Creating volume 5d3ae882-aec4-410e-b68e-787ff8ae884c {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:23:53 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-56e5f363-c4c5-458c-9df3-aae3f7ad3865 tempest-VolumesSnapshotNegativeTestJSON-586856708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:23:53 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-56e5f363-c4c5-458c-9df3-aae3f7ad3865 tempest-VolumesSnapshotNegativeTestJSON-586856708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:23:53 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-56e5f363-c4c5-458c-9df3-aae3f7ad3865 tempest-VolumesSnapshotNegativeTestJSON-586856708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:23:53 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-56e5f363-c4c5-458c-9df3-aae3f7ad3865 tempest-VolumesSnapshotNegativeTestJSON-586856708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:23:53 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-56e5f363-c4c5-458c-9df3-aae3f7ad3865 tempest-VolumesSnapshotNegativeTestJSON-586856708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:23:53 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-56e5f363-c4c5-458c-9df3-aae3f7ad3865 tempest-VolumesSnapshotNegativeTestJSON-586856708 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:23:53 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-56e5f363-c4c5-458c-9df3-aae3f7ad3865 tempest-VolumesSnapshotNegativeTestJSON-586856708 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:23:53 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-56e5f363-c4c5-458c-9df3-aae3f7ad3865 tempest-VolumesSnapshotNegativeTestJSON-586856708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-5d3ae882-aec4-410e-b68e-787ff8ae884c 2147483648 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:23:53 devstack sudo[101130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-5d3ae882-aec4-410e-b68e-787ff8ae884c 2147483648 Aug 29 01:23:53 devstack sudo[101130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:23:54 devstack sudo[101130]: pam_unix(sudo:session): session closed for user root Aug 29 01:23:54 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-56e5f363-c4c5-458c-9df3-aae3f7ad3865 tempest-VolumesSnapshotNegativeTestJSON-586856708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-5d3ae882-aec4-410e-b68e-787ff8ae884c 2147483648" returned: 0 in 0.761s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:23:54 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-56e5f363-c4c5-458c-9df3-aae3f7ad3865 tempest-VolumesSnapshotNegativeTestJSON-586856708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-5d3ae882-aec4-410e-b68e-787ff8ae884c {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:23:54 devstack sudo[101136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-5d3ae882-aec4-410e-b68e-787ff8ae884c Aug 29 01:23:54 devstack sudo[101136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:23:54 devstack sudo[101136]: pam_unix(sudo:session): session closed for user root Aug 29 01:23:54 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-56e5f363-c4c5-458c-9df3-aae3f7ad3865 tempest-VolumesSnapshotNegativeTestJSON-586856708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-5d3ae882-aec4-410e-b68e-787ff8ae884c" returned: 0 in 0.271s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:23:54 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-56e5f363-c4c5-458c-9df3-aae3f7ad3865 tempest-VolumesSnapshotNegativeTestJSON-586856708 None] <== create_volume: return (1108ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:23:54 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-56e5f363-c4c5-458c-9df3-aae3f7ad3865 tempest-VolumesSnapshotNegativeTestJSON-586856708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.111s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:23:54 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-56e5f363-c4c5-458c-9df3-aae3f7ad3865 tempest-VolumesSnapshotNegativeTestJSON-586856708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (915c7273-70b4-48c3-a3a1-aebfd07eff03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d3ae882-aec4-410e-b68e-787ff8ae884c', 'volume_size': 2}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:23:54 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-56e5f363-c4c5-458c-9df3-aae3f7ad3865 tempest-VolumesSnapshotNegativeTestJSON-586856708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a393c0f-decb-4fa7-b88c-3074c2734d9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:23:54 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-56e5f363-c4c5-458c-9df3-aae3f7ad3865 tempest-VolumesSnapshotNegativeTestJSON-586856708 None] Volume volume-5d3ae882-aec4-410e-b68e-787ff8ae884c (5d3ae882-aec4-410e-b68e-787ff8ae884c): created successfully Aug 29 01:23:54 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-56e5f363-c4c5-458c-9df3-aae3f7ad3865 tempest-VolumesSnapshotNegativeTestJSON-586856708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a393c0f-decb-4fa7-b88c-3074c2734d9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:23:54 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-56e5f363-c4c5-458c-9df3-aae3f7ad3865 tempest-VolumesSnapshotNegativeTestJSON-586856708 None] Flow 'volume_create_manager' (ef7d4a46-3585-4597-aae3-589850311626) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:23:54 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-56e5f363-c4c5-458c-9df3-aae3f7ad3865 tempest-VolumesSnapshotNegativeTestJSON-586856708 None] Created volume successfully. Aug 29 01:23:55 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-c912edef-d9a0-4cb2-9a09-15f7d661ab13 tempest-VolumesSnapshotNegativeTestJSON-586856708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:23:55 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-c912edef-d9a0-4cb2-9a09-15f7d661ab13 tempest-VolumesSnapshotNegativeTestJSON-586856708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:23:55 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-c912edef-d9a0-4cb2-9a09-15f7d661ab13 tempest-VolumesSnapshotNegativeTestJSON-586856708 None] Creating offline snapshot e1dc0412-c08d-40aa-8148-159787b55a13 of volume 5d3ae882-aec4-410e-b68e-787ff8ae884c {{(pid=86111) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 29 01:23:55 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[fea8e4c4-2e2d-459a-b4f4-5378ee31696c]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:23:55 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c912edef-d9a0-4cb2-9a09-15f7d661ab13 tempest-VolumesSnapshotNegativeTestJSON-586856708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-5d3ae882-aec4-410e-b68e-787ff8ae884c {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:23:56 devstack sudo[101140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-5d3ae882-aec4-410e-b68e-787ff8ae884c Aug 29 01:23:56 devstack sudo[101140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:23:56 devstack sudo[101140]: pam_unix(sudo:session): session closed for user root Aug 29 01:23:56 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c912edef-d9a0-4cb2-9a09-15f7d661ab13 tempest-VolumesSnapshotNegativeTestJSON-586856708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-5d3ae882-aec4-410e-b68e-787ff8ae884c" returned: 0 in 0.414s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:23:56 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c912edef-d9a0-4cb2-9a09-15f7d661ab13 tempest-VolumesSnapshotNegativeTestJSON-586856708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-5d3ae882-aec4-410e-b68e-787ff8ae884c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-5d3ae882-aec4-410e-b68e-787ff8ae884c.e1dc0412-c08d-40aa-8148-159787b55a13 2G {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:23:56 devstack sudo[101145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-5d3ae882-aec4-410e-b68e-787ff8ae884c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-5d3ae882-aec4-410e-b68e-787ff8ae884c.e1dc0412-c08d-40aa-8148-159787b55a13 2G Aug 29 01:23:56 devstack sudo[101145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:23:56 devstack sudo[101145]: pam_unix(sudo:session): session closed for user root Aug 29 01:23:56 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c912edef-d9a0-4cb2-9a09-15f7d661ab13 tempest-VolumesSnapshotNegativeTestJSON-586856708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-5d3ae882-aec4-410e-b68e-787ff8ae884c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-5d3ae882-aec4-410e-b68e-787ff8ae884c.e1dc0412-c08d-40aa-8148-159787b55a13 2G" returned: 0 in 0.420s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:23:56 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c912edef-d9a0-4cb2-9a09-15f7d661ab13 tempest-VolumesSnapshotNegativeTestJSON-586856708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d3ae882-aec4-410e-b68e-787ff8ae884c -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-5d3ae882-aec4-410e-b68e-787ff8ae884c.e1dc0412-c08d-40aa-8148-159787b55a13 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:23:56 devstack sudo[101151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d3ae882-aec4-410e-b68e-787ff8ae884c -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-5d3ae882-aec4-410e-b68e-787ff8ae884c.e1dc0412-c08d-40aa-8148-159787b55a13 Aug 29 01:23:56 devstack sudo[101151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:23:57 devstack sudo[101151]: pam_unix(sudo:session): session closed for user root Aug 29 01:23:57 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c912edef-d9a0-4cb2-9a09-15f7d661ab13 tempest-VolumesSnapshotNegativeTestJSON-586856708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d3ae882-aec4-410e-b68e-787ff8ae884c -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-5d3ae882-aec4-410e-b68e-787ff8ae884c.e1dc0412-c08d-40aa-8148-159787b55a13" returned: 0 in 0.291s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:23:57 devstack cinder-volume[86111]: WARNING cinder.volume.drivers.remotefs [None req-c912edef-d9a0-4cb2-9a09-15f7d661ab13 tempest-VolumesSnapshotNegativeTestJSON-586856708 None] /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-5d3ae882-aec4-410e-b68e-787ff8ae884c.e1dc0412-c08d-40aa-8148-159787b55a13 is being set with open permissions: ugo+rw Aug 29 01:23:57 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c912edef-d9a0-4cb2-9a09-15f7d661ab13 tempest-VolumesSnapshotNegativeTestJSON-586856708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-5d3ae882-aec4-410e-b68e-787ff8ae884c.e1dc0412-c08d-40aa-8148-159787b55a13 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:23:57 devstack sudo[101156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-5d3ae882-aec4-410e-b68e-787ff8ae884c.e1dc0412-c08d-40aa-8148-159787b55a13 Aug 29 01:23:57 devstack sudo[101156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:23:57 devstack sudo[101156]: pam_unix(sudo:session): session closed for user root Aug 29 01:23:57 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c912edef-d9a0-4cb2-9a09-15f7d661ab13 tempest-VolumesSnapshotNegativeTestJSON-586856708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-5d3ae882-aec4-410e-b68e-787ff8ae884c.e1dc0412-c08d-40aa-8148-159787b55a13" returned: 0 in 0.266s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:23:57 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c912edef-d9a0-4cb2-9a09-15f7d661ab13 tempest-VolumesSnapshotNegativeTestJSON-586856708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-5d3ae882-aec4-410e-b68e-787ff8ae884c.info {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:23:57 devstack sudo[101159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-5d3ae882-aec4-410e-b68e-787ff8ae884c.info Aug 29 01:23:57 devstack sudo[101159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:23:57 devstack sudo[101159]: pam_unix(sudo:session): session closed for user root Aug 29 01:23:57 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c912edef-d9a0-4cb2-9a09-15f7d661ab13 tempest-VolumesSnapshotNegativeTestJSON-586856708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-5d3ae882-aec4-410e-b68e-787ff8ae884c.info" returned: 0 in 0.358s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:23:57 devstack cinder-volume[86111]: WARNING cinder.volume.drivers.remotefs [None req-c912edef-d9a0-4cb2-9a09-15f7d661ab13 tempest-VolumesSnapshotNegativeTestJSON-586856708 None] /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-5d3ae882-aec4-410e-b68e-787ff8ae884c.info is being set with open permissions: ugo+rw Aug 29 01:23:57 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c912edef-d9a0-4cb2-9a09-15f7d661ab13 tempest-VolumesSnapshotNegativeTestJSON-586856708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-5d3ae882-aec4-410e-b68e-787ff8ae884c.info {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:23:57 devstack sudo[101162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-5d3ae882-aec4-410e-b68e-787ff8ae884c.info Aug 29 01:23:57 devstack sudo[101162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:23:58 devstack sudo[101162]: pam_unix(sudo:session): session closed for user root Aug 29 01:23:58 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c912edef-d9a0-4cb2-9a09-15f7d661ab13 tempest-VolumesSnapshotNegativeTestJSON-586856708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-5d3ae882-aec4-410e-b68e-787ff8ae884c.info" returned: 0 in 0.282s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:23:58 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-c912edef-d9a0-4cb2-9a09-15f7d661ab13 tempest-VolumesSnapshotNegativeTestJSON-586856708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.166s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:23:58 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-c912edef-d9a0-4cb2-9a09-15f7d661ab13 tempest-VolumesSnapshotNegativeTestJSON-586856708 None] Create snapshot completed successfully Aug 29 01:23:59 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-f02257dc-9047-4031-ba8b-12b3e126eb89 tempest-VolumesSnapshotNegativeTestJSON-586856708 None] Acquiring lock "cinder-e1dc0412-c08d-40aa-8148-159787b55a13-delete_snapshot" by "delete_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:23:59 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-f02257dc-9047-4031-ba8b-12b3e126eb89 tempest-VolumesSnapshotNegativeTestJSON-586856708 None] Lock "cinder-e1dc0412-c08d-40aa-8148-159787b55a13-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:23:59 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-f02257dc-9047-4031-ba8b-12b3e126eb89 tempest-VolumesSnapshotNegativeTestJSON-586856708 None] Acquiring lock "cinder-quobyte-5d3ae882-aec4-410e-b68e-787ff8ae884c" by "delete_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:23:59 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-f02257dc-9047-4031-ba8b-12b3e126eb89 tempest-VolumesSnapshotNegativeTestJSON-586856708 None] Lock "cinder-quobyte-5d3ae882-aec4-410e-b68e-787ff8ae884c" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:23:59 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-f02257dc-9047-4031-ba8b-12b3e126eb89 tempest-VolumesSnapshotNegativeTestJSON-586856708 None] Acquiring lock "cinder-quobyte-e1dc0412-c08d-40aa-8148-159787b55a13" by "_delete_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:23:59 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-f02257dc-9047-4031-ba8b-12b3e126eb89 tempest-VolumesSnapshotNegativeTestJSON-586856708 None] Lock "cinder-quobyte-e1dc0412-c08d-40aa-8148-159787b55a13" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:23:59 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-f02257dc-9047-4031-ba8b-12b3e126eb89 tempest-VolumesSnapshotNegativeTestJSON-586856708 None] Deleting offline snapshot e1dc0412-c08d-40aa-8148-159787b55a13 of volume 5d3ae882-aec4-410e-b68e-787ff8ae884c {{(pid=86111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 29 01:23:59 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-f02257dc-9047-4031-ba8b-12b3e126eb89 tempest-VolumesSnapshotNegativeTestJSON-586856708 None] snapshot_file for this snap is: volume-5d3ae882-aec4-410e-b68e-787ff8ae884c.e1dc0412-c08d-40aa-8148-159787b55a13 {{(pid=86111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 29 01:23:59 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[90a44e43-f781-4e72-802e-83cf5cf00b88]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:23:59 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-f02257dc-9047-4031-ba8b-12b3e126eb89 tempest-VolumesSnapshotNegativeTestJSON-586856708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-5d3ae882-aec4-410e-b68e-787ff8ae884c.e1dc0412-c08d-40aa-8148-159787b55a13 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:23:59 devstack sudo[101167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-5d3ae882-aec4-410e-b68e-787ff8ae884c.e1dc0412-c08d-40aa-8148-159787b55a13 Aug 29 01:23:59 devstack sudo[101167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:24:00 devstack sudo[101167]: pam_unix(sudo:session): session closed for user root Aug 29 01:24:00 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-f02257dc-9047-4031-ba8b-12b3e126eb89 tempest-VolumesSnapshotNegativeTestJSON-586856708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-5d3ae882-aec4-410e-b68e-787ff8ae884c.e1dc0412-c08d-40aa-8148-159787b55a13" returned: 0 in 0.541s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:24:00 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-f02257dc-9047-4031-ba8b-12b3e126eb89 tempest-VolumesSnapshotNegativeTestJSON-586856708 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5d3ae882-aec4-410e-b68e-787ff8ae884c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 29 01:24:00 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a5590f3-2c13-4c5c-8a71-e7f400ddc264]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:24:00 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-f02257dc-9047-4031-ba8b-12b3e126eb89 tempest-VolumesSnapshotNegativeTestJSON-586856708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-5d3ae882-aec4-410e-b68e-787ff8ae884c {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:24:00 devstack sudo[101173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-5d3ae882-aec4-410e-b68e-787ff8ae884c Aug 29 01:24:00 devstack sudo[101173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:24:00 devstack sudo[101173]: pam_unix(sudo:session): session closed for user root Aug 29 01:24:00 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-f02257dc-9047-4031-ba8b-12b3e126eb89 tempest-VolumesSnapshotNegativeTestJSON-586856708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-5d3ae882-aec4-410e-b68e-787ff8ae884c" returned: 0 in 0.473s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:24:00 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-f02257dc-9047-4031-ba8b-12b3e126eb89 tempest-VolumesSnapshotNegativeTestJSON-586856708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-5d3ae882-aec4-410e-b68e-787ff8ae884c.e1dc0412-c08d-40aa-8148-159787b55a13 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:24:00 devstack sudo[101178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-5d3ae882-aec4-410e-b68e-787ff8ae884c.e1dc0412-c08d-40aa-8148-159787b55a13 Aug 29 01:24:00 devstack sudo[101178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:24:01 devstack sudo[101178]: pam_unix(sudo:session): session closed for user root Aug 29 01:24:01 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-f02257dc-9047-4031-ba8b-12b3e126eb89 tempest-VolumesSnapshotNegativeTestJSON-586856708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-5d3ae882-aec4-410e-b68e-787ff8ae884c.e1dc0412-c08d-40aa-8148-159787b55a13" returned: 0 in 0.449s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:24:01 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-f02257dc-9047-4031-ba8b-12b3e126eb89 tempest-VolumesSnapshotNegativeTestJSON-586856708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-5d3ae882-aec4-410e-b68e-787ff8ae884c.e1dc0412-c08d-40aa-8148-159787b55a13 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:24:01 devstack sudo[101184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-5d3ae882-aec4-410e-b68e-787ff8ae884c.e1dc0412-c08d-40aa-8148-159787b55a13 Aug 29 01:24:01 devstack sudo[101184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:24:01 devstack sudo[101184]: pam_unix(sudo:session): session closed for user root Aug 29 01:24:01 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-f02257dc-9047-4031-ba8b-12b3e126eb89 tempest-VolumesSnapshotNegativeTestJSON-586856708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-5d3ae882-aec4-410e-b68e-787ff8ae884c.e1dc0412-c08d-40aa-8148-159787b55a13" returned: 0 in 0.312s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:24:01 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-f02257dc-9047-4031-ba8b-12b3e126eb89 tempest-VolumesSnapshotNegativeTestJSON-586856708 None] Lock "cinder-quobyte-e1dc0412-c08d-40aa-8148-159787b55a13" released by "_delete_snapshot" :: held 1.940s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:24:01 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-f02257dc-9047-4031-ba8b-12b3e126eb89 tempest-VolumesSnapshotNegativeTestJSON-586856708 None] Lock "cinder-quobyte-5d3ae882-aec4-410e-b68e-787ff8ae884c" released by "delete_snapshot" :: held 1.977s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:24:01 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-f02257dc-9047-4031-ba8b-12b3e126eb89 tempest-VolumesSnapshotNegativeTestJSON-586856708 None] Created reservations ['a59df7d5-37bf-44ac-8f41-e88d8a04e13a', 'bb9742a0-aa2b-4330-8f7e-07b2a3674f96', '21cdab38-c4cd-4c82-946d-f3cca369d5a9', '00c8ab18-9b13-4817-851f-e35303bd85aa'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:24:01 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-f02257dc-9047-4031-ba8b-12b3e126eb89 tempest-VolumesSnapshotNegativeTestJSON-586856708 None] Delete snapshot completed successfully. Aug 29 01:24:01 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-f02257dc-9047-4031-ba8b-12b3e126eb89 tempest-VolumesSnapshotNegativeTestJSON-586856708 None] Lock "cinder-e1dc0412-c08d-40aa-8148-159787b55a13-delete_snapshot" released by "delete_snapshot" :: held 2.220s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:24:02 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-afba0db6-8cdd-4484-a5c0-9ac7952e49e4 tempest-VolumesSnapshotNegativeTestJSON-586856708 None] Acquiring lock "cinder-5d3ae882-aec4-410e-b68e-787ff8ae884c-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:24:02 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-afba0db6-8cdd-4484-a5c0-9ac7952e49e4 tempest-VolumesSnapshotNegativeTestJSON-586856708 None] Lock "cinder-5d3ae882-aec4-410e-b68e-787ff8ae884c-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:24:02 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-afba0db6-8cdd-4484-a5c0-9ac7952e49e4 tempest-VolumesSnapshotNegativeTestJSON-586856708 None] Acquiring lock "cinder-quobyte-5d3ae882-aec4-410e-b68e-787ff8ae884c" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:24:02 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-afba0db6-8cdd-4484-a5c0-9ac7952e49e4 tempest-VolumesSnapshotNegativeTestJSON-586856708 None] Lock "cinder-quobyte-5d3ae882-aec4-410e-b68e-787ff8ae884c" acquired by "delete_volume" :: waited 0.019s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:24:02 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ba5f771-467b-4245-8de6-8f85e35c3217]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:24:02 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-afba0db6-8cdd-4484-a5c0-9ac7952e49e4 tempest-VolumesSnapshotNegativeTestJSON-586856708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-5d3ae882-aec4-410e-b68e-787ff8ae884c {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:24:03 devstack sudo[101188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-5d3ae882-aec4-410e-b68e-787ff8ae884c Aug 29 01:24:03 devstack sudo[101188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:24:03 devstack sudo[101188]: pam_unix(sudo:session): session closed for user root Aug 29 01:24:03 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-afba0db6-8cdd-4484-a5c0-9ac7952e49e4 tempest-VolumesSnapshotNegativeTestJSON-586856708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-5d3ae882-aec4-410e-b68e-787ff8ae884c" returned: 0 in 0.442s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:24:03 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-afba0db6-8cdd-4484-a5c0-9ac7952e49e4 tempest-VolumesSnapshotNegativeTestJSON-586856708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-5d3ae882-aec4-410e-b68e-787ff8ae884c {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:24:03 devstack sudo[101193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-5d3ae882-aec4-410e-b68e-787ff8ae884c Aug 29 01:24:03 devstack sudo[101193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:24:03 devstack sudo[101193]: pam_unix(sudo:session): session closed for user root Aug 29 01:24:03 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-afba0db6-8cdd-4484-a5c0-9ac7952e49e4 tempest-VolumesSnapshotNegativeTestJSON-586856708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-5d3ae882-aec4-410e-b68e-787ff8ae884c" returned: 0 in 0.278s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:24:03 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-afba0db6-8cdd-4484-a5c0-9ac7952e49e4 tempest-VolumesSnapshotNegativeTestJSON-586856708 None] Lock "cinder-quobyte-5d3ae882-aec4-410e-b68e-787ff8ae884c" released by "delete_volume" :: held 0.816s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:24:03 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-afba0db6-8cdd-4484-a5c0-9ac7952e49e4 tempest-VolumesSnapshotNegativeTestJSON-586856708 None] Created reservations ['1e53225e-8a44-490c-bdea-d9862124c905', 'c9f3115e-cad9-4b29-9a92-acf3c73bffb9', '5ed9b614-c9dc-4929-84ad-768513931c1d', 'e5f276b5-9206-4e11-9363-38b41d18d2e8'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:24:03 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-afba0db6-8cdd-4484-a5c0-9ac7952e49e4 tempest-VolumesSnapshotNegativeTestJSON-586856708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:24:03 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-afba0db6-8cdd-4484-a5c0-9ac7952e49e4 tempest-VolumesSnapshotNegativeTestJSON-586856708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:24:03 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-afba0db6-8cdd-4484-a5c0-9ac7952e49e4 tempest-VolumesSnapshotNegativeTestJSON-586856708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:24:03 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-afba0db6-8cdd-4484-a5c0-9ac7952e49e4 tempest-VolumesSnapshotNegativeTestJSON-586856708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:24:03 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-afba0db6-8cdd-4484-a5c0-9ac7952e49e4 tempest-VolumesSnapshotNegativeTestJSON-586856708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:24:03 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-afba0db6-8cdd-4484-a5c0-9ac7952e49e4 tempest-VolumesSnapshotNegativeTestJSON-586856708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:24:03 devstack sudo[101196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:24:03 devstack sudo[101196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:24:04 devstack sudo[101196]: pam_unix(sudo:session): session closed for user root Aug 29 01:24:04 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-afba0db6-8cdd-4484-a5c0-9ac7952e49e4 tempest-VolumesSnapshotNegativeTestJSON-586856708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.331s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:24:04 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-afba0db6-8cdd-4484-a5c0-9ac7952e49e4 tempest-VolumesSnapshotNegativeTestJSON-586856708 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:24:04 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-afba0db6-8cdd-4484-a5c0-9ac7952e49e4 tempest-VolumesSnapshotNegativeTestJSON-586856708 None] Deleted volume successfully. Aug 29 01:24:04 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-afba0db6-8cdd-4484-a5c0-9ac7952e49e4 tempest-VolumesSnapshotNegativeTestJSON-586856708 None] Lock "cinder-5d3ae882-aec4-410e-b68e-787ff8ae884c-delete_volume" released by "delete_volume" :: held 1.419s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:24:04 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-829d9d53-0e71-4d11-a087-22926a08789c tempest-SnapshotDependencyTests-1509799463 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:24:04 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-829d9d53-0e71-4d11-a087-22926a08789c tempest-SnapshotDependencyTests-1509799463 None] Flow 'volume_create_manager' (fa3705f2-f739-41c4-9e6c-5c291d8f73f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:24:04 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-829d9d53-0e71-4d11-a087-22926a08789c tempest-SnapshotDependencyTests-1509799463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b2b1a85-86ec-45ed-9aa9-d527e408e2c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:24:04 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-829d9d53-0e71-4d11-a087-22926a08789c tempest-SnapshotDependencyTests-1509799463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b2b1a85-86ec-45ed-9aa9-d527e408e2c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:24:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-532647375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23711eec-e57d-4239-aad5-df19d3361807,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcb81e9fe2954bf7a66ab6ccb6cdac9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:24:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:24:05Z,use_quota=True,user_id='9369ae1d5d7e49d4834ce8a5288e2522',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:24:04 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-829d9d53-0e71-4d11-a087-22926a08789c tempest-SnapshotDependencyTests-1509799463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17a9ed6e-1ab5-4bcb-9f97-ab1074b427aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:24:04 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-829d9d53-0e71-4d11-a087-22926a08789c tempest-SnapshotDependencyTests-1509799463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17a9ed6e-1ab5-4bcb-9f97-ab1074b427aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:24:04 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-829d9d53-0e71-4d11-a087-22926a08789c tempest-SnapshotDependencyTests-1509799463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a813d42-89d1-46e3-9593-0174d092d1da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:24:04 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-829d9d53-0e71-4d11-a087-22926a08789c tempest-SnapshotDependencyTests-1509799463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a813d42-89d1-46e3-9593-0174d092d1da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23711eec-e57d-4239-aad5-df19d3361807', 'volume_name': 'volume-23711eec-e57d-4239-aad5-df19d3361807', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:24:04 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-829d9d53-0e71-4d11-a087-22926a08789c tempest-SnapshotDependencyTests-1509799463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (655a2d68-5178-4130-bbcd-88bdb1a71d17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:24:04 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-829d9d53-0e71-4d11-a087-22926a08789c tempest-SnapshotDependencyTests-1509799463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (655a2d68-5178-4130-bbcd-88bdb1a71d17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:24:04 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-829d9d53-0e71-4d11-a087-22926a08789c tempest-SnapshotDependencyTests-1509799463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (890fa7d3-ea93-490b-8654-9d0df34e34a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:24:04 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-829d9d53-0e71-4d11-a087-22926a08789c tempest-SnapshotDependencyTests-1509799463 None] Volume 23711eec-e57d-4239-aad5-df19d3361807: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23711eec-e57d-4239-aad5-df19d3361807', 'volume_size': 1} Aug 29 01:24:04 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-829d9d53-0e71-4d11-a087-22926a08789c tempest-SnapshotDependencyTests-1509799463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:24:04 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-829d9d53-0e71-4d11-a087-22926a08789c tempest-SnapshotDependencyTests-1509799463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:24:04 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-829d9d53-0e71-4d11-a087-22926a08789c tempest-SnapshotDependencyTests-1509799463 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:24:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-532647375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23711eec-e57d-4239-aad5-df19d3361807,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcb81e9fe2954bf7a66ab6ccb6cdac9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:24:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:24:05Z,use_quota=True,user_id='9369ae1d5d7e49d4834ce8a5288e2522',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:24:04 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-829d9d53-0e71-4d11-a087-22926a08789c tempest-SnapshotDependencyTests-1509799463 None] Creating volume 23711eec-e57d-4239-aad5-df19d3361807 {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:24:04 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-829d9d53-0e71-4d11-a087-22926a08789c tempest-SnapshotDependencyTests-1509799463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:24:04 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-829d9d53-0e71-4d11-a087-22926a08789c tempest-SnapshotDependencyTests-1509799463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:24:04 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-829d9d53-0e71-4d11-a087-22926a08789c tempest-SnapshotDependencyTests-1509799463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:24:04 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-829d9d53-0e71-4d11-a087-22926a08789c tempest-SnapshotDependencyTests-1509799463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:24:04 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-829d9d53-0e71-4d11-a087-22926a08789c tempest-SnapshotDependencyTests-1509799463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:24:04 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-829d9d53-0e71-4d11-a087-22926a08789c tempest-SnapshotDependencyTests-1509799463 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:24:04 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-829d9d53-0e71-4d11-a087-22926a08789c tempest-SnapshotDependencyTests-1509799463 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:24:04 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-829d9d53-0e71-4d11-a087-22926a08789c tempest-SnapshotDependencyTests-1509799463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-23711eec-e57d-4239-aad5-df19d3361807 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:24:04 devstack sudo[101199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-23711eec-e57d-4239-aad5-df19d3361807 1073741824 Aug 29 01:24:04 devstack sudo[101199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:24:05 devstack sudo[101199]: pam_unix(sudo:session): session closed for user root Aug 29 01:24:05 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-829d9d53-0e71-4d11-a087-22926a08789c tempest-SnapshotDependencyTests-1509799463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-23711eec-e57d-4239-aad5-df19d3361807 1073741824" returned: 0 in 0.577s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:24:05 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-829d9d53-0e71-4d11-a087-22926a08789c tempest-SnapshotDependencyTests-1509799463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-23711eec-e57d-4239-aad5-df19d3361807 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:24:05 devstack sudo[101205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-23711eec-e57d-4239-aad5-df19d3361807 Aug 29 01:24:05 devstack sudo[101205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:24:05 devstack sudo[101205]: pam_unix(sudo:session): session closed for user root Aug 29 01:24:05 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-829d9d53-0e71-4d11-a087-22926a08789c tempest-SnapshotDependencyTests-1509799463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-23711eec-e57d-4239-aad5-df19d3361807" returned: 0 in 0.273s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:24:05 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-829d9d53-0e71-4d11-a087-22926a08789c tempest-SnapshotDependencyTests-1509799463 None] <== create_volume: return (912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:24:05 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-829d9d53-0e71-4d11-a087-22926a08789c tempest-SnapshotDependencyTests-1509799463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.914s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:24:05 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-829d9d53-0e71-4d11-a087-22926a08789c tempest-SnapshotDependencyTests-1509799463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (890fa7d3-ea93-490b-8654-9d0df34e34a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23711eec-e57d-4239-aad5-df19d3361807', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:24:05 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-829d9d53-0e71-4d11-a087-22926a08789c tempest-SnapshotDependencyTests-1509799463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3adf230-69d5-47d7-91f4-8f43d761163a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:24:05 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-829d9d53-0e71-4d11-a087-22926a08789c tempest-SnapshotDependencyTests-1509799463 None] Volume volume-23711eec-e57d-4239-aad5-df19d3361807 (23711eec-e57d-4239-aad5-df19d3361807): created successfully Aug 29 01:24:05 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-829d9d53-0e71-4d11-a087-22926a08789c tempest-SnapshotDependencyTests-1509799463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3adf230-69d5-47d7-91f4-8f43d761163a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:24:05 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-829d9d53-0e71-4d11-a087-22926a08789c tempest-SnapshotDependencyTests-1509799463 None] Flow 'volume_create_manager' (fa3705f2-f739-41c4-9e6c-5c291d8f73f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:24:05 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-829d9d53-0e71-4d11-a087-22926a08789c tempest-SnapshotDependencyTests-1509799463 None] Created volume successfully. Aug 29 01:24:07 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-708b1c0c-72da-4912-a5a1-430b59ffc85e tempest-SnapshotDependencyTests-1509799463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:24:07 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-708b1c0c-72da-4912-a5a1-430b59ffc85e tempest-SnapshotDependencyTests-1509799463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:24:07 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-708b1c0c-72da-4912-a5a1-430b59ffc85e tempest-SnapshotDependencyTests-1509799463 None] Creating offline snapshot dd36d286-2d36-4090-b652-2307200d8cec of volume 23711eec-e57d-4239-aad5-df19d3361807 {{(pid=86111) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 29 01:24:07 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[54b18887-6965-411f-847b-4d0387f15a88]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:24:07 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-708b1c0c-72da-4912-a5a1-430b59ffc85e tempest-SnapshotDependencyTests-1509799463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-23711eec-e57d-4239-aad5-df19d3361807 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:24:07 devstack sudo[101208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-23711eec-e57d-4239-aad5-df19d3361807 Aug 29 01:24:07 devstack sudo[101208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:24:07 devstack sudo[101208]: pam_unix(sudo:session): session closed for user root Aug 29 01:24:07 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-708b1c0c-72da-4912-a5a1-430b59ffc85e tempest-SnapshotDependencyTests-1509799463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-23711eec-e57d-4239-aad5-df19d3361807" returned: 0 in 0.466s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:24:07 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-708b1c0c-72da-4912-a5a1-430b59ffc85e tempest-SnapshotDependencyTests-1509799463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-23711eec-e57d-4239-aad5-df19d3361807,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-23711eec-e57d-4239-aad5-df19d3361807.dd36d286-2d36-4090-b652-2307200d8cec 1G {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:24:07 devstack sudo[101214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-23711eec-e57d-4239-aad5-df19d3361807,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-23711eec-e57d-4239-aad5-df19d3361807.dd36d286-2d36-4090-b652-2307200d8cec 1G Aug 29 01:24:07 devstack sudo[101214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:24:08 devstack sudo[101214]: pam_unix(sudo:session): session closed for user root Aug 29 01:24:08 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-708b1c0c-72da-4912-a5a1-430b59ffc85e tempest-SnapshotDependencyTests-1509799463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-23711eec-e57d-4239-aad5-df19d3361807,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-23711eec-e57d-4239-aad5-df19d3361807.dd36d286-2d36-4090-b652-2307200d8cec 1G" returned: 0 in 0.506s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:24:08 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-708b1c0c-72da-4912-a5a1-430b59ffc85e tempest-SnapshotDependencyTests-1509799463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23711eec-e57d-4239-aad5-df19d3361807 -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-23711eec-e57d-4239-aad5-df19d3361807.dd36d286-2d36-4090-b652-2307200d8cec {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:24:08 devstack sudo[101219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23711eec-e57d-4239-aad5-df19d3361807 -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-23711eec-e57d-4239-aad5-df19d3361807.dd36d286-2d36-4090-b652-2307200d8cec Aug 29 01:24:08 devstack sudo[101219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:24:08 devstack sudo[101219]: pam_unix(sudo:session): session closed for user root Aug 29 01:24:08 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-708b1c0c-72da-4912-a5a1-430b59ffc85e tempest-SnapshotDependencyTests-1509799463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23711eec-e57d-4239-aad5-df19d3361807 -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-23711eec-e57d-4239-aad5-df19d3361807.dd36d286-2d36-4090-b652-2307200d8cec" returned: 0 in 0.335s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:24:08 devstack cinder-volume[86111]: WARNING cinder.volume.drivers.remotefs [None req-708b1c0c-72da-4912-a5a1-430b59ffc85e tempest-SnapshotDependencyTests-1509799463 None] /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-23711eec-e57d-4239-aad5-df19d3361807.dd36d286-2d36-4090-b652-2307200d8cec is being set with open permissions: ugo+rw Aug 29 01:24:08 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-708b1c0c-72da-4912-a5a1-430b59ffc85e tempest-SnapshotDependencyTests-1509799463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-23711eec-e57d-4239-aad5-df19d3361807.dd36d286-2d36-4090-b652-2307200d8cec {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:24:08 devstack sudo[101224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-23711eec-e57d-4239-aad5-df19d3361807.dd36d286-2d36-4090-b652-2307200d8cec Aug 29 01:24:08 devstack sudo[101224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:24:08 devstack sudo[101224]: pam_unix(sudo:session): session closed for user root Aug 29 01:24:08 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-708b1c0c-72da-4912-a5a1-430b59ffc85e tempest-SnapshotDependencyTests-1509799463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-23711eec-e57d-4239-aad5-df19d3361807.dd36d286-2d36-4090-b652-2307200d8cec" returned: 0 in 0.266s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:24:08 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-708b1c0c-72da-4912-a5a1-430b59ffc85e tempest-SnapshotDependencyTests-1509799463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-23711eec-e57d-4239-aad5-df19d3361807.info {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:24:08 devstack sudo[101227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-23711eec-e57d-4239-aad5-df19d3361807.info Aug 29 01:24:08 devstack sudo[101227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:24:09 devstack sudo[101227]: pam_unix(sudo:session): session closed for user root Aug 29 01:24:09 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-708b1c0c-72da-4912-a5a1-430b59ffc85e tempest-SnapshotDependencyTests-1509799463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-23711eec-e57d-4239-aad5-df19d3361807.info" returned: 0 in 0.370s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:24:09 devstack cinder-volume[86111]: WARNING cinder.volume.drivers.remotefs [None req-708b1c0c-72da-4912-a5a1-430b59ffc85e tempest-SnapshotDependencyTests-1509799463 None] /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-23711eec-e57d-4239-aad5-df19d3361807.info is being set with open permissions: ugo+rw Aug 29 01:24:09 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-708b1c0c-72da-4912-a5a1-430b59ffc85e tempest-SnapshotDependencyTests-1509799463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-23711eec-e57d-4239-aad5-df19d3361807.info {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:24:09 devstack sudo[101231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-23711eec-e57d-4239-aad5-df19d3361807.info Aug 29 01:24:09 devstack sudo[101231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:24:09 devstack sudo[101231]: pam_unix(sudo:session): session closed for user root Aug 29 01:24:09 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-708b1c0c-72da-4912-a5a1-430b59ffc85e tempest-SnapshotDependencyTests-1509799463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-23711eec-e57d-4239-aad5-df19d3361807.info" returned: 0 in 0.325s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:24:09 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-708b1c0c-72da-4912-a5a1-430b59ffc85e tempest-SnapshotDependencyTests-1509799463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.367s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:24:09 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-708b1c0c-72da-4912-a5a1-430b59ffc85e tempest-SnapshotDependencyTests-1509799463 None] Create snapshot completed successfully Aug 29 01:24:11 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a1d0965-30e0-49e9-ac0c-44b4424e2795 tempest-SnapshotDependencyTests-1509799463 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:24:11 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-0a1d0965-30e0-49e9-ac0c-44b4424e2795 tempest-SnapshotDependencyTests-1509799463 None] Flow 'volume_create_manager' (caf95289-6aa5-407e-9ee4-f290cdc08c0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:24:11 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-0a1d0965-30e0-49e9-ac0c-44b4424e2795 tempest-SnapshotDependencyTests-1509799463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (742c0b1b-7a50-4f4e-abbb-805594849cce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:24:11 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-0a1d0965-30e0-49e9-ac0c-44b4424e2795 tempest-SnapshotDependencyTests-1509799463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (742c0b1b-7a50-4f4e-abbb-805594849cce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:24:11Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50e52bad-4090-4673-ac3e-436b5c34aeb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcb81e9fe2954bf7a66ab6ccb6cdac9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:24:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=dd36d286-2d36-4090-b652-2307200d8cec,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:24:11Z,use_quota=True,user_id='9369ae1d5d7e49d4834ce8a5288e2522',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:24:11 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-0a1d0965-30e0-49e9-ac0c-44b4424e2795 tempest-SnapshotDependencyTests-1509799463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27b6ebf1-2d38-496a-9496-93607af21d78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:24:11 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-0a1d0965-30e0-49e9-ac0c-44b4424e2795 tempest-SnapshotDependencyTests-1509799463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27b6ebf1-2d38-496a-9496-93607af21d78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:24:11 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-0a1d0965-30e0-49e9-ac0c-44b4424e2795 tempest-SnapshotDependencyTests-1509799463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86daa9ad-8972-4b9c-94b3-a210cac618e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:24:11 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-0a1d0965-30e0-49e9-ac0c-44b4424e2795 tempest-SnapshotDependencyTests-1509799463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86daa9ad-8972-4b9c-94b3-a210cac618e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '50e52bad-4090-4673-ac3e-436b5c34aeb4', 'volume_name': 'volume-50e52bad-4090-4673-ac3e-436b5c34aeb4', 'volume_size': 1, 'snapshot_id': 'dd36d286-2d36-4090-b652-2307200d8cec'}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:24:11 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-0a1d0965-30e0-49e9-ac0c-44b4424e2795 tempest-SnapshotDependencyTests-1509799463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9899b47e-1805-480e-9c2e-2014aeb5a042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:24:11 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-0a1d0965-30e0-49e9-ac0c-44b4424e2795 tempest-SnapshotDependencyTests-1509799463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9899b47e-1805-480e-9c2e-2014aeb5a042) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:24:11 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-0a1d0965-30e0-49e9-ac0c-44b4424e2795 tempest-SnapshotDependencyTests-1509799463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (993a17ad-0220-4d4d-84b8-4ba5fe2f61cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:24:11 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-0a1d0965-30e0-49e9-ac0c-44b4424e2795 tempest-SnapshotDependencyTests-1509799463 None] Volume 50e52bad-4090-4673-ac3e-436b5c34aeb4: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-50e52bad-4090-4673-ac3e-436b5c34aeb4', 'volume_size': 1, 'snapshot_id': 'dd36d286-2d36-4090-b652-2307200d8cec'} Aug 29 01:24:11 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-0a1d0965-30e0-49e9-ac0c-44b4424e2795 tempest-SnapshotDependencyTests-1509799463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:24:11 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-0a1d0965-30e0-49e9-ac0c-44b4424e2795 tempest-SnapshotDependencyTests-1509799463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:24:11 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-0a1d0965-30e0-49e9-ac0c-44b4424e2795 tempest-SnapshotDependencyTests-1509799463 None] Acquiring lock "cinder-quobyte-dd36d286-2d36-4090-b652-2307200d8cec-50e52bad-4090-4673-ac3e-436b5c34aeb4" by "_create_volume_from_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:24:11 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-0a1d0965-30e0-49e9-ac0c-44b4424e2795 tempest-SnapshotDependencyTests-1509799463 None] Lock "cinder-quobyte-dd36d286-2d36-4090-b652-2307200d8cec-50e52bad-4090-4673-ac3e-436b5c34aeb4" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:24:11 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-0a1d0965-30e0-49e9-ac0c-44b4424e2795 tempest-SnapshotDependencyTests-1509799463 None] Creating volume 50e52bad-4090-4673-ac3e-436b5c34aeb4 from snapshot dd36d286-2d36-4090-b652-2307200d8cec {{(pid=86111) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Aug 29 01:24:11 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-0a1d0965-30e0-49e9-ac0c-44b4424e2795 tempest-SnapshotDependencyTests-1509799463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:24:11 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-0a1d0965-30e0-49e9-ac0c-44b4424e2795 tempest-SnapshotDependencyTests-1509799463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:24:11 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-0a1d0965-30e0-49e9-ac0c-44b4424e2795 tempest-SnapshotDependencyTests-1509799463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:24:11 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-0a1d0965-30e0-49e9-ac0c-44b4424e2795 tempest-SnapshotDependencyTests-1509799463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:24:11 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-0a1d0965-30e0-49e9-ac0c-44b4424e2795 tempest-SnapshotDependencyTests-1509799463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:24:11 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-0a1d0965-30e0-49e9-ac0c-44b4424e2795 tempest-SnapshotDependencyTests-1509799463 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:24:11 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-0a1d0965-30e0-49e9-ac0c-44b4424e2795 tempest-SnapshotDependencyTests-1509799463 None] Acquiring lock "cinder-quobyte-50e52bad-4090-4673-ac3e-436b5c34aeb4" by "_copy_volume_from_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:24:11 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-0a1d0965-30e0-49e9-ac0c-44b4424e2795 tempest-SnapshotDependencyTests-1509799463 None] Lock "cinder-quobyte-50e52bad-4090-4673-ac3e-436b5c34aeb4" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:24:11 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-0a1d0965-30e0-49e9-ac0c-44b4424e2795 tempest-SnapshotDependencyTests-1509799463 None] snapshot: dd36d286-2d36-4090-b652-2307200d8cec, volume: 50e52bad-4090-4673-ac3e-436b5c34aeb4, {{(pid=86111) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 29 01:24:11 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-0a1d0965-30e0-49e9-ac0c-44b4424e2795 tempest-SnapshotDependencyTests-1509799463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:24:11 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-0a1d0965-30e0-49e9-ac0c-44b4424e2795 tempest-SnapshotDependencyTests-1509799463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:24:11 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-0a1d0965-30e0-49e9-ac0c-44b4424e2795 tempest-SnapshotDependencyTests-1509799463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:24:11 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-0a1d0965-30e0-49e9-ac0c-44b4424e2795 tempest-SnapshotDependencyTests-1509799463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:24:11 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-0a1d0965-30e0-49e9-ac0c-44b4424e2795 tempest-SnapshotDependencyTests-1509799463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:24:11 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[37f36413-c139-4aee-bbbb-c34426275a5a]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:24:11 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-0a1d0965-30e0-49e9-ac0c-44b4424e2795 tempest-SnapshotDependencyTests-1509799463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-23711eec-e57d-4239-aad5-df19d3361807.dd36d286-2d36-4090-b652-2307200d8cec {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:24:11 devstack sudo[101234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-23711eec-e57d-4239-aad5-df19d3361807.dd36d286-2d36-4090-b652-2307200d8cec Aug 29 01:24:11 devstack sudo[101234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:24:11 devstack sudo[101234]: pam_unix(sudo:session): session closed for user root Aug 29 01:24:11 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-0a1d0965-30e0-49e9-ac0c-44b4424e2795 tempest-SnapshotDependencyTests-1509799463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-23711eec-e57d-4239-aad5-df19d3361807.dd36d286-2d36-4090-b652-2307200d8cec" returned: 0 in 0.441s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:24:11 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-0a1d0965-30e0-49e9-ac0c-44b4424e2795 tempest-SnapshotDependencyTests-1509799463 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-23711eec-e57d-4239-aad5-df19d3361807(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 29 01:24:11 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cb863a6-1b55-4a01-9a54-ff3b08cf2b77]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:24:11 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-0a1d0965-30e0-49e9-ac0c-44b4424e2795 tempest-SnapshotDependencyTests-1509799463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-23711eec-e57d-4239-aad5-df19d3361807 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:24:11 devstack sudo[101239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-23711eec-e57d-4239-aad5-df19d3361807 Aug 29 01:24:11 devstack sudo[101239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:24:12 devstack sudo[101239]: pam_unix(sudo:session): session closed for user root Aug 29 01:24:12 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-0a1d0965-30e0-49e9-ac0c-44b4424e2795 tempest-SnapshotDependencyTests-1509799463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-23711eec-e57d-4239-aad5-df19d3361807" returned: 0 in 0.470s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:24:12 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-0a1d0965-30e0-49e9-ac0c-44b4424e2795 tempest-SnapshotDependencyTests-1509799463 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-23711eec-e57d-4239-aad5-df19d3361807 {{(pid=86111) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 29 01:24:12 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-0a1d0965-30e0-49e9-ac0c-44b4424e2795 tempest-SnapshotDependencyTests-1509799463 None] Creating direct copy from snapshot {{(pid=86111) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 29 01:24:12 devstack cinder-volume[86111]: DEBUG cinder.utils [None req-0a1d0965-30e0-49e9-ac0c-44b4424e2795 tempest-SnapshotDependencyTests-1509799463 None] Path /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-50e52bad-4090-4673-ac3e-436b5c34aeb4 not found in is_blk_device check {{(pid=86111) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 29 01:24:12 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-0a1d0965-30e0-49e9-ac0c-44b4424e2795 tempest-SnapshotDependencyTests-1509799463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-23711eec-e57d-4239-aad5-df19d3361807 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-50e52bad-4090-4673-ac3e-436b5c34aeb4 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:24:12 devstack sudo[101244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-23711eec-e57d-4239-aad5-df19d3361807 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-50e52bad-4090-4673-ac3e-436b5c34aeb4 Aug 29 01:24:12 devstack sudo[101244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:24:18 devstack sudo[101244]: pam_unix(sudo:session): session closed for user root Aug 29 01:24:18 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-0a1d0965-30e0-49e9-ac0c-44b4424e2795 tempest-SnapshotDependencyTests-1509799463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-23711eec-e57d-4239-aad5-df19d3361807 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-50e52bad-4090-4673-ac3e-436b5c34aeb4" returned: 0 in 6.253s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:24:18 devstack cinder-volume[86111]: DEBUG cinder.image.image_utils [None req-0a1d0965-30e0-49e9-ac0c-44b4424e2795 tempest-SnapshotDependencyTests-1509799463 None] Image conversion details: src /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-23711eec-e57d-4239-aad5-df19d3361807, size 1024.00 MB, duration 6.25 sec, destination /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-50e52bad-4090-4673-ac3e-436b5c34aeb4 {{(pid=86111) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 29 01:24:18 devstack cinder-volume[86111]: INFO cinder.image.image_utils [None req-0a1d0965-30e0-49e9-ac0c-44b4424e2795 tempest-SnapshotDependencyTests-1509799463 None] Converted 1024.00 MB image at 163.73 MB/s Aug 29 01:24:18 devstack cinder-volume[86111]: WARNING cinder.volume.drivers.remotefs [None req-0a1d0965-30e0-49e9-ac0c-44b4424e2795 tempest-SnapshotDependencyTests-1509799463 None] /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-50e52bad-4090-4673-ac3e-436b5c34aeb4 is being set with open permissions: ugo+rw Aug 29 01:24:18 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-0a1d0965-30e0-49e9-ac0c-44b4424e2795 tempest-SnapshotDependencyTests-1509799463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-50e52bad-4090-4673-ac3e-436b5c34aeb4 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:24:18 devstack sudo[101257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-50e52bad-4090-4673-ac3e-436b5c34aeb4 Aug 29 01:24:18 devstack sudo[101257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:24:18 devstack sudo[101257]: pam_unix(sudo:session): session closed for user root Aug 29 01:24:18 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-0a1d0965-30e0-49e9-ac0c-44b4424e2795 tempest-SnapshotDependencyTests-1509799463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-50e52bad-4090-4673-ac3e-436b5c34aeb4" returned: 0 in 0.269s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:24:18 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-0a1d0965-30e0-49e9-ac0c-44b4424e2795 tempest-SnapshotDependencyTests-1509799463 None] Lock "cinder-quobyte-50e52bad-4090-4673-ac3e-436b5c34aeb4" released by "_copy_volume_from_snapshot" :: held 7.531s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:24:18 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-0a1d0965-30e0-49e9-ac0c-44b4424e2795 tempest-SnapshotDependencyTests-1509799463 None] Lock "cinder-quobyte-dd36d286-2d36-4090-b652-2307200d8cec-50e52bad-4090-4673-ac3e-436b5c34aeb4" released by "_create_volume_from_snapshot" :: held 7.624s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:24:18 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-0a1d0965-30e0-49e9-ac0c-44b4424e2795 tempest-SnapshotDependencyTests-1509799463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.644s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:24:18 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-0a1d0965-30e0-49e9-ac0c-44b4424e2795 tempest-SnapshotDependencyTests-1509799463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (993a17ad-0220-4d4d-84b8-4ba5fe2f61cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50e52bad-4090-4673-ac3e-436b5c34aeb4', 'volume_size': 1, 'snapshot_id': 'dd36d286-2d36-4090-b652-2307200d8cec'}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:24:18 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-0a1d0965-30e0-49e9-ac0c-44b4424e2795 tempest-SnapshotDependencyTests-1509799463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (698b54a2-5770-4075-88f2-7b8a899e5019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:24:18 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-0a1d0965-30e0-49e9-ac0c-44b4424e2795 tempest-SnapshotDependencyTests-1509799463 None] Volume volume-50e52bad-4090-4673-ac3e-436b5c34aeb4 (50e52bad-4090-4673-ac3e-436b5c34aeb4): created successfully Aug 29 01:24:18 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-0a1d0965-30e0-49e9-ac0c-44b4424e2795 tempest-SnapshotDependencyTests-1509799463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (698b54a2-5770-4075-88f2-7b8a899e5019) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:24:18 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-0a1d0965-30e0-49e9-ac0c-44b4424e2795 tempest-SnapshotDependencyTests-1509799463 None] Flow 'volume_create_manager' (caf95289-6aa5-407e-9ee4-f290cdc08c0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:24:18 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-0a1d0965-30e0-49e9-ac0c-44b4424e2795 tempest-SnapshotDependencyTests-1509799463 None] Created volume successfully. Aug 29 01:24:20 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-83977af6-780d-472d-a6f8-3307aabf3a0f tempest-SnapshotDependencyTests-1509799463 None] Acquiring lock "cinder-dd36d286-2d36-4090-b652-2307200d8cec-delete_snapshot" by "delete_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:24:20 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-83977af6-780d-472d-a6f8-3307aabf3a0f tempest-SnapshotDependencyTests-1509799463 None] Lock "cinder-dd36d286-2d36-4090-b652-2307200d8cec-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:24:20 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-83977af6-780d-472d-a6f8-3307aabf3a0f tempest-SnapshotDependencyTests-1509799463 None] Acquiring lock "cinder-quobyte-23711eec-e57d-4239-aad5-df19d3361807" by "delete_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:24:20 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-83977af6-780d-472d-a6f8-3307aabf3a0f tempest-SnapshotDependencyTests-1509799463 None] Lock "cinder-quobyte-23711eec-e57d-4239-aad5-df19d3361807" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:24:20 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-83977af6-780d-472d-a6f8-3307aabf3a0f tempest-SnapshotDependencyTests-1509799463 None] Acquiring lock "cinder-quobyte-dd36d286-2d36-4090-b652-2307200d8cec" by "_delete_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:24:20 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-83977af6-780d-472d-a6f8-3307aabf3a0f tempest-SnapshotDependencyTests-1509799463 None] Lock "cinder-quobyte-dd36d286-2d36-4090-b652-2307200d8cec" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:24:20 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-83977af6-780d-472d-a6f8-3307aabf3a0f tempest-SnapshotDependencyTests-1509799463 None] Deleting offline snapshot dd36d286-2d36-4090-b652-2307200d8cec of volume 23711eec-e57d-4239-aad5-df19d3361807 {{(pid=86111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 29 01:24:20 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-83977af6-780d-472d-a6f8-3307aabf3a0f tempest-SnapshotDependencyTests-1509799463 None] snapshot_file for this snap is: volume-23711eec-e57d-4239-aad5-df19d3361807.dd36d286-2d36-4090-b652-2307200d8cec {{(pid=86111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 29 01:24:20 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[e10c6221-8dbc-425d-9fa9-8e619d69512a]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:24:20 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-83977af6-780d-472d-a6f8-3307aabf3a0f tempest-SnapshotDependencyTests-1509799463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-23711eec-e57d-4239-aad5-df19d3361807.dd36d286-2d36-4090-b652-2307200d8cec {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:24:20 devstack sudo[101261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-23711eec-e57d-4239-aad5-df19d3361807.dd36d286-2d36-4090-b652-2307200d8cec Aug 29 01:24:20 devstack sudo[101261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:24:20 devstack sudo[101261]: pam_unix(sudo:session): session closed for user root Aug 29 01:24:20 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-83977af6-780d-472d-a6f8-3307aabf3a0f tempest-SnapshotDependencyTests-1509799463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-23711eec-e57d-4239-aad5-df19d3361807.dd36d286-2d36-4090-b652-2307200d8cec" returned: 0 in 0.460s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:24:20 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-83977af6-780d-472d-a6f8-3307aabf3a0f tempest-SnapshotDependencyTests-1509799463 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-23711eec-e57d-4239-aad5-df19d3361807(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 29 01:24:20 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ae5bd01-d228-492f-a49a-c3e17ebdc34d]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:24:20 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-83977af6-780d-472d-a6f8-3307aabf3a0f tempest-SnapshotDependencyTests-1509799463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-23711eec-e57d-4239-aad5-df19d3361807 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:24:20 devstack sudo[101267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-23711eec-e57d-4239-aad5-df19d3361807 Aug 29 01:24:20 devstack sudo[101267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:24:21 devstack sudo[101267]: pam_unix(sudo:session): session closed for user root Aug 29 01:24:21 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-83977af6-780d-472d-a6f8-3307aabf3a0f tempest-SnapshotDependencyTests-1509799463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-23711eec-e57d-4239-aad5-df19d3361807" returned: 0 in 0.667s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:24:21 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-83977af6-780d-472d-a6f8-3307aabf3a0f tempest-SnapshotDependencyTests-1509799463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-23711eec-e57d-4239-aad5-df19d3361807.dd36d286-2d36-4090-b652-2307200d8cec {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:24:21 devstack sudo[101272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-23711eec-e57d-4239-aad5-df19d3361807.dd36d286-2d36-4090-b652-2307200d8cec Aug 29 01:24:21 devstack sudo[101272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:24:21 devstack sudo[101272]: pam_unix(sudo:session): session closed for user root Aug 29 01:24:21 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-83977af6-780d-472d-a6f8-3307aabf3a0f tempest-SnapshotDependencyTests-1509799463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-23711eec-e57d-4239-aad5-df19d3361807.dd36d286-2d36-4090-b652-2307200d8cec" returned: 0 in 0.412s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:24:21 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-83977af6-780d-472d-a6f8-3307aabf3a0f tempest-SnapshotDependencyTests-1509799463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-23711eec-e57d-4239-aad5-df19d3361807.dd36d286-2d36-4090-b652-2307200d8cec {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:24:21 devstack sudo[101279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-23711eec-e57d-4239-aad5-df19d3361807.dd36d286-2d36-4090-b652-2307200d8cec Aug 29 01:24:21 devstack sudo[101279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:24:21 devstack sudo[101279]: pam_unix(sudo:session): session closed for user root Aug 29 01:24:21 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-83977af6-780d-472d-a6f8-3307aabf3a0f tempest-SnapshotDependencyTests-1509799463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-23711eec-e57d-4239-aad5-df19d3361807.dd36d286-2d36-4090-b652-2307200d8cec" returned: 0 in 0.270s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:24:22 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-83977af6-780d-472d-a6f8-3307aabf3a0f tempest-SnapshotDependencyTests-1509799463 None] Lock "cinder-quobyte-dd36d286-2d36-4090-b652-2307200d8cec" released by "_delete_snapshot" :: held 1.946s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:24:22 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-83977af6-780d-472d-a6f8-3307aabf3a0f tempest-SnapshotDependencyTests-1509799463 None] Lock "cinder-quobyte-23711eec-e57d-4239-aad5-df19d3361807" released by "delete_snapshot" :: held 1.977s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:24:22 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-83977af6-780d-472d-a6f8-3307aabf3a0f tempest-SnapshotDependencyTests-1509799463 None] Created reservations ['198a42a3-a6e2-42ea-a97a-1a623bfda0c6', 'e0b90251-960d-441c-bf5f-a6aed4ae66ed', '934f1a39-9c63-4a39-98d3-bbc32aa128ba', '1b3bfc79-a11a-4e65-9790-5a65c28f2e2f'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:24:22 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-83977af6-780d-472d-a6f8-3307aabf3a0f tempest-SnapshotDependencyTests-1509799463 None] Delete snapshot completed successfully. Aug 29 01:24:22 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-83977af6-780d-472d-a6f8-3307aabf3a0f tempest-SnapshotDependencyTests-1509799463 None] Lock "cinder-dd36d286-2d36-4090-b652-2307200d8cec-delete_snapshot" released by "delete_snapshot" :: held 2.162s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:24:22 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-8a334817-3ca8-48f5-bb56-d83caab36a7f tempest-SnapshotDependencyTests-1509799463 None] Acquiring lock "cinder-23711eec-e57d-4239-aad5-df19d3361807-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:24:22 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-8a334817-3ca8-48f5-bb56-d83caab36a7f tempest-SnapshotDependencyTests-1509799463 None] Lock "cinder-23711eec-e57d-4239-aad5-df19d3361807-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:24:22 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-8a334817-3ca8-48f5-bb56-d83caab36a7f tempest-SnapshotDependencyTests-1509799463 None] Acquiring lock "cinder-quobyte-23711eec-e57d-4239-aad5-df19d3361807" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:24:22 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-8a334817-3ca8-48f5-bb56-d83caab36a7f tempest-SnapshotDependencyTests-1509799463 None] Lock "cinder-quobyte-23711eec-e57d-4239-aad5-df19d3361807" acquired by "delete_volume" :: waited 0.027s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:24:22 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[be181a09-ed7e-4952-ba10-1c594aa8c53c]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:24:22 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8a334817-3ca8-48f5-bb56-d83caab36a7f tempest-SnapshotDependencyTests-1509799463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-23711eec-e57d-4239-aad5-df19d3361807 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:24:22 devstack sudo[101285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-23711eec-e57d-4239-aad5-df19d3361807 Aug 29 01:24:22 devstack sudo[101285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:24:22 devstack sudo[101285]: pam_unix(sudo:session): session closed for user root Aug 29 01:24:22 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8a334817-3ca8-48f5-bb56-d83caab36a7f tempest-SnapshotDependencyTests-1509799463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-23711eec-e57d-4239-aad5-df19d3361807" returned: 0 in 0.434s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:24:22 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8a334817-3ca8-48f5-bb56-d83caab36a7f tempest-SnapshotDependencyTests-1509799463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-23711eec-e57d-4239-aad5-df19d3361807 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:24:22 devstack sudo[101293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-23711eec-e57d-4239-aad5-df19d3361807 Aug 29 01:24:22 devstack sudo[101293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:24:23 devstack sudo[101293]: pam_unix(sudo:session): session closed for user root Aug 29 01:24:23 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8a334817-3ca8-48f5-bb56-d83caab36a7f tempest-SnapshotDependencyTests-1509799463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-23711eec-e57d-4239-aad5-df19d3361807" returned: 0 in 0.284s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:24:23 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-8a334817-3ca8-48f5-bb56-d83caab36a7f tempest-SnapshotDependencyTests-1509799463 None] Lock "cinder-quobyte-23711eec-e57d-4239-aad5-df19d3361807" released by "delete_volume" :: held 0.809s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:24:23 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-8a334817-3ca8-48f5-bb56-d83caab36a7f tempest-SnapshotDependencyTests-1509799463 None] Created reservations ['acd2d9d1-9fd6-46e7-bd4e-88704bf5bf82', '7e6f0e41-99db-4b10-9396-27be5655d59a', '47e36ae6-6859-450d-ac0e-0e5fab169270', 'c00f7162-1975-4b2f-adad-3d46a0cfa1ea'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:24:23 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-8a334817-3ca8-48f5-bb56-d83caab36a7f tempest-SnapshotDependencyTests-1509799463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:24:23 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-8a334817-3ca8-48f5-bb56-d83caab36a7f tempest-SnapshotDependencyTests-1509799463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:24:23 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-8a334817-3ca8-48f5-bb56-d83caab36a7f tempest-SnapshotDependencyTests-1509799463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:24:23 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-8a334817-3ca8-48f5-bb56-d83caab36a7f tempest-SnapshotDependencyTests-1509799463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:24:23 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-8a334817-3ca8-48f5-bb56-d83caab36a7f tempest-SnapshotDependencyTests-1509799463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:24:23 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8a334817-3ca8-48f5-bb56-d83caab36a7f tempest-SnapshotDependencyTests-1509799463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:24:23 devstack sudo[101296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:24:23 devstack sudo[101296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:24:23 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-b17804a6-9dd3-4dfd-8f51-d0783da37128 tempest-SnapshotDependencyTests-1509799463 None] Acquiring lock "cinder-50e52bad-4090-4673-ac3e-436b5c34aeb4-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:24:23 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-b17804a6-9dd3-4dfd-8f51-d0783da37128 tempest-SnapshotDependencyTests-1509799463 None] Lock "cinder-50e52bad-4090-4673-ac3e-436b5c34aeb4-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:24:23 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-b17804a6-9dd3-4dfd-8f51-d0783da37128 tempest-SnapshotDependencyTests-1509799463 None] Acquiring lock "cinder-quobyte-50e52bad-4090-4673-ac3e-436b5c34aeb4" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:24:23 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-b17804a6-9dd3-4dfd-8f51-d0783da37128 tempest-SnapshotDependencyTests-1509799463 None] Lock "cinder-quobyte-50e52bad-4090-4673-ac3e-436b5c34aeb4" acquired by "delete_volume" :: waited 0.023s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:24:23 devstack sudo[101296]: pam_unix(sudo:session): session closed for user root Aug 29 01:24:23 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8a334817-3ca8-48f5-bb56-d83caab36a7f tempest-SnapshotDependencyTests-1509799463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.386s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:24:23 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-8a334817-3ca8-48f5-bb56-d83caab36a7f tempest-SnapshotDependencyTests-1509799463 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:24:23 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-8a334817-3ca8-48f5-bb56-d83caab36a7f tempest-SnapshotDependencyTests-1509799463 None] Deleted volume successfully. Aug 29 01:24:23 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[194716a8-df05-47ef-af9a-317397e1d7d5]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:24:23 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-b17804a6-9dd3-4dfd-8f51-d0783da37128 tempest-SnapshotDependencyTests-1509799463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-50e52bad-4090-4673-ac3e-436b5c34aeb4 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:24:23 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-8a334817-3ca8-48f5-bb56-d83caab36a7f tempest-SnapshotDependencyTests-1509799463 None] Lock "cinder-23711eec-e57d-4239-aad5-df19d3361807-delete_volume" released by "delete_volume" :: held 1.478s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:24:23 devstack sudo[101299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-50e52bad-4090-4673-ac3e-436b5c34aeb4 Aug 29 01:24:23 devstack sudo[101299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:24:24 devstack sudo[101299]: pam_unix(sudo:session): session closed for user root Aug 29 01:24:24 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-b17804a6-9dd3-4dfd-8f51-d0783da37128 tempest-SnapshotDependencyTests-1509799463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-50e52bad-4090-4673-ac3e-436b5c34aeb4" returned: 0 in 0.424s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:24:24 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-b17804a6-9dd3-4dfd-8f51-d0783da37128 tempest-SnapshotDependencyTests-1509799463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-50e52bad-4090-4673-ac3e-436b5c34aeb4 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:24:24 devstack sudo[101307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-50e52bad-4090-4673-ac3e-436b5c34aeb4 Aug 29 01:24:24 devstack sudo[101307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:24:24 devstack sudo[101307]: pam_unix(sudo:session): session closed for user root Aug 29 01:24:24 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-b17804a6-9dd3-4dfd-8f51-d0783da37128 tempest-SnapshotDependencyTests-1509799463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-50e52bad-4090-4673-ac3e-436b5c34aeb4" returned: 0 in 0.277s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:24:24 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-b17804a6-9dd3-4dfd-8f51-d0783da37128 tempest-SnapshotDependencyTests-1509799463 None] Lock "cinder-quobyte-50e52bad-4090-4673-ac3e-436b5c34aeb4" released by "delete_volume" :: held 0.766s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:24:24 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-b17804a6-9dd3-4dfd-8f51-d0783da37128 tempest-SnapshotDependencyTests-1509799463 None] Created reservations ['5f8f383d-944c-45fb-ba41-a5e92132bee2', '95331420-ca0c-4ac8-a746-d915cf69207b', '0b114f06-9566-4bf2-80ce-3f2fad1a5cb9', 'd5f347c5-46bc-4a7a-8bf4-d13c527caa47'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:24:24 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-b17804a6-9dd3-4dfd-8f51-d0783da37128 tempest-SnapshotDependencyTests-1509799463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:24:24 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-b17804a6-9dd3-4dfd-8f51-d0783da37128 tempest-SnapshotDependencyTests-1509799463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:24:24 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-b17804a6-9dd3-4dfd-8f51-d0783da37128 tempest-SnapshotDependencyTests-1509799463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:24:24 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-b17804a6-9dd3-4dfd-8f51-d0783da37128 tempest-SnapshotDependencyTests-1509799463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:24:24 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-b17804a6-9dd3-4dfd-8f51-d0783da37128 tempest-SnapshotDependencyTests-1509799463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:24:24 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-b17804a6-9dd3-4dfd-8f51-d0783da37128 tempest-SnapshotDependencyTests-1509799463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:24:24 devstack sudo[101310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:24:24 devstack sudo[101310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:24:24 devstack sudo[101310]: pam_unix(sudo:session): session closed for user root Aug 29 01:24:24 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-b17804a6-9dd3-4dfd-8f51-d0783da37128 tempest-SnapshotDependencyTests-1509799463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.322s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:24:24 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-b17804a6-9dd3-4dfd-8f51-d0783da37128 tempest-SnapshotDependencyTests-1509799463 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:24:24 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-b17804a6-9dd3-4dfd-8f51-d0783da37128 tempest-SnapshotDependencyTests-1509799463 None] Deleted volume successfully. Aug 29 01:24:24 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-b17804a6-9dd3-4dfd-8f51-d0783da37128 tempest-SnapshotDependencyTests-1509799463 None] Lock "cinder-50e52bad-4090-4673-ac3e-436b5c34aeb4-delete_volume" released by "delete_volume" :: held 1.366s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:24:34 devstack cinder-volume[86111]: DEBUG dbcounter [-] [86111] Writing DB stats cinder:SELECT=79,cinder:INSERT=30,cinder:UPDATE=99,cinder:DELETE=6 {{(pid=86111) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 29 01:24:34 devstack cinder-volume[86111]: DEBUG dbcounter [-] [86111] Writing DB stats cinder:SELECT=72,cinder:INSERT=24,cinder:UPDATE=112,cinder:DELETE=10 {{(pid=86111) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 29 01:24:40 devstack cinder-volume[86111]: DEBUG oslo_service.periodic_task [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86111) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 29 01:24:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:24:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:24:40 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:24:40 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:24:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:24:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:24:40 devstack sudo[101357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:24:40 devstack sudo[101357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:24:41 devstack sudo[101357]: pam_unix(sudo:session): session closed for user root Aug 29 01:24:41 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-de752545-d617-440e-8362-d04fae0901a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.265s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:24:41 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:24:41 devstack cinder-volume[86111]: DEBUG oslo_service.periodic_task [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Running periodic task VolumeManager._thread_info {{(pid=86111) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 29 01:24:41 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-de752545-d617-440e-8362-d04fae0901a5 None None] thread count: 28 {{(pid=86111) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 29 01:24:41 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-de752545-d617-440e-8362-d04fae0901a5 None None] thread info: [<_MainThread(MainThread, started 129173440548992)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86111) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 29 01:24:42 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-0119fbc5-b759-4cd7-a23f-23f099ad887d tempest-TestShelveInstance-649116597 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:24:42 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-0119fbc5-b759-4cd7-a23f-23f099ad887d tempest-TestShelveInstance-649116597 None] Flow 'volume_create_manager' (6f19f87b-9068-468b-8484-3b81a6bfe773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:24:42 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-0119fbc5-b759-4cd7-a23f-23f099ad887d tempest-TestShelveInstance-649116597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b10e9544-8d9f-490b-be3c-8a553710bc1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:24:42 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-0119fbc5-b759-4cd7-a23f-23f099ad887d tempest-TestShelveInstance-649116597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b10e9544-8d9f-490b-be3c-8a553710bc1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:24:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1850061115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa985749-e6ef-4d1a-9109-e5ee8b6074a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b1b8ed4011e47c1b021e49bcb0246e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:24:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:24:42Z,use_quota=True,user_id='8eb88332a1614bc5a6316400b2818507',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:24:42 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-0119fbc5-b759-4cd7-a23f-23f099ad887d tempest-TestShelveInstance-649116597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5dc75f5f-9840-417e-b4e7-4345cc58e51e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:24:42 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-0119fbc5-b759-4cd7-a23f-23f099ad887d tempest-TestShelveInstance-649116597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5dc75f5f-9840-417e-b4e7-4345cc58e51e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:24:42 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-0119fbc5-b759-4cd7-a23f-23f099ad887d tempest-TestShelveInstance-649116597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da3f0daa-b757-4721-969a-1fcde6ddfc45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:24:42 devstack cinder-volume[86111]: DEBUG cinder.image.glance [None req-0119fbc5-b759-4cd7-a23f-23f099ad887d tempest-TestShelveInstance-649116597 None] Creating Keystone auth plugin from conf {{(pid=86111) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 29 01:24:42 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-0119fbc5-b759-4cd7-a23f-23f099ad887d tempest-TestShelveInstance-649116597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da3f0daa-b757-4721-969a-1fcde6ddfc45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'fa985749-e6ef-4d1a-9109-e5ee8b6074a3', 'volume_name': 'volume-fa985749-e6ef-4d1a-9109-e5ee8b6074a3', 'volume_size': 1, 'image_id': 'f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8d940113004947258ae710723d273006', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab', 'created_at': datetime.datetime(2026, 8, 28, 23, 3, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 23, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:24:42 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-0119fbc5-b759-4cd7-a23f-23f099ad887d tempest-TestShelveInstance-649116597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1e1cdf4-b51f-45e3-8c44-49ad81582325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:24:42 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-0119fbc5-b759-4cd7-a23f-23f099ad887d tempest-TestShelveInstance-649116597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1e1cdf4-b51f-45e3-8c44-49ad81582325) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:24:42 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-0119fbc5-b759-4cd7-a23f-23f099ad887d tempest-TestShelveInstance-649116597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4ff841a-e39c-4d9e-9a4a-c0e280cd6c65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:24:42 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-0119fbc5-b759-4cd7-a23f-23f099ad887d tempest-TestShelveInstance-649116597 None] Volume fa985749-e6ef-4d1a-9109-e5ee8b6074a3: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-fa985749-e6ef-4d1a-9109-e5ee8b6074a3', 'volume_size': 1, 'image_id': 'f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8d940113004947258ae710723d273006', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab', 'created_at': datetime.datetime(2026, 8, 28, 23, 3, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 23, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 29 01:24:42 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-0119fbc5-b759-4cd7-a23f-23f099ad887d tempest-TestShelveInstance-649116597 None] Trying to clone fa985749-e6ef-4d1a-9109-e5ee8b6074a3 from image f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab at location (None, [{'url': 'file:///opt/stack/data/glance/images/f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab', 'metadata': {}}]). {{(pid=86111) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 29 01:24:43 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-2eca90a4-fa17-4d5c-959c-c388bc9645db tempest-TestStampPattern-1898898860 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:24:43 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-2eca90a4-fa17-4d5c-959c-c388bc9645db tempest-TestStampPattern-1898898860 None] Flow 'volume_create_manager' (f870a6b5-50bb-4922-a9a7-6b44ca3187e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:24:43 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-2eca90a4-fa17-4d5c-959c-c388bc9645db tempest-TestStampPattern-1898898860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46ceeb2b-84c6-4653-b839-8a31c603ce0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:24:43 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-2eca90a4-fa17-4d5c-959c-c388bc9645db tempest-TestStampPattern-1898898860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46ceeb2b-84c6-4653-b839-8a31c603ce0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:24:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-395824549',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62dbe5e4-d990-45e8-a189-d8953e058264,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9a6f405a6854efb85515fe4ec3ab9b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:24:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:24:43Z,use_quota=True,user_id='5c60e882263f4592ac4bd78929f6d75d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:24:43 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-2eca90a4-fa17-4d5c-959c-c388bc9645db tempest-TestStampPattern-1898898860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bce963a-fe5e-44d5-bb1a-2b5ec49b0222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:24:43 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-2eca90a4-fa17-4d5c-959c-c388bc9645db tempest-TestStampPattern-1898898860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bce963a-fe5e-44d5-bb1a-2b5ec49b0222) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:24:43 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-2eca90a4-fa17-4d5c-959c-c388bc9645db tempest-TestStampPattern-1898898860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c78bf85-9dbb-4ea2-aba4-7f384a6c01c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:24:43 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-2eca90a4-fa17-4d5c-959c-c388bc9645db tempest-TestStampPattern-1898898860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c78bf85-9dbb-4ea2-aba4-7f384a6c01c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62dbe5e4-d990-45e8-a189-d8953e058264', 'volume_name': 'volume-62dbe5e4-d990-45e8-a189-d8953e058264', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:24:43 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-2eca90a4-fa17-4d5c-959c-c388bc9645db tempest-TestStampPattern-1898898860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c4d0867-0c47-4d96-bd83-584dfeadaf4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:24:43 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-2eca90a4-fa17-4d5c-959c-c388bc9645db tempest-TestStampPattern-1898898860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c4d0867-0c47-4d96-bd83-584dfeadaf4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:24:43 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-2eca90a4-fa17-4d5c-959c-c388bc9645db tempest-TestStampPattern-1898898860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ba64de6-d5ab-4f3a-8767-50b5e9ad6817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:24:43 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-2eca90a4-fa17-4d5c-959c-c388bc9645db tempest-TestStampPattern-1898898860 None] Volume 62dbe5e4-d990-45e8-a189-d8953e058264: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62dbe5e4-d990-45e8-a189-d8953e058264', 'volume_size': 1} Aug 29 01:24:43 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-2eca90a4-fa17-4d5c-959c-c388bc9645db tempest-TestStampPattern-1898898860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:24:43 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-2eca90a4-fa17-4d5c-959c-c388bc9645db tempest-TestStampPattern-1898898860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:24:43 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-2eca90a4-fa17-4d5c-959c-c388bc9645db tempest-TestStampPattern-1898898860 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:24:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-395824549',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62dbe5e4-d990-45e8-a189-d8953e058264,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9a6f405a6854efb85515fe4ec3ab9b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:24:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:24:43Z,use_quota=True,user_id='5c60e882263f4592ac4bd78929f6d75d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:24:43 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-2eca90a4-fa17-4d5c-959c-c388bc9645db tempest-TestStampPattern-1898898860 None] Creating volume 62dbe5e4-d990-45e8-a189-d8953e058264 {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:24:43 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-2eca90a4-fa17-4d5c-959c-c388bc9645db tempest-TestStampPattern-1898898860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:24:43 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-2eca90a4-fa17-4d5c-959c-c388bc9645db tempest-TestStampPattern-1898898860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:24:43 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-2eca90a4-fa17-4d5c-959c-c388bc9645db tempest-TestStampPattern-1898898860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:24:43 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-2eca90a4-fa17-4d5c-959c-c388bc9645db tempest-TestStampPattern-1898898860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:24:43 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-2eca90a4-fa17-4d5c-959c-c388bc9645db tempest-TestStampPattern-1898898860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:24:43 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-2eca90a4-fa17-4d5c-959c-c388bc9645db tempest-TestStampPattern-1898898860 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:24:43 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-2eca90a4-fa17-4d5c-959c-c388bc9645db tempest-TestStampPattern-1898898860 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:24:43 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-2eca90a4-fa17-4d5c-959c-c388bc9645db tempest-TestStampPattern-1898898860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-62dbe5e4-d990-45e8-a189-d8953e058264 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:24:43 devstack sudo[101362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-62dbe5e4-d990-45e8-a189-d8953e058264 1073741824 Aug 29 01:24:43 devstack sudo[101362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:24:43 devstack cinder-volume[86111]: DEBUG cinder.image.image_utils [None req-0119fbc5-b759-4cd7-a23f-23f099ad887d tempest-TestShelveInstance-649116597 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab_o_v11v13devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86111) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 29 01:24:43 devstack cinder-volume[86111]: INFO cinder.image.image_utils [None req-0119fbc5-b759-4cd7-a23f-23f099ad887d tempest-TestShelveInstance-649116597 None] Image download 20.69 MB at 20.69 MB/s Aug 29 01:24:43 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[f225dd31-0532-464c-9264-f00d20136e0b]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:24:43 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-0119fbc5-b759-4cd7-a23f-23f099ad887d tempest-TestShelveInstance-649116597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab_o_v11v13devstack@QuobyteHD {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:24:43 devstack sudo[101364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab_o_v11v13devstack@QuobyteHD Aug 29 01:24:43 devstack sudo[101364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:24:43 devstack sudo[101364]: pam_unix(sudo:session): session closed for user root Aug 29 01:24:43 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-0119fbc5-b759-4cd7-a23f-23f099ad887d tempest-TestShelveInstance-649116597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab_o_v11v13devstack@QuobyteHD" returned: 0 in 0.405s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:24:43 devstack cinder-volume[86111]: DEBUG cinder.image.image_utils [None req-0119fbc5-b759-4cd7-a23f-23f099ad887d tempest-TestShelveInstance-649116597 None] Temporary image f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab is fetched for user 8eb88332a1614bc5a6316400b2818507. {{(pid=86111) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 29 01:24:43 devstack sudo[101362]: pam_unix(sudo:session): session closed for user root Aug 29 01:24:43 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-2eca90a4-fa17-4d5c-959c-c388bc9645db tempest-TestStampPattern-1898898860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-62dbe5e4-d990-45e8-a189-d8953e058264 1073741824" returned: 0 in 0.583s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:24:43 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-2eca90a4-fa17-4d5c-959c-c388bc9645db tempest-TestStampPattern-1898898860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-62dbe5e4-d990-45e8-a189-d8953e058264 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:24:43 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3bb0ef3-3da5-4938-bfd6-a450189bcd00]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:24:43 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-0119fbc5-b759-4cd7-a23f-23f099ad887d tempest-TestShelveInstance-649116597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab_o_v11v13devstack@QuobyteHD {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:24:44 devstack sudo[101373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-62dbe5e4-d990-45e8-a189-d8953e058264 Aug 29 01:24:44 devstack sudo[101373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:24:44 devstack sudo[101374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab_o_v11v13devstack@QuobyteHD Aug 29 01:24:44 devstack sudo[101374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:24:44 devstack sudo[101373]: pam_unix(sudo:session): session closed for user root Aug 29 01:24:44 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-2eca90a4-fa17-4d5c-959c-c388bc9645db tempest-TestStampPattern-1898898860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-62dbe5e4-d990-45e8-a189-d8953e058264" returned: 0 in 0.314s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:24:44 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-2eca90a4-fa17-4d5c-959c-c388bc9645db tempest-TestStampPattern-1898898860 None] <== create_volume: return (976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:24:44 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-2eca90a4-fa17-4d5c-959c-c388bc9645db tempest-TestStampPattern-1898898860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.984s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:24:44 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-2eca90a4-fa17-4d5c-959c-c388bc9645db tempest-TestStampPattern-1898898860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ba64de6-d5ab-4f3a-8767-50b5e9ad6817) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62dbe5e4-d990-45e8-a189-d8953e058264', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:24:44 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-2eca90a4-fa17-4d5c-959c-c388bc9645db tempest-TestStampPattern-1898898860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cce2868-89de-4b97-bbd7-e3910c697e87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:24:44 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-2eca90a4-fa17-4d5c-959c-c388bc9645db tempest-TestStampPattern-1898898860 None] Volume volume-62dbe5e4-d990-45e8-a189-d8953e058264 (62dbe5e4-d990-45e8-a189-d8953e058264): created successfully Aug 29 01:24:44 devstack sudo[101374]: pam_unix(sudo:session): session closed for user root Aug 29 01:24:44 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-2eca90a4-fa17-4d5c-959c-c388bc9645db tempest-TestStampPattern-1898898860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cce2868-89de-4b97-bbd7-e3910c697e87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:24:44 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-2eca90a4-fa17-4d5c-959c-c388bc9645db tempest-TestStampPattern-1898898860 None] Flow 'volume_create_manager' (f870a6b5-50bb-4922-a9a7-6b44ca3187e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:24:44 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-0119fbc5-b759-4cd7-a23f-23f099ad887d tempest-TestShelveInstance-649116597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab_o_v11v13devstack@QuobyteHD" returned: 0 in 0.375s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:24:44 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-0119fbc5-b759-4cd7-a23f-23f099ad887d tempest-TestShelveInstance-649116597 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:24:44 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-0119fbc5-b759-4cd7-a23f-23f099ad887d tempest-TestShelveInstance-649116597 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:24:44 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-0119fbc5-b759-4cd7-a23f-23f099ad887d tempest-TestShelveInstance-649116597 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:24:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1850061115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa985749-e6ef-4d1a-9109-e5ee8b6074a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b1b8ed4011e47c1b021e49bcb0246e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:24:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:24:42Z,use_quota=True,user_id='8eb88332a1614bc5a6316400b2818507',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:24:44 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-0119fbc5-b759-4cd7-a23f-23f099ad887d tempest-TestShelveInstance-649116597 None] Creating volume fa985749-e6ef-4d1a-9109-e5ee8b6074a3 {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:24:44 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-0119fbc5-b759-4cd7-a23f-23f099ad887d tempest-TestShelveInstance-649116597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:24:44 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-0119fbc5-b759-4cd7-a23f-23f099ad887d tempest-TestShelveInstance-649116597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:24:44 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-0119fbc5-b759-4cd7-a23f-23f099ad887d tempest-TestShelveInstance-649116597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:24:44 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-0119fbc5-b759-4cd7-a23f-23f099ad887d tempest-TestShelveInstance-649116597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:24:44 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-0119fbc5-b759-4cd7-a23f-23f099ad887d tempest-TestShelveInstance-649116597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:24:44 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-0119fbc5-b759-4cd7-a23f-23f099ad887d tempest-TestShelveInstance-649116597 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:24:44 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-0119fbc5-b759-4cd7-a23f-23f099ad887d tempest-TestShelveInstance-649116597 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:24:44 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-0119fbc5-b759-4cd7-a23f-23f099ad887d tempest-TestShelveInstance-649116597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-fa985749-e6ef-4d1a-9109-e5ee8b6074a3 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:24:44 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-2eca90a4-fa17-4d5c-959c-c388bc9645db tempest-TestStampPattern-1898898860 None] Created volume successfully. Aug 29 01:24:44 devstack sudo[101381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-fa985749-e6ef-4d1a-9109-e5ee8b6074a3 1073741824 Aug 29 01:24:44 devstack sudo[101381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:24:44 devstack sudo[101381]: pam_unix(sudo:session): session closed for user root Aug 29 01:24:44 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-0119fbc5-b759-4cd7-a23f-23f099ad887d tempest-TestShelveInstance-649116597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-fa985749-e6ef-4d1a-9109-e5ee8b6074a3 1073741824" returned: 0 in 0.597s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:24:45 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-0119fbc5-b759-4cd7-a23f-23f099ad887d tempest-TestShelveInstance-649116597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-fa985749-e6ef-4d1a-9109-e5ee8b6074a3 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:24:45 devstack sudo[101390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-fa985749-e6ef-4d1a-9109-e5ee8b6074a3 Aug 29 01:24:45 devstack sudo[101390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:24:45 devstack sudo[101390]: pam_unix(sudo:session): session closed for user root Aug 29 01:24:45 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-0119fbc5-b759-4cd7-a23f-23f099ad887d tempest-TestShelveInstance-649116597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-fa985749-e6ef-4d1a-9109-e5ee8b6074a3" returned: 0 in 0.303s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:24:45 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-0119fbc5-b759-4cd7-a23f-23f099ad887d tempest-TestShelveInstance-649116597 None] <== create_volume: return (955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:24:45 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-0119fbc5-b759-4cd7-a23f-23f099ad887d tempest-TestShelveInstance-649116597 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.959s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:24:45 devstack cinder-volume[86111]: DEBUG cinder.volume.volume_utils [None req-0119fbc5-b759-4cd7-a23f-23f099ad887d tempest-TestShelveInstance-649116597 None] Attempting download of f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab ((None, [{'url': 'file:///opt/stack/data/glance/images/f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab', 'metadata': {}}])) to volume fa985749-e6ef-4d1a-9109-e5ee8b6074a3. {{(pid=86111) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 29 01:24:45 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[04e8bb8f-a34e-46fd-9762-14c8a4c2e83b]: (4, 'raw') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:24:45 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-0119fbc5-b759-4cd7-a23f-23f099ad887d tempest-TestShelveInstance-649116597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab_b7ee55sv {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:24:45 devstack sudo[101393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab_b7ee55sv Aug 29 01:24:45 devstack sudo[101393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:24:45 devstack sudo[101393]: pam_unix(sudo:session): session closed for user root Aug 29 01:24:45 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-0119fbc5-b759-4cd7-a23f-23f099ad887d tempest-TestShelveInstance-649116597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab_b7ee55sv" returned: 0 in 0.355s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:24:45 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-0119fbc5-b759-4cd7-a23f-23f099ad887d tempest-TestShelveInstance-649116597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab_b7ee55sv {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:24:45 devstack sudo[101397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab_b7ee55sv Aug 29 01:24:45 devstack sudo[101397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:24:46 devstack sudo[101397]: pam_unix(sudo:session): session closed for user root Aug 29 01:24:46 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-0119fbc5-b759-4cd7-a23f-23f099ad887d tempest-TestShelveInstance-649116597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab_b7ee55sv" returned: 1 in 0.330s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:24:46 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-0119fbc5-b759-4cd7-a23f-23f099ad887d tempest-TestShelveInstance-649116597 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab_b7ee55sv' failed. Not Retrying. {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 29 01:24:46 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[02966b87-370e-4d29-aee5-9e10a64e8282]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:24:46 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-0119fbc5-b759-4cd7-a23f-23f099ad887d tempest-TestShelveInstance-649116597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab_o_v11v13devstack@QuobyteHD {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:24:46 devstack sudo[101401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab_o_v11v13devstack@QuobyteHD Aug 29 01:24:46 devstack sudo[101401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:24:46 devstack sudo[101401]: pam_unix(sudo:session): session closed for user root Aug 29 01:24:46 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-0119fbc5-b759-4cd7-a23f-23f099ad887d tempest-TestShelveInstance-649116597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab_o_v11v13devstack@QuobyteHD" returned: 0 in 0.403s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:24:46 devstack cinder-volume[86111]: DEBUG cinder.image.image_utils [None req-0119fbc5-b759-4cd7-a23f-23f099ad887d tempest-TestShelveInstance-649116597 None] f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab was qcow2, converting to qcow2 {{(pid=86111) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 29 01:24:46 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-0119fbc5-b759-4cd7-a23f-23f099ad887d tempest-TestShelveInstance-649116597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab_o_v11v13devstack@QuobyteHD /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-fa985749-e6ef-4d1a-9109-e5ee8b6074a3 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:24:46 devstack sudo[101410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab_o_v11v13devstack@QuobyteHD /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-fa985749-e6ef-4d1a-9109-e5ee8b6074a3 Aug 29 01:24:46 devstack sudo[101410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:24:48 devstack sudo[101410]: pam_unix(sudo:session): session closed for user root Aug 29 01:24:48 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-0119fbc5-b759-4cd7-a23f-23f099ad887d tempest-TestShelveInstance-649116597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab_o_v11v13devstack@QuobyteHD /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-fa985749-e6ef-4d1a-9109-e5ee8b6074a3" returned: 0 in 1.863s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:24:48 devstack cinder-volume[86111]: DEBUG cinder.image.image_utils [None req-0119fbc5-b759-4cd7-a23f-23f099ad887d tempest-TestShelveInstance-649116597 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab_o_v11v13devstack@QuobyteHD, size 112.00 MB, duration 1.86 sec, destination /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-fa985749-e6ef-4d1a-9109-e5ee8b6074a3 {{(pid=86111) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 29 01:24:48 devstack cinder-volume[86111]: INFO cinder.image.image_utils [None req-0119fbc5-b759-4cd7-a23f-23f099ad887d tempest-TestShelveInstance-649116597 None] Converted 112.00 MB image at 60.07 MB/s Aug 29 01:24:48 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-0119fbc5-b759-4cd7-a23f-23f099ad887d tempest-TestShelveInstance-649116597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-fa985749-e6ef-4d1a-9109-e5ee8b6074a3 1G {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:24:48 devstack sudo[101429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-fa985749-e6ef-4d1a-9109-e5ee8b6074a3 1G Aug 29 01:24:48 devstack sudo[101429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:24:48 devstack sudo[101429]: pam_unix(sudo:session): session closed for user root Aug 29 01:24:48 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-0119fbc5-b759-4cd7-a23f-23f099ad887d tempest-TestShelveInstance-649116597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-fa985749-e6ef-4d1a-9109-e5ee8b6074a3 1G" returned: 0 in 0.369s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:24:48 devstack cinder-volume[86111]: DEBUG cinder.volume.volume_utils [None req-0119fbc5-b759-4cd7-a23f-23f099ad887d tempest-TestShelveInstance-649116597 None] Downloaded image f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab ((None, [{'url': 'file:///opt/stack/data/glance/images/f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab', 'metadata': {}}])) to volume fa985749-e6ef-4d1a-9109-e5ee8b6074a3 successfully. {{(pid=86111) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 29 01:24:48 devstack cinder-volume[86111]: DEBUG cinder.image.image_utils [None req-0119fbc5-b759-4cd7-a23f-23f099ad887d tempest-TestShelveInstance-649116597 None] Temporary image f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab for user 8eb88332a1614bc5a6316400b2818507 is deleted. {{(pid=86111) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 29 01:24:48 devstack cinder-volume[86111]: DEBUG cinder.volume.volume_utils [None req-0119fbc5-b759-4cd7-a23f-23f099ad887d tempest-TestShelveInstance-649116597 None] Marking volume fa985749-e6ef-4d1a-9109-e5ee8b6074a3 as bootable. {{(pid=86111) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 29 01:24:48 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-0119fbc5-b759-4cd7-a23f-23f099ad887d tempest-TestShelveInstance-649116597 None] Copying metadata from image f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab to fa985749-e6ef-4d1a-9109-e5ee8b6074a3. {{(pid=86111) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 29 01:24:48 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-0119fbc5-b759-4cd7-a23f-23f099ad887d tempest-TestShelveInstance-649116597 None] Creating volume glance metadata for volume fa985749-e6ef-4d1a-9109-e5ee8b6074a3 backed by image f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86111) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 29 01:24:48 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-0119fbc5-b759-4cd7-a23f-23f099ad887d tempest-TestShelveInstance-649116597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4ff841a-e39c-4d9e-9a4a-c0e280cd6c65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa985749-e6ef-4d1a-9109-e5ee8b6074a3', 'volume_size': 1, 'image_id': 'f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8d940113004947258ae710723d273006', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab', 'created_at': datetime.datetime(2026, 8, 28, 23, 3, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 23, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f6d51064-aea8-4cf4-b7f7-80b3fad8f9ab/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:24:48 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-0119fbc5-b759-4cd7-a23f-23f099ad887d tempest-TestShelveInstance-649116597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3436d9de-f62b-4097-b261-8991b1364589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:24:48 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-0119fbc5-b759-4cd7-a23f-23f099ad887d tempest-TestShelveInstance-649116597 None] Volume volume-fa985749-e6ef-4d1a-9109-e5ee8b6074a3 (fa985749-e6ef-4d1a-9109-e5ee8b6074a3): created successfully Aug 29 01:24:48 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-0119fbc5-b759-4cd7-a23f-23f099ad887d tempest-TestShelveInstance-649116597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3436d9de-f62b-4097-b261-8991b1364589) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:24:48 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-0119fbc5-b759-4cd7-a23f-23f099ad887d tempest-TestShelveInstance-649116597 None] Flow 'volume_create_manager' (6f19f87b-9068-468b-8484-3b81a6bfe773) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:24:48 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-0119fbc5-b759-4cd7-a23f-23f099ad887d tempest-TestShelveInstance-649116597 None] Created volume successfully. Aug 29 01:24:52 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [req-719e3ffc-fb74-4fb9-9d3a-88e4646efd5c req-0ee4e26a-9f97-424b-a4e1-40b0d591d613 tempest-TestShelveInstance-649116597 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:24:52 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [req-719e3ffc-fb74-4fb9-9d3a-88e4646efd5c req-0ee4e26a-9f97-424b-a4e1-40b0d591d613 tempest-TestShelveInstance-649116597 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:24:52 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [req-719e3ffc-fb74-4fb9-9d3a-88e4646efd5c req-0ee4e26a-9f97-424b-a4e1-40b0d591d613 tempest-TestShelveInstance-649116597 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.029s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:24:52 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [req-719e3ffc-fb74-4fb9-9d3a-88e4646efd5c req-0ee4e26a-9f97-424b-a4e1-40b0d591d613 tempest-TestShelveInstance-649116597 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630', 'name': 'volume-fa985749-e6ef-4d1a-9109-e5ee8b6074a3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c0c9b725-7a7a-48bc-a005-7c9d6a0d5b1c', 'enforce_multipath': True} {{(pid=86111) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 29 01:24:52 devstack cinder-volume[86111]: INFO cinder.volume.manager [req-719e3ffc-fb74-4fb9-9d3a-88e4646efd5c req-0ee4e26a-9f97-424b-a4e1-40b0d591d613 tempest-TestShelveInstance-649116597 None] attachment_update completed successfully. Aug 29 01:25:02 devstack cinder-volume[86111]: DEBUG dbcounter [-] [86111] Writing DB stats cinder:SELECT=9,cinder:UPDATE=12,cinder:INSERT=10,cinder:DELETE=1 {{(pid=86111) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 29 01:25:02 devstack cinder-volume[86111]: DEBUG dbcounter [-] [86111] Writing DB stats cinder:SELECT=28,cinder:UPDATE=7,cinder:INSERT=5,cinder:DELETE=1 {{(pid=86111) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 29 01:25:15 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [req-d3653434-e703-42a4-8751-fdd70150663e req-e794de3e-7c4e-4450-915c-f09970fb7cd2 tempest-TestStampPattern-1898898860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:25:15 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [req-d3653434-e703-42a4-8751-fdd70150663e req-e794de3e-7c4e-4450-915c-f09970fb7cd2 tempest-TestStampPattern-1898898860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:25:15 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [req-d3653434-e703-42a4-8751-fdd70150663e req-e794de3e-7c4e-4450-915c-f09970fb7cd2 tempest-TestStampPattern-1898898860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:25:15 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [req-d3653434-e703-42a4-8751-fdd70150663e req-e794de3e-7c4e-4450-915c-f09970fb7cd2 tempest-TestStampPattern-1898898860 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630', 'name': 'volume-62dbe5e4-d990-45e8-a189-d8953e058264', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8d0e17f8-9218-4091-ae2b-9781b28eb840', 'enforce_multipath': True} {{(pid=86111) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 29 01:25:15 devstack cinder-volume[86111]: INFO cinder.volume.manager [req-d3653434-e703-42a4-8751-fdd70150663e req-e794de3e-7c4e-4450-915c-f09970fb7cd2 tempest-TestStampPattern-1898898860 None] attachment_update completed successfully. Aug 29 01:25:19 devstack cinder-volume[86111]: INFO cinder.volume.manager [req-b65f7e4b-36f2-401f-a1ed-aea796688766 req-4204b5d8-dee5-447e-b651-d712a8c6f9f1 tempest-TestStampPattern-1898898860 None] Terminate volume connection completed successfully. Aug 29 01:25:19 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [req-b65f7e4b-36f2-401f-a1ed-aea796688766 req-4204b5d8-dee5-447e-b651-d712a8c6f9f1 tempest-TestStampPattern-1898898860 None] Deleting attachment 8d0e17f8-9218-4091-ae2b-9781b28eb840. {{(pid=86111) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 29 01:25:20 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-d2a62746-383f-4557-86ee-376f862d292e tempest-TestStampPattern-1898898860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:25:20 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-d2a62746-383f-4557-86ee-376f862d292e tempest-TestStampPattern-1898898860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:25:20 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-d2a62746-383f-4557-86ee-376f862d292e tempest-TestStampPattern-1898898860 None] Creating offline snapshot 72c82354-11d8-4731-9c12-d794cec2ee18 of volume 62dbe5e4-d990-45e8-a189-d8953e058264 {{(pid=86111) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 29 01:25:20 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[523ee4fa-b004-4a85-820f-4fb3d751b9b3]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:25:20 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d2a62746-383f-4557-86ee-376f862d292e tempest-TestStampPattern-1898898860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-62dbe5e4-d990-45e8-a189-d8953e058264 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:25:20 devstack sudo[102489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-62dbe5e4-d990-45e8-a189-d8953e058264 Aug 29 01:25:20 devstack sudo[102489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:25:20 devstack sudo[102489]: pam_unix(sudo:session): session closed for user root Aug 29 01:25:20 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d2a62746-383f-4557-86ee-376f862d292e tempest-TestStampPattern-1898898860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-62dbe5e4-d990-45e8-a189-d8953e058264" returned: 0 in 0.380s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:25:20 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d2a62746-383f-4557-86ee-376f862d292e tempest-TestStampPattern-1898898860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-62dbe5e4-d990-45e8-a189-d8953e058264,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-62dbe5e4-d990-45e8-a189-d8953e058264.72c82354-11d8-4731-9c12-d794cec2ee18 1G {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:25:20 devstack sudo[102494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-62dbe5e4-d990-45e8-a189-d8953e058264,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-62dbe5e4-d990-45e8-a189-d8953e058264.72c82354-11d8-4731-9c12-d794cec2ee18 1G Aug 29 01:25:20 devstack sudo[102494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:25:21 devstack sudo[102494]: pam_unix(sudo:session): session closed for user root Aug 29 01:25:21 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d2a62746-383f-4557-86ee-376f862d292e tempest-TestStampPattern-1898898860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-62dbe5e4-d990-45e8-a189-d8953e058264,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-62dbe5e4-d990-45e8-a189-d8953e058264.72c82354-11d8-4731-9c12-d794cec2ee18 1G" returned: 0 in 0.397s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:25:21 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d2a62746-383f-4557-86ee-376f862d292e tempest-TestStampPattern-1898898860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62dbe5e4-d990-45e8-a189-d8953e058264 -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-62dbe5e4-d990-45e8-a189-d8953e058264.72c82354-11d8-4731-9c12-d794cec2ee18 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:25:21 devstack sudo[102499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62dbe5e4-d990-45e8-a189-d8953e058264 -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-62dbe5e4-d990-45e8-a189-d8953e058264.72c82354-11d8-4731-9c12-d794cec2ee18 Aug 29 01:25:21 devstack sudo[102499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:25:21 devstack sudo[102499]: pam_unix(sudo:session): session closed for user root Aug 29 01:25:21 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d2a62746-383f-4557-86ee-376f862d292e tempest-TestStampPattern-1898898860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62dbe5e4-d990-45e8-a189-d8953e058264 -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-62dbe5e4-d990-45e8-a189-d8953e058264.72c82354-11d8-4731-9c12-d794cec2ee18" returned: 0 in 0.304s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:25:21 devstack cinder-volume[86111]: WARNING cinder.volume.drivers.remotefs [None req-d2a62746-383f-4557-86ee-376f862d292e tempest-TestStampPattern-1898898860 None] /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-62dbe5e4-d990-45e8-a189-d8953e058264.72c82354-11d8-4731-9c12-d794cec2ee18 is being set with open permissions: ugo+rw Aug 29 01:25:21 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d2a62746-383f-4557-86ee-376f862d292e tempest-TestStampPattern-1898898860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-62dbe5e4-d990-45e8-a189-d8953e058264.72c82354-11d8-4731-9c12-d794cec2ee18 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:25:21 devstack sudo[102504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-62dbe5e4-d990-45e8-a189-d8953e058264.72c82354-11d8-4731-9c12-d794cec2ee18 Aug 29 01:25:21 devstack sudo[102504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:25:21 devstack sudo[102504]: pam_unix(sudo:session): session closed for user root Aug 29 01:25:21 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d2a62746-383f-4557-86ee-376f862d292e tempest-TestStampPattern-1898898860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-62dbe5e4-d990-45e8-a189-d8953e058264.72c82354-11d8-4731-9c12-d794cec2ee18" returned: 0 in 0.278s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:25:21 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d2a62746-383f-4557-86ee-376f862d292e tempest-TestStampPattern-1898898860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-62dbe5e4-d990-45e8-a189-d8953e058264.info {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:25:21 devstack sudo[102510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-62dbe5e4-d990-45e8-a189-d8953e058264.info Aug 29 01:25:21 devstack sudo[102510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:25:21 devstack sudo[102510]: pam_unix(sudo:session): session closed for user root Aug 29 01:25:21 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d2a62746-383f-4557-86ee-376f862d292e tempest-TestStampPattern-1898898860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-62dbe5e4-d990-45e8-a189-d8953e058264.info" returned: 0 in 0.272s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:25:21 devstack cinder-volume[86111]: WARNING cinder.volume.drivers.remotefs [None req-d2a62746-383f-4557-86ee-376f862d292e tempest-TestStampPattern-1898898860 None] /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-62dbe5e4-d990-45e8-a189-d8953e058264.info is being set with open permissions: ugo+rw Aug 29 01:25:21 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d2a62746-383f-4557-86ee-376f862d292e tempest-TestStampPattern-1898898860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-62dbe5e4-d990-45e8-a189-d8953e058264.info {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:25:21 devstack sudo[102527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-62dbe5e4-d990-45e8-a189-d8953e058264.info Aug 29 01:25:21 devstack sudo[102527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:25:22 devstack sudo[102527]: pam_unix(sudo:session): session closed for user root Aug 29 01:25:22 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d2a62746-383f-4557-86ee-376f862d292e tempest-TestStampPattern-1898898860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-62dbe5e4-d990-45e8-a189-d8953e058264.info" returned: 0 in 0.266s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:25:22 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-d2a62746-383f-4557-86ee-376f862d292e tempest-TestStampPattern-1898898860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.010s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:25:22 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-d2a62746-383f-4557-86ee-376f862d292e tempest-TestStampPattern-1898898860 None] Create snapshot completed successfully Aug 29 01:25:24 devstack cinder-volume[86111]: INFO cinder.volume.manager [req-4be25b54-7d1d-444f-86c5-80486de6fa78 req-daa46ba6-4dbd-4a74-9b78-d42b4f93922c tempest-TestShelveInstance-649116597 None] Terminate volume connection completed successfully. Aug 29 01:25:24 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [req-4be25b54-7d1d-444f-86c5-80486de6fa78 req-daa46ba6-4dbd-4a74-9b78-d42b4f93922c tempest-TestShelveInstance-649116597 None] Deleting attachment c0c9b725-7a7a-48bc-a005-7c9d6a0d5b1c. {{(pid=86111) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 29 01:25:26 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [req-e6ccab79-c688-4727-9d06-a69bba7ae513 req-5c80e12a-e1e8-4480-8085-c6d3a60ca8b1 tempest-TestShelveInstance-649116597 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:25:26 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [req-e6ccab79-c688-4727-9d06-a69bba7ae513 req-5c80e12a-e1e8-4480-8085-c6d3a60ca8b1 tempest-TestShelveInstance-649116597 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:25:26 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [req-e6ccab79-c688-4727-9d06-a69bba7ae513 req-5c80e12a-e1e8-4480-8085-c6d3a60ca8b1 tempest-TestShelveInstance-649116597 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:25:26 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [req-e6ccab79-c688-4727-9d06-a69bba7ae513 req-5c80e12a-e1e8-4480-8085-c6d3a60ca8b1 tempest-TestShelveInstance-649116597 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630', 'name': 'volume-fa985749-e6ef-4d1a-9109-e5ee8b6074a3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '07991d72-12bb-4930-9075-100b12d5feea', 'enforce_multipath': True} {{(pid=86111) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 29 01:25:26 devstack cinder-volume[86111]: INFO cinder.volume.manager [req-e6ccab79-c688-4727-9d06-a69bba7ae513 req-5c80e12a-e1e8-4480-8085-c6d3a60ca8b1 tempest-TestShelveInstance-649116597 None] attachment_update completed successfully. Aug 29 01:25:30 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e375693-a50a-4ef1-93f8-1b3e9dfeebb7 tempest-TestStampPattern-1898898860 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:25:30 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-9e375693-a50a-4ef1-93f8-1b3e9dfeebb7 tempest-TestStampPattern-1898898860 None] Flow 'volume_create_manager' (f76bab2d-0683-410d-990b-5a277d37fc89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:25:30 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-9e375693-a50a-4ef1-93f8-1b3e9dfeebb7 tempest-TestStampPattern-1898898860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8edb1fa2-6b45-45c7-9d61-b6eb7f796e01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:25:30 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-9e375693-a50a-4ef1-93f8-1b3e9dfeebb7 tempest-TestStampPattern-1898898860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8edb1fa2-6b45-45c7-9d61-b6eb7f796e01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:25:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-889957298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbb88808-57ba-485a-b283-1d127546cab3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9a6f405a6854efb85515fe4ec3ab9b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:25:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=72c82354-11d8-4731-9c12-d794cec2ee18,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:25:31Z,use_quota=True,user_id='5c60e882263f4592ac4bd78929f6d75d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:25:30 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-9e375693-a50a-4ef1-93f8-1b3e9dfeebb7 tempest-TestStampPattern-1898898860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93b2d35b-fd9b-4d79-b5b6-bbf788a071ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:25:30 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-9e375693-a50a-4ef1-93f8-1b3e9dfeebb7 tempest-TestStampPattern-1898898860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93b2d35b-fd9b-4d79-b5b6-bbf788a071ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:25:30 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-9e375693-a50a-4ef1-93f8-1b3e9dfeebb7 tempest-TestStampPattern-1898898860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d97a608-1e07-4e33-86d1-ff6a226d31c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:25:30 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-9e375693-a50a-4ef1-93f8-1b3e9dfeebb7 tempest-TestStampPattern-1898898860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d97a608-1e07-4e33-86d1-ff6a226d31c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'bbb88808-57ba-485a-b283-1d127546cab3', 'volume_name': 'volume-bbb88808-57ba-485a-b283-1d127546cab3', 'volume_size': 1, 'snapshot_id': '72c82354-11d8-4731-9c12-d794cec2ee18'}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:25:30 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-9e375693-a50a-4ef1-93f8-1b3e9dfeebb7 tempest-TestStampPattern-1898898860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aaac6bc5-ce6c-4842-83c7-4648f6d38536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:25:30 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-9e375693-a50a-4ef1-93f8-1b3e9dfeebb7 tempest-TestStampPattern-1898898860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aaac6bc5-ce6c-4842-83c7-4648f6d38536) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:25:30 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-9e375693-a50a-4ef1-93f8-1b3e9dfeebb7 tempest-TestStampPattern-1898898860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ac985de-fea5-4c0f-a41b-1ba7a7124669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:25:30 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-9e375693-a50a-4ef1-93f8-1b3e9dfeebb7 tempest-TestStampPattern-1898898860 None] Volume bbb88808-57ba-485a-b283-1d127546cab3: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-bbb88808-57ba-485a-b283-1d127546cab3', 'volume_size': 1, 'snapshot_id': '72c82354-11d8-4731-9c12-d794cec2ee18'} Aug 29 01:25:30 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-9e375693-a50a-4ef1-93f8-1b3e9dfeebb7 tempest-TestStampPattern-1898898860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:25:30 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-9e375693-a50a-4ef1-93f8-1b3e9dfeebb7 tempest-TestStampPattern-1898898860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:25:30 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-9e375693-a50a-4ef1-93f8-1b3e9dfeebb7 tempest-TestStampPattern-1898898860 None] Acquiring lock "cinder-quobyte-72c82354-11d8-4731-9c12-d794cec2ee18-bbb88808-57ba-485a-b283-1d127546cab3" by "_create_volume_from_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:25:30 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-9e375693-a50a-4ef1-93f8-1b3e9dfeebb7 tempest-TestStampPattern-1898898860 None] Lock "cinder-quobyte-72c82354-11d8-4731-9c12-d794cec2ee18-bbb88808-57ba-485a-b283-1d127546cab3" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:25:30 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-9e375693-a50a-4ef1-93f8-1b3e9dfeebb7 tempest-TestStampPattern-1898898860 None] Creating volume bbb88808-57ba-485a-b283-1d127546cab3 from snapshot 72c82354-11d8-4731-9c12-d794cec2ee18 {{(pid=86111) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Aug 29 01:25:30 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-9e375693-a50a-4ef1-93f8-1b3e9dfeebb7 tempest-TestStampPattern-1898898860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:25:30 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-9e375693-a50a-4ef1-93f8-1b3e9dfeebb7 tempest-TestStampPattern-1898898860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:25:30 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-9e375693-a50a-4ef1-93f8-1b3e9dfeebb7 tempest-TestStampPattern-1898898860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:25:30 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-9e375693-a50a-4ef1-93f8-1b3e9dfeebb7 tempest-TestStampPattern-1898898860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:25:30 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-9e375693-a50a-4ef1-93f8-1b3e9dfeebb7 tempest-TestStampPattern-1898898860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:25:30 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-9e375693-a50a-4ef1-93f8-1b3e9dfeebb7 tempest-TestStampPattern-1898898860 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:25:30 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-9e375693-a50a-4ef1-93f8-1b3e9dfeebb7 tempest-TestStampPattern-1898898860 None] Acquiring lock "cinder-quobyte-bbb88808-57ba-485a-b283-1d127546cab3" by "_copy_volume_from_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:25:31 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-9e375693-a50a-4ef1-93f8-1b3e9dfeebb7 tempest-TestStampPattern-1898898860 None] Lock "cinder-quobyte-bbb88808-57ba-485a-b283-1d127546cab3" acquired by "_copy_volume_from_snapshot" :: waited 0.040s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:25:31 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-9e375693-a50a-4ef1-93f8-1b3e9dfeebb7 tempest-TestStampPattern-1898898860 None] snapshot: 72c82354-11d8-4731-9c12-d794cec2ee18, volume: bbb88808-57ba-485a-b283-1d127546cab3, {{(pid=86111) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 29 01:25:31 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-9e375693-a50a-4ef1-93f8-1b3e9dfeebb7 tempest-TestStampPattern-1898898860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:25:31 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-9e375693-a50a-4ef1-93f8-1b3e9dfeebb7 tempest-TestStampPattern-1898898860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:25:31 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-9e375693-a50a-4ef1-93f8-1b3e9dfeebb7 tempest-TestStampPattern-1898898860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:25:31 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-9e375693-a50a-4ef1-93f8-1b3e9dfeebb7 tempest-TestStampPattern-1898898860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:25:31 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-9e375693-a50a-4ef1-93f8-1b3e9dfeebb7 tempest-TestStampPattern-1898898860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:25:31 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[90487cd0-1eea-452c-85b7-4314d561798a]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:25:31 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-9e375693-a50a-4ef1-93f8-1b3e9dfeebb7 tempest-TestStampPattern-1898898860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-62dbe5e4-d990-45e8-a189-d8953e058264.72c82354-11d8-4731-9c12-d794cec2ee18 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:25:31 devstack sudo[103083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-62dbe5e4-d990-45e8-a189-d8953e058264.72c82354-11d8-4731-9c12-d794cec2ee18 Aug 29 01:25:31 devstack sudo[103083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:25:31 devstack sudo[103083]: pam_unix(sudo:session): session closed for user root Aug 29 01:25:31 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-9e375693-a50a-4ef1-93f8-1b3e9dfeebb7 tempest-TestStampPattern-1898898860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-62dbe5e4-d990-45e8-a189-d8953e058264.72c82354-11d8-4731-9c12-d794cec2ee18" returned: 0 in 0.541s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:25:31 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-9e375693-a50a-4ef1-93f8-1b3e9dfeebb7 tempest-TestStampPattern-1898898860 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-62dbe5e4-d990-45e8-a189-d8953e058264(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 29 01:25:31 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[581cd624-bf9f-4f6f-93ea-cf22c29d9737]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:25:31 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-9e375693-a50a-4ef1-93f8-1b3e9dfeebb7 tempest-TestStampPattern-1898898860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-62dbe5e4-d990-45e8-a189-d8953e058264 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:25:31 devstack sudo[103090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-62dbe5e4-d990-45e8-a189-d8953e058264 Aug 29 01:25:31 devstack sudo[103090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:25:32 devstack sudo[103090]: pam_unix(sudo:session): session closed for user root Aug 29 01:25:32 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-9e375693-a50a-4ef1-93f8-1b3e9dfeebb7 tempest-TestStampPattern-1898898860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-62dbe5e4-d990-45e8-a189-d8953e058264" returned: 0 in 0.580s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:25:32 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-9e375693-a50a-4ef1-93f8-1b3e9dfeebb7 tempest-TestStampPattern-1898898860 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-62dbe5e4-d990-45e8-a189-d8953e058264 {{(pid=86111) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 29 01:25:32 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-9e375693-a50a-4ef1-93f8-1b3e9dfeebb7 tempest-TestStampPattern-1898898860 None] Creating direct copy from snapshot {{(pid=86111) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 29 01:25:32 devstack cinder-volume[86111]: DEBUG cinder.utils [None req-9e375693-a50a-4ef1-93f8-1b3e9dfeebb7 tempest-TestStampPattern-1898898860 None] Path /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-bbb88808-57ba-485a-b283-1d127546cab3 not found in is_blk_device check {{(pid=86111) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 29 01:25:32 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-9e375693-a50a-4ef1-93f8-1b3e9dfeebb7 tempest-TestStampPattern-1898898860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-62dbe5e4-d990-45e8-a189-d8953e058264 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-bbb88808-57ba-485a-b283-1d127546cab3 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:25:32 devstack sudo[103098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-62dbe5e4-d990-45e8-a189-d8953e058264 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-bbb88808-57ba-485a-b283-1d127546cab3 Aug 29 01:25:32 devstack sudo[103098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:25:40 devstack sudo[103098]: pam_unix(sudo:session): session closed for user root Aug 29 01:25:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-9e375693-a50a-4ef1-93f8-1b3e9dfeebb7 tempest-TestStampPattern-1898898860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-62dbe5e4-d990-45e8-a189-d8953e058264 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-bbb88808-57ba-485a-b283-1d127546cab3" returned: 0 in 8.020s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:25:40 devstack cinder-volume[86111]: DEBUG cinder.image.image_utils [None req-9e375693-a50a-4ef1-93f8-1b3e9dfeebb7 tempest-TestStampPattern-1898898860 None] Image conversion details: src /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-62dbe5e4-d990-45e8-a189-d8953e058264, size 1024.00 MB, duration 8.02 sec, destination /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-bbb88808-57ba-485a-b283-1d127546cab3 {{(pid=86111) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 29 01:25:40 devstack cinder-volume[86111]: INFO cinder.image.image_utils [None req-9e375693-a50a-4ef1-93f8-1b3e9dfeebb7 tempest-TestStampPattern-1898898860 None] Converted 1024.00 MB image at 127.67 MB/s Aug 29 01:25:40 devstack cinder-volume[86111]: WARNING cinder.volume.drivers.remotefs [None req-9e375693-a50a-4ef1-93f8-1b3e9dfeebb7 tempest-TestStampPattern-1898898860 None] /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-bbb88808-57ba-485a-b283-1d127546cab3 is being set with open permissions: ugo+rw Aug 29 01:25:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-9e375693-a50a-4ef1-93f8-1b3e9dfeebb7 tempest-TestStampPattern-1898898860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-bbb88808-57ba-485a-b283-1d127546cab3 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:25:40 devstack sudo[103123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-bbb88808-57ba-485a-b283-1d127546cab3 Aug 29 01:25:40 devstack sudo[103123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:25:40 devstack sudo[103123]: pam_unix(sudo:session): session closed for user root Aug 29 01:25:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-9e375693-a50a-4ef1-93f8-1b3e9dfeebb7 tempest-TestStampPattern-1898898860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-bbb88808-57ba-485a-b283-1d127546cab3" returned: 0 in 0.402s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:25:40 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-9e375693-a50a-4ef1-93f8-1b3e9dfeebb7 tempest-TestStampPattern-1898898860 None] Lock "cinder-quobyte-bbb88808-57ba-485a-b283-1d127546cab3" released by "_copy_volume_from_snapshot" :: held 9.730s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:25:40 devstack cinder-volume[86111]: DEBUG oslo_service.periodic_task [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86111) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 29 01:25:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:25:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:25:40 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:25:40 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:25:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:25:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:25:40 devstack sudo[103130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:25:40 devstack sudo[103130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:25:40 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-9e375693-a50a-4ef1-93f8-1b3e9dfeebb7 tempest-TestStampPattern-1898898860 None] Lock "cinder-quobyte-72c82354-11d8-4731-9c12-d794cec2ee18-bbb88808-57ba-485a-b283-1d127546cab3" released by "_create_volume_from_snapshot" :: held 9.919s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:25:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-9e375693-a50a-4ef1-93f8-1b3e9dfeebb7 tempest-TestStampPattern-1898898860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.947s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:25:40 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-9e375693-a50a-4ef1-93f8-1b3e9dfeebb7 tempest-TestStampPattern-1898898860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ac985de-fea5-4c0f-a41b-1ba7a7124669) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bbb88808-57ba-485a-b283-1d127546cab3', 'volume_size': 1, 'snapshot_id': '72c82354-11d8-4731-9c12-d794cec2ee18'}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:25:40 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-9e375693-a50a-4ef1-93f8-1b3e9dfeebb7 tempest-TestStampPattern-1898898860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ae3cb68-6bd0-41fc-95e2-04065eae8306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:25:40 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-9e375693-a50a-4ef1-93f8-1b3e9dfeebb7 tempest-TestStampPattern-1898898860 None] Volume volume-bbb88808-57ba-485a-b283-1d127546cab3 (bbb88808-57ba-485a-b283-1d127546cab3): created successfully Aug 29 01:25:40 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-9e375693-a50a-4ef1-93f8-1b3e9dfeebb7 tempest-TestStampPattern-1898898860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ae3cb68-6bd0-41fc-95e2-04065eae8306) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:25:40 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-9e375693-a50a-4ef1-93f8-1b3e9dfeebb7 tempest-TestStampPattern-1898898860 None] Flow 'volume_create_manager' (f76bab2d-0683-410d-990b-5a277d37fc89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:25:41 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-9e375693-a50a-4ef1-93f8-1b3e9dfeebb7 tempest-TestStampPattern-1898898860 None] Created volume successfully. Aug 29 01:25:41 devstack sudo[103130]: pam_unix(sudo:session): session closed for user root Aug 29 01:25:41 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-de752545-d617-440e-8362-d04fae0901a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.500s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:25:41 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:25:41 devstack cinder-volume[86111]: DEBUG oslo_service.periodic_task [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Running periodic task VolumeManager._thread_info {{(pid=86111) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 29 01:25:41 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-de752545-d617-440e-8362-d04fae0901a5 None None] thread count: 28 {{(pid=86111) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 29 01:25:41 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-de752545-d617-440e-8362-d04fae0901a5 None None] thread info: [<_MainThread(MainThread, started 129173440548992)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86111) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 29 01:25:50 devstack cinder-volume[86111]: DEBUG dbcounter [-] [86111] Writing DB stats cinder:SELECT=23,cinder:UPDATE=6,cinder:INSERT=1 {{(pid=86111) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 29 01:25:51 devstack cinder-volume[86111]: DEBUG dbcounter [-] [86111] Writing DB stats cinder:SELECT=21,cinder:UPDATE=9,cinder:DELETE=2,cinder:INSERT=1 {{(pid=86111) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 29 01:26:10 devstack cinder-volume[86111]: INFO cinder.volume.manager [req-506b6769-327b-40d2-861e-3e79a1507147 req-7453d844-47af-4cf1-90af-e5c0bb14bda6 tempest-TestShelveInstance-649116597 None] Terminate volume connection completed successfully. Aug 29 01:26:10 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [req-506b6769-327b-40d2-861e-3e79a1507147 req-7453d844-47af-4cf1-90af-e5c0bb14bda6 tempest-TestShelveInstance-649116597 None] Deleting attachment 07991d72-12bb-4930-9075-100b12d5feea. {{(pid=86111) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 29 01:26:11 devstack cinder-volume[86111]: DEBUG cinder.coordination [req-506b6769-327b-40d2-861e-3e79a1507147 req-463f05c7-2829-4ca9-9074-cdcd1fef68d3 tempest-TestShelveInstance-649116597 None] Acquiring lock "cinder-fa985749-e6ef-4d1a-9109-e5ee8b6074a3-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:26:11 devstack cinder-volume[86111]: DEBUG cinder.coordination [req-506b6769-327b-40d2-861e-3e79a1507147 req-463f05c7-2829-4ca9-9074-cdcd1fef68d3 tempest-TestShelveInstance-649116597 None] Lock "cinder-fa985749-e6ef-4d1a-9109-e5ee8b6074a3-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:26:11 devstack cinder-volume[86111]: DEBUG cinder.coordination [req-506b6769-327b-40d2-861e-3e79a1507147 req-463f05c7-2829-4ca9-9074-cdcd1fef68d3 tempest-TestShelveInstance-649116597 None] Acquiring lock "cinder-quobyte-fa985749-e6ef-4d1a-9109-e5ee8b6074a3" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:26:11 devstack cinder-volume[86111]: DEBUG cinder.coordination [req-506b6769-327b-40d2-861e-3e79a1507147 req-463f05c7-2829-4ca9-9074-cdcd1fef68d3 tempest-TestShelveInstance-649116597 None] Lock "cinder-quobyte-fa985749-e6ef-4d1a-9109-e5ee8b6074a3" acquired by "delete_volume" :: waited 0.018s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:26:11 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[74c0ab4b-9c5f-4415-a2b1-dfca8b63d537]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:26:11 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [req-506b6769-327b-40d2-861e-3e79a1507147 req-463f05c7-2829-4ca9-9074-cdcd1fef68d3 tempest-TestShelveInstance-649116597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-fa985749-e6ef-4d1a-9109-e5ee8b6074a3 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:26:11 devstack sudo[103278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-fa985749-e6ef-4d1a-9109-e5ee8b6074a3 Aug 29 01:26:11 devstack sudo[103278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:26:11 devstack sudo[103278]: pam_unix(sudo:session): session closed for user root Aug 29 01:26:11 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [req-506b6769-327b-40d2-861e-3e79a1507147 req-463f05c7-2829-4ca9-9074-cdcd1fef68d3 tempest-TestShelveInstance-649116597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-fa985749-e6ef-4d1a-9109-e5ee8b6074a3" returned: 0 in 0.406s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:26:11 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [req-506b6769-327b-40d2-861e-3e79a1507147 req-463f05c7-2829-4ca9-9074-cdcd1fef68d3 tempest-TestShelveInstance-649116597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-fa985749-e6ef-4d1a-9109-e5ee8b6074a3 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:26:11 devstack sudo[103283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-fa985749-e6ef-4d1a-9109-e5ee8b6074a3 Aug 29 01:26:11 devstack sudo[103283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:26:11 devstack sudo[103283]: pam_unix(sudo:session): session closed for user root Aug 29 01:26:11 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [req-506b6769-327b-40d2-861e-3e79a1507147 req-463f05c7-2829-4ca9-9074-cdcd1fef68d3 tempest-TestShelveInstance-649116597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-fa985749-e6ef-4d1a-9109-e5ee8b6074a3" returned: 0 in 0.255s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:26:11 devstack cinder-volume[86111]: DEBUG cinder.coordination [req-506b6769-327b-40d2-861e-3e79a1507147 req-463f05c7-2829-4ca9-9074-cdcd1fef68d3 tempest-TestShelveInstance-649116597 None] Lock "cinder-quobyte-fa985749-e6ef-4d1a-9109-e5ee8b6074a3" released by "delete_volume" :: held 0.697s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:26:11 devstack cinder-volume[86111]: DEBUG cinder.quota [req-506b6769-327b-40d2-861e-3e79a1507147 req-463f05c7-2829-4ca9-9074-cdcd1fef68d3 tempest-TestShelveInstance-649116597 None] Created reservations ['5a0ad817-8892-451e-b84c-2e797374ed34', '3135a22a-29d9-4272-8831-06c05994c8dd', 'fc095533-3424-4740-943d-dfbb5a62ac76', '859fdaba-d568-44e3-b8ad-970ab69b70e0'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:26:11 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [req-506b6769-327b-40d2-861e-3e79a1507147 req-463f05c7-2829-4ca9-9074-cdcd1fef68d3 tempest-TestShelveInstance-649116597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:26:11 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [req-506b6769-327b-40d2-861e-3e79a1507147 req-463f05c7-2829-4ca9-9074-cdcd1fef68d3 tempest-TestShelveInstance-649116597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:26:11 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [req-506b6769-327b-40d2-861e-3e79a1507147 req-463f05c7-2829-4ca9-9074-cdcd1fef68d3 tempest-TestShelveInstance-649116597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:26:11 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [req-506b6769-327b-40d2-861e-3e79a1507147 req-463f05c7-2829-4ca9-9074-cdcd1fef68d3 tempest-TestShelveInstance-649116597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:26:11 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [req-506b6769-327b-40d2-861e-3e79a1507147 req-463f05c7-2829-4ca9-9074-cdcd1fef68d3 tempest-TestShelveInstance-649116597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:26:11 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [req-506b6769-327b-40d2-861e-3e79a1507147 req-463f05c7-2829-4ca9-9074-cdcd1fef68d3 tempest-TestShelveInstance-649116597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:26:11 devstack sudo[103286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:26:11 devstack sudo[103286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:26:12 devstack sudo[103286]: pam_unix(sudo:session): session closed for user root Aug 29 01:26:12 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [req-506b6769-327b-40d2-861e-3e79a1507147 req-463f05c7-2829-4ca9-9074-cdcd1fef68d3 tempest-TestShelveInstance-649116597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.280s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:26:12 devstack cinder-volume[86111]: DEBUG cinder.manager [req-506b6769-327b-40d2-861e-3e79a1507147 req-463f05c7-2829-4ca9-9074-cdcd1fef68d3 tempest-TestShelveInstance-649116597 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:26:12 devstack cinder-volume[86111]: INFO cinder.volume.manager [req-506b6769-327b-40d2-861e-3e79a1507147 req-463f05c7-2829-4ca9-9074-cdcd1fef68d3 tempest-TestShelveInstance-649116597 None] Deleted volume successfully. Aug 29 01:26:12 devstack cinder-volume[86111]: DEBUG cinder.coordination [req-506b6769-327b-40d2-861e-3e79a1507147 req-463f05c7-2829-4ca9-9074-cdcd1fef68d3 tempest-TestShelveInstance-649116597 None] Lock "cinder-fa985749-e6ef-4d1a-9109-e5ee8b6074a3-delete_volume" released by "delete_volume" :: held 1.185s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:26:21 devstack cinder-volume[86111]: DEBUG dbcounter [-] [86111] Writing DB stats cinder:SELECT=5,cinder:UPDATE=8,cinder:INSERT=2 {{(pid=86111) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 29 01:26:22 devstack cinder-volume[86111]: DEBUG dbcounter [-] [86111] Writing DB stats cinder:SELECT=7,cinder:INSERT=2,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=86111) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 29 01:26:23 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-fdb1d1c2-3411-45cc-8bb8-07511bdfd64d tempest-CreateVolumesFromImageTest-702184679 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:26:23 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-fdb1d1c2-3411-45cc-8bb8-07511bdfd64d tempest-CreateVolumesFromImageTest-702184679 None] Flow 'volume_create_manager' (8bcdd326-ff9b-420f-ab72-40fdea1a6fd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:26:23 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-fdb1d1c2-3411-45cc-8bb8-07511bdfd64d tempest-CreateVolumesFromImageTest-702184679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1716987c-c725-43c0-bb5e-561f2c483615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:26:23 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-fdb1d1c2-3411-45cc-8bb8-07511bdfd64d tempest-CreateVolumesFromImageTest-702184679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1716987c-c725-43c0-bb5e-561f2c483615) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:26:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-189409611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=526282f4-f68d-4822-ab83-d9a49dc06bf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='264b1bd9981b45779143eb94db88a03e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:26:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:26:23Z,use_quota=True,user_id='615692482fae41cfa9b3886809ba71e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:26:23 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-fdb1d1c2-3411-45cc-8bb8-07511bdfd64d tempest-CreateVolumesFromImageTest-702184679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea4bbf65-58a0-42e7-9009-43a171128ef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:26:23 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-fdb1d1c2-3411-45cc-8bb8-07511bdfd64d tempest-CreateVolumesFromImageTest-702184679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea4bbf65-58a0-42e7-9009-43a171128ef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:26:23 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-fdb1d1c2-3411-45cc-8bb8-07511bdfd64d tempest-CreateVolumesFromImageTest-702184679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f49ad1cb-db0c-422b-9800-7a45888943e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:26:23 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-fdb1d1c2-3411-45cc-8bb8-07511bdfd64d tempest-CreateVolumesFromImageTest-702184679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f49ad1cb-db0c-422b-9800-7a45888943e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '526282f4-f68d-4822-ab83-d9a49dc06bf9', 'volume_name': 'volume-526282f4-f68d-4822-ab83-d9a49dc06bf9', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:26:23 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-fdb1d1c2-3411-45cc-8bb8-07511bdfd64d tempest-CreateVolumesFromImageTest-702184679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2d23f94-2926-4cea-ab94-0ed3429af305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:26:23 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-fdb1d1c2-3411-45cc-8bb8-07511bdfd64d tempest-CreateVolumesFromImageTest-702184679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2d23f94-2926-4cea-ab94-0ed3429af305) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:26:23 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-fdb1d1c2-3411-45cc-8bb8-07511bdfd64d tempest-CreateVolumesFromImageTest-702184679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67dd9cbc-ac82-4be6-b059-d8b82175f0b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:26:23 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-fdb1d1c2-3411-45cc-8bb8-07511bdfd64d tempest-CreateVolumesFromImageTest-702184679 None] Volume 526282f4-f68d-4822-ab83-d9a49dc06bf9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-526282f4-f68d-4822-ab83-d9a49dc06bf9', 'volume_size': 1} Aug 29 01:26:23 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-fdb1d1c2-3411-45cc-8bb8-07511bdfd64d tempest-CreateVolumesFromImageTest-702184679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:26:23 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-fdb1d1c2-3411-45cc-8bb8-07511bdfd64d tempest-CreateVolumesFromImageTest-702184679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:26:23 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-fdb1d1c2-3411-45cc-8bb8-07511bdfd64d tempest-CreateVolumesFromImageTest-702184679 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:26:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-189409611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=526282f4-f68d-4822-ab83-d9a49dc06bf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='264b1bd9981b45779143eb94db88a03e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:26:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:26:23Z,use_quota=True,user_id='615692482fae41cfa9b3886809ba71e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:26:23 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-fdb1d1c2-3411-45cc-8bb8-07511bdfd64d tempest-CreateVolumesFromImageTest-702184679 None] Creating volume 526282f4-f68d-4822-ab83-d9a49dc06bf9 {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:26:23 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-fdb1d1c2-3411-45cc-8bb8-07511bdfd64d tempest-CreateVolumesFromImageTest-702184679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:26:23 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-fdb1d1c2-3411-45cc-8bb8-07511bdfd64d tempest-CreateVolumesFromImageTest-702184679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:26:23 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-fdb1d1c2-3411-45cc-8bb8-07511bdfd64d tempest-CreateVolumesFromImageTest-702184679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:26:23 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-fdb1d1c2-3411-45cc-8bb8-07511bdfd64d tempest-CreateVolumesFromImageTest-702184679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:26:23 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-fdb1d1c2-3411-45cc-8bb8-07511bdfd64d tempest-CreateVolumesFromImageTest-702184679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:26:23 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-fdb1d1c2-3411-45cc-8bb8-07511bdfd64d tempest-CreateVolumesFromImageTest-702184679 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:26:23 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-fdb1d1c2-3411-45cc-8bb8-07511bdfd64d tempest-CreateVolumesFromImageTest-702184679 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:26:23 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-fdb1d1c2-3411-45cc-8bb8-07511bdfd64d tempest-CreateVolumesFromImageTest-702184679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-526282f4-f68d-4822-ab83-d9a49dc06bf9 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:26:23 devstack sudo[103308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-526282f4-f68d-4822-ab83-d9a49dc06bf9 1073741824 Aug 29 01:26:23 devstack sudo[103308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:26:23 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [req-e789588f-b3f4-4c4d-b96f-ae47be47e48c req-f093c8e8-a926-4221-8bad-e0d70b899135 tempest-TestStampPattern-1898898860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:26:23 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f39f324-bda8-4553-a821-81d2344c13a6 tempest-CreateVolumesFromImageTest-702184679 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:26:24 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6f39f324-bda8-4553-a821-81d2344c13a6 tempest-CreateVolumesFromImageTest-702184679 None] Flow 'volume_create_manager' (ad7161a2-f69d-4201-8254-81684ec25da2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:26:24 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6f39f324-bda8-4553-a821-81d2344c13a6 tempest-CreateVolumesFromImageTest-702184679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d36127f-addc-485b-9758-dc4fe2473deb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:26:24 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6f39f324-bda8-4553-a821-81d2344c13a6 tempest-CreateVolumesFromImageTest-702184679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d36127f-addc-485b-9758-dc4fe2473deb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:26:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1571125352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cfe6c6e-695f-4ba4-8d3b-5c95d22b1d45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='264b1bd9981b45779143eb94db88a03e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:26:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:26:24Z,use_quota=True,user_id='615692482fae41cfa9b3886809ba71e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:26:24 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6f39f324-bda8-4553-a821-81d2344c13a6 tempest-CreateVolumesFromImageTest-702184679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79655900-2952-428c-9eb7-0a14a88324e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:26:24 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6f39f324-bda8-4553-a821-81d2344c13a6 tempest-CreateVolumesFromImageTest-702184679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79655900-2952-428c-9eb7-0a14a88324e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:26:24 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6f39f324-bda8-4553-a821-81d2344c13a6 tempest-CreateVolumesFromImageTest-702184679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67a273cd-4d0f-4eb5-8fe5-5dcdcd9f60aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:26:24 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6f39f324-bda8-4553-a821-81d2344c13a6 tempest-CreateVolumesFromImageTest-702184679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67a273cd-4d0f-4eb5-8fe5-5dcdcd9f60aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6cfe6c6e-695f-4ba4-8d3b-5c95d22b1d45', 'volume_name': 'volume-6cfe6c6e-695f-4ba4-8d3b-5c95d22b1d45', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:26:24 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6f39f324-bda8-4553-a821-81d2344c13a6 tempest-CreateVolumesFromImageTest-702184679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (426744f0-921b-4c94-befb-842addea126f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:26:24 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6f39f324-bda8-4553-a821-81d2344c13a6 tempest-CreateVolumesFromImageTest-702184679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (426744f0-921b-4c94-befb-842addea126f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:26:24 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6f39f324-bda8-4553-a821-81d2344c13a6 tempest-CreateVolumesFromImageTest-702184679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (756af71f-6681-4b0a-b5aa-6d800a5ec056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:26:24 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-6f39f324-bda8-4553-a821-81d2344c13a6 tempest-CreateVolumesFromImageTest-702184679 None] Volume 6cfe6c6e-695f-4ba4-8d3b-5c95d22b1d45: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6cfe6c6e-695f-4ba4-8d3b-5c95d22b1d45', 'volume_size': 1} Aug 29 01:26:24 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-6f39f324-bda8-4553-a821-81d2344c13a6 tempest-CreateVolumesFromImageTest-702184679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:26:24 devstack sudo[103308]: pam_unix(sudo:session): session closed for user root Aug 29 01:26:24 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-fdb1d1c2-3411-45cc-8bb8-07511bdfd64d tempest-CreateVolumesFromImageTest-702184679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-526282f4-f68d-4822-ab83-d9a49dc06bf9 1073741824" returned: 0 in 0.509s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:26:24 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-fdb1d1c2-3411-45cc-8bb8-07511bdfd64d tempest-CreateVolumesFromImageTest-702184679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-526282f4-f68d-4822-ab83-d9a49dc06bf9 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:26:24 devstack sudo[103325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-526282f4-f68d-4822-ab83-d9a49dc06bf9 Aug 29 01:26:24 devstack sudo[103325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:26:24 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d6e9eab-31c7-4716-9baa-e21182d17247 tempest-CreateVolumesFromImageTest-702184679 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:26:24 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-2d6e9eab-31c7-4716-9baa-e21182d17247 tempest-CreateVolumesFromImageTest-702184679 None] Flow 'volume_create_manager' (327d06af-ff6b-4d4f-b7f1-508af4d12d02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:26:24 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-2d6e9eab-31c7-4716-9baa-e21182d17247 tempest-CreateVolumesFromImageTest-702184679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80de0317-ed68-4b2a-a7d4-121373543162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:26:24 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-2d6e9eab-31c7-4716-9baa-e21182d17247 tempest-CreateVolumesFromImageTest-702184679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80de0317-ed68-4b2a-a7d4-121373543162) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:26:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1270947139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f0002ca-4043-4200-910d-7bca0faf7cd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='264b1bd9981b45779143eb94db88a03e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:26:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:26:24Z,use_quota=True,user_id='615692482fae41cfa9b3886809ba71e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:26:24 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-2d6e9eab-31c7-4716-9baa-e21182d17247 tempest-CreateVolumesFromImageTest-702184679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6972e41-8483-491b-b6a6-783767863531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:26:24 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-2d6e9eab-31c7-4716-9baa-e21182d17247 tempest-CreateVolumesFromImageTest-702184679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6972e41-8483-491b-b6a6-783767863531) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:26:24 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-2d6e9eab-31c7-4716-9baa-e21182d17247 tempest-CreateVolumesFromImageTest-702184679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3677af24-0510-4b82-95c9-2fd960310314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:26:24 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-2d6e9eab-31c7-4716-9baa-e21182d17247 tempest-CreateVolumesFromImageTest-702184679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3677af24-0510-4b82-95c9-2fd960310314) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f0002ca-4043-4200-910d-7bca0faf7cd0', 'volume_name': 'volume-1f0002ca-4043-4200-910d-7bca0faf7cd0', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:26:24 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-2d6e9eab-31c7-4716-9baa-e21182d17247 tempest-CreateVolumesFromImageTest-702184679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c4b092d-9218-4efd-b5a3-397f06cc699c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:26:24 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-2d6e9eab-31c7-4716-9baa-e21182d17247 tempest-CreateVolumesFromImageTest-702184679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c4b092d-9218-4efd-b5a3-397f06cc699c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:26:24 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-2d6e9eab-31c7-4716-9baa-e21182d17247 tempest-CreateVolumesFromImageTest-702184679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c54ad566-6fce-422a-a5df-0a802c5e8483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:26:24 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-2d6e9eab-31c7-4716-9baa-e21182d17247 tempest-CreateVolumesFromImageTest-702184679 None] Volume 1f0002ca-4043-4200-910d-7bca0faf7cd0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f0002ca-4043-4200-910d-7bca0faf7cd0', 'volume_size': 1} Aug 29 01:26:24 devstack sudo[103325]: pam_unix(sudo:session): session closed for user root Aug 29 01:26:24 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-2d6e9eab-31c7-4716-9baa-e21182d17247 tempest-CreateVolumesFromImageTest-702184679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:26:24 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-fdb1d1c2-3411-45cc-8bb8-07511bdfd64d tempest-CreateVolumesFromImageTest-702184679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-526282f4-f68d-4822-ab83-d9a49dc06bf9" returned: 0 in 0.253s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:26:24 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-fdb1d1c2-3411-45cc-8bb8-07511bdfd64d tempest-CreateVolumesFromImageTest-702184679 None] <== create_volume: return (803ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:26:24 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-fdb1d1c2-3411-45cc-8bb8-07511bdfd64d tempest-CreateVolumesFromImageTest-702184679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.807s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:26:24 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [req-e789588f-b3f4-4c4d-b96f-ae47be47e48c req-f093c8e8-a926-4221-8bad-e0d70b899135 tempest-TestStampPattern-1898898860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.476s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:26:24 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-fdb1d1c2-3411-45cc-8bb8-07511bdfd64d tempest-CreateVolumesFromImageTest-702184679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67dd9cbc-ac82-4be6-b059-d8b82175f0b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-526282f4-f68d-4822-ab83-d9a49dc06bf9', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:26:24 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-fdb1d1c2-3411-45cc-8bb8-07511bdfd64d tempest-CreateVolumesFromImageTest-702184679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b0a82d8-a7bd-4292-8e49-50176eb2f508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:26:24 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [req-e789588f-b3f4-4c4d-b96f-ae47be47e48c req-f093c8e8-a926-4221-8bad-e0d70b899135 tempest-TestStampPattern-1898898860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:26:24 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-6f39f324-bda8-4553-a821-81d2344c13a6 tempest-CreateVolumesFromImageTest-702184679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.365s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:26:24 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-6f39f324-bda8-4553-a821-81d2344c13a6 tempest-CreateVolumesFromImageTest-702184679 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:26:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1571125352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cfe6c6e-695f-4ba4-8d3b-5c95d22b1d45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='264b1bd9981b45779143eb94db88a03e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:26:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:26:24Z,use_quota=True,user_id='615692482fae41cfa9b3886809ba71e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:26:24 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-6f39f324-bda8-4553-a821-81d2344c13a6 tempest-CreateVolumesFromImageTest-702184679 None] Creating volume 6cfe6c6e-695f-4ba4-8d3b-5c95d22b1d45 {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:26:24 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-6f39f324-bda8-4553-a821-81d2344c13a6 tempest-CreateVolumesFromImageTest-702184679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:26:24 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-6f39f324-bda8-4553-a821-81d2344c13a6 tempest-CreateVolumesFromImageTest-702184679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:26:24 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-6f39f324-bda8-4553-a821-81d2344c13a6 tempest-CreateVolumesFromImageTest-702184679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:26:24 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-6f39f324-bda8-4553-a821-81d2344c13a6 tempest-CreateVolumesFromImageTest-702184679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:26:24 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-6f39f324-bda8-4553-a821-81d2344c13a6 tempest-CreateVolumesFromImageTest-702184679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:26:24 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-6f39f324-bda8-4553-a821-81d2344c13a6 tempest-CreateVolumesFromImageTest-702184679 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:26:24 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-6f39f324-bda8-4553-a821-81d2344c13a6 tempest-CreateVolumesFromImageTest-702184679 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:26:24 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-6f39f324-bda8-4553-a821-81d2344c13a6 tempest-CreateVolumesFromImageTest-702184679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-6cfe6c6e-695f-4ba4-8d3b-5c95d22b1d45 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:26:24 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-fdb1d1c2-3411-45cc-8bb8-07511bdfd64d tempest-CreateVolumesFromImageTest-702184679 None] Volume volume-526282f4-f68d-4822-ab83-d9a49dc06bf9 (526282f4-f68d-4822-ab83-d9a49dc06bf9): created successfully Aug 29 01:26:24 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-fdb1d1c2-3411-45cc-8bb8-07511bdfd64d tempest-CreateVolumesFromImageTest-702184679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b0a82d8-a7bd-4292-8e49-50176eb2f508) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:26:24 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-fdb1d1c2-3411-45cc-8bb8-07511bdfd64d tempest-CreateVolumesFromImageTest-702184679 None] Flow 'volume_create_manager' (8bcdd326-ff9b-420f-ab72-40fdea1a6fd7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:26:24 devstack sudo[103328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-6cfe6c6e-695f-4ba4-8d3b-5c95d22b1d45 1073741824 Aug 29 01:26:24 devstack sudo[103328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:26:24 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-fdb1d1c2-3411-45cc-8bb8-07511bdfd64d tempest-CreateVolumesFromImageTest-702184679 None] Created volume successfully. Aug 29 01:26:24 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [req-e789588f-b3f4-4c4d-b96f-ae47be47e48c req-f093c8e8-a926-4221-8bad-e0d70b899135 tempest-TestStampPattern-1898898860 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630', 'name': 'volume-bbb88808-57ba-485a-b283-1d127546cab3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd8ea2b37-baa6-4f95-ab73-157f6bcf6758', 'enforce_multipath': True} {{(pid=86111) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 29 01:26:24 devstack cinder-volume[86111]: INFO cinder.volume.manager [req-e789588f-b3f4-4c4d-b96f-ae47be47e48c req-f093c8e8-a926-4221-8bad-e0d70b899135 tempest-TestStampPattern-1898898860 None] attachment_update completed successfully. Aug 29 01:26:24 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7d6ba53-1c61-4d01-b55f-68ccccd46986 tempest-CreateVolumesFromImageTest-702184679 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:26:24 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-a7d6ba53-1c61-4d01-b55f-68ccccd46986 tempest-CreateVolumesFromImageTest-702184679 None] Flow 'volume_create_manager' (6a1d3360-793c-44a9-a703-aef5310a821b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:26:24 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-a7d6ba53-1c61-4d01-b55f-68ccccd46986 tempest-CreateVolumesFromImageTest-702184679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5dd14a99-f63d-41b6-bb9f-32944e11232a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:26:24 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-a7d6ba53-1c61-4d01-b55f-68ccccd46986 tempest-CreateVolumesFromImageTest-702184679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5dd14a99-f63d-41b6-bb9f-32944e11232a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:26:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1853866495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f74dd68c-96fc-478a-8492-9a74bdd8bdbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='264b1bd9981b45779143eb94db88a03e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:26:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:26:25Z,use_quota=True,user_id='615692482fae41cfa9b3886809ba71e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:26:24 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-a7d6ba53-1c61-4d01-b55f-68ccccd46986 tempest-CreateVolumesFromImageTest-702184679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (589ad584-900c-46d1-8be1-d00a2632a9b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:26:24 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-a7d6ba53-1c61-4d01-b55f-68ccccd46986 tempest-CreateVolumesFromImageTest-702184679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (589ad584-900c-46d1-8be1-d00a2632a9b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:26:24 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-a7d6ba53-1c61-4d01-b55f-68ccccd46986 tempest-CreateVolumesFromImageTest-702184679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2375b71-3152-4bf9-a857-433455103156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:26:24 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-a7d6ba53-1c61-4d01-b55f-68ccccd46986 tempest-CreateVolumesFromImageTest-702184679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2375b71-3152-4bf9-a857-433455103156) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f74dd68c-96fc-478a-8492-9a74bdd8bdbe', 'volume_name': 'volume-f74dd68c-96fc-478a-8492-9a74bdd8bdbe', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:26:24 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-a7d6ba53-1c61-4d01-b55f-68ccccd46986 tempest-CreateVolumesFromImageTest-702184679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50bf16e7-f5b7-4b95-a787-c21dc7447964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:26:24 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-a7d6ba53-1c61-4d01-b55f-68ccccd46986 tempest-CreateVolumesFromImageTest-702184679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50bf16e7-f5b7-4b95-a787-c21dc7447964) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:26:24 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-a7d6ba53-1c61-4d01-b55f-68ccccd46986 tempest-CreateVolumesFromImageTest-702184679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77c88c1b-0390-4836-8b73-0565ac7e8f62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:26:24 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-a7d6ba53-1c61-4d01-b55f-68ccccd46986 tempest-CreateVolumesFromImageTest-702184679 None] Volume f74dd68c-96fc-478a-8492-9a74bdd8bdbe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f74dd68c-96fc-478a-8492-9a74bdd8bdbe', 'volume_size': 1} Aug 29 01:26:24 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-a7d6ba53-1c61-4d01-b55f-68ccccd46986 tempest-CreateVolumesFromImageTest-702184679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:26:25 devstack sudo[103328]: pam_unix(sudo:session): session closed for user root Aug 29 01:26:25 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-6f39f324-bda8-4553-a821-81d2344c13a6 tempest-CreateVolumesFromImageTest-702184679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-6cfe6c6e-695f-4ba4-8d3b-5c95d22b1d45 1073741824" returned: 0 in 0.603s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:26:25 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-6f39f324-bda8-4553-a821-81d2344c13a6 tempest-CreateVolumesFromImageTest-702184679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-6cfe6c6e-695f-4ba4-8d3b-5c95d22b1d45 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:26:25 devstack sudo[103716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-6cfe6c6e-695f-4ba4-8d3b-5c95d22b1d45 Aug 29 01:26:25 devstack sudo[103716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:26:25 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5013ff2-7eef-43c4-bf11-9cb3f456d931 tempest-CreateVolumesFromImageTest-702184679 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:26:25 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-b5013ff2-7eef-43c4-bf11-9cb3f456d931 tempest-CreateVolumesFromImageTest-702184679 None] Flow 'volume_create_manager' (fda8e33b-8764-4be8-88f4-951e225b5553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:26:25 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-b5013ff2-7eef-43c4-bf11-9cb3f456d931 tempest-CreateVolumesFromImageTest-702184679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de369882-37dd-435d-b4bd-c04225808fea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:26:25 devstack sudo[103716]: pam_unix(sudo:session): session closed for user root Aug 29 01:26:25 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-6f39f324-bda8-4553-a821-81d2344c13a6 tempest-CreateVolumesFromImageTest-702184679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-6cfe6c6e-695f-4ba4-8d3b-5c95d22b1d45" returned: 0 in 0.313s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:26:25 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-6f39f324-bda8-4553-a821-81d2344c13a6 tempest-CreateVolumesFromImageTest-702184679 None] <== create_volume: return (972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:26:25 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-6f39f324-bda8-4553-a821-81d2344c13a6 tempest-CreateVolumesFromImageTest-702184679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.976s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:26:25 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-2d6e9eab-31c7-4716-9baa-e21182d17247 tempest-CreateVolumesFromImageTest-702184679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.013s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:26:25 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-2d6e9eab-31c7-4716-9baa-e21182d17247 tempest-CreateVolumesFromImageTest-702184679 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:26:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1270947139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f0002ca-4043-4200-910d-7bca0faf7cd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='264b1bd9981b45779143eb94db88a03e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:26:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:26:24Z,use_quota=True,user_id='615692482fae41cfa9b3886809ba71e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:26:25 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-2d6e9eab-31c7-4716-9baa-e21182d17247 tempest-CreateVolumesFromImageTest-702184679 None] Creating volume 1f0002ca-4043-4200-910d-7bca0faf7cd0 {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:26:25 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-2d6e9eab-31c7-4716-9baa-e21182d17247 tempest-CreateVolumesFromImageTest-702184679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:26:25 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-2d6e9eab-31c7-4716-9baa-e21182d17247 tempest-CreateVolumesFromImageTest-702184679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:26:25 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-2d6e9eab-31c7-4716-9baa-e21182d17247 tempest-CreateVolumesFromImageTest-702184679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:26:25 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-2d6e9eab-31c7-4716-9baa-e21182d17247 tempest-CreateVolumesFromImageTest-702184679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:26:25 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-2d6e9eab-31c7-4716-9baa-e21182d17247 tempest-CreateVolumesFromImageTest-702184679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:26:25 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-2d6e9eab-31c7-4716-9baa-e21182d17247 tempest-CreateVolumesFromImageTest-702184679 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:26:25 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-2d6e9eab-31c7-4716-9baa-e21182d17247 tempest-CreateVolumesFromImageTest-702184679 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:26:25 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-2d6e9eab-31c7-4716-9baa-e21182d17247 tempest-CreateVolumesFromImageTest-702184679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-1f0002ca-4043-4200-910d-7bca0faf7cd0 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:26:25 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-b5013ff2-7eef-43c4-bf11-9cb3f456d931 tempest-CreateVolumesFromImageTest-702184679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de369882-37dd-435d-b4bd-c04225808fea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:26:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1894930050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=570e87e0-7c69-4728-a626-2d299568eadf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='264b1bd9981b45779143eb94db88a03e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:26:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:26:25Z,use_quota=True,user_id='615692482fae41cfa9b3886809ba71e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:26:25 devstack sudo[103720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-1f0002ca-4043-4200-910d-7bca0faf7cd0 1073741824 Aug 29 01:26:25 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-b5013ff2-7eef-43c4-bf11-9cb3f456d931 tempest-CreateVolumesFromImageTest-702184679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7543f990-9bc6-4ba2-b4b6-8ad3f339eea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:26:25 devstack sudo[103720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:26:25 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-b5013ff2-7eef-43c4-bf11-9cb3f456d931 tempest-CreateVolumesFromImageTest-702184679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7543f990-9bc6-4ba2-b4b6-8ad3f339eea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:26:25 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-b5013ff2-7eef-43c4-bf11-9cb3f456d931 tempest-CreateVolumesFromImageTest-702184679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38814b7a-846d-4e95-8a3e-7fc4d127e1df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:26:25 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-b5013ff2-7eef-43c4-bf11-9cb3f456d931 tempest-CreateVolumesFromImageTest-702184679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38814b7a-846d-4e95-8a3e-7fc4d127e1df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '570e87e0-7c69-4728-a626-2d299568eadf', 'volume_name': 'volume-570e87e0-7c69-4728-a626-2d299568eadf', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:26:25 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-b5013ff2-7eef-43c4-bf11-9cb3f456d931 tempest-CreateVolumesFromImageTest-702184679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7015ad9d-7800-49d7-9b48-56fa39f5d7f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:26:25 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-b5013ff2-7eef-43c4-bf11-9cb3f456d931 tempest-CreateVolumesFromImageTest-702184679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7015ad9d-7800-49d7-9b48-56fa39f5d7f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:26:25 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-b5013ff2-7eef-43c4-bf11-9cb3f456d931 tempest-CreateVolumesFromImageTest-702184679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aea6e18a-2ada-43fd-8bcc-b24f04406953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:26:25 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-b5013ff2-7eef-43c4-bf11-9cb3f456d931 tempest-CreateVolumesFromImageTest-702184679 None] Volume 570e87e0-7c69-4728-a626-2d299568eadf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-570e87e0-7c69-4728-a626-2d299568eadf', 'volume_size': 1} Aug 29 01:26:25 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-b5013ff2-7eef-43c4-bf11-9cb3f456d931 tempest-CreateVolumesFromImageTest-702184679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:26:25 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6f39f324-bda8-4553-a821-81d2344c13a6 tempest-CreateVolumesFromImageTest-702184679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (756af71f-6681-4b0a-b5aa-6d800a5ec056) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6cfe6c6e-695f-4ba4-8d3b-5c95d22b1d45', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:26:25 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6f39f324-bda8-4553-a821-81d2344c13a6 tempest-CreateVolumesFromImageTest-702184679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9b21439-b2d0-4869-b1b6-b3564657d7ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:26:25 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-6f39f324-bda8-4553-a821-81d2344c13a6 tempest-CreateVolumesFromImageTest-702184679 None] Volume volume-6cfe6c6e-695f-4ba4-8d3b-5c95d22b1d45 (6cfe6c6e-695f-4ba4-8d3b-5c95d22b1d45): created successfully Aug 29 01:26:25 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6f39f324-bda8-4553-a821-81d2344c13a6 tempest-CreateVolumesFromImageTest-702184679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9b21439-b2d0-4869-b1b6-b3564657d7ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:26:25 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6f39f324-bda8-4553-a821-81d2344c13a6 tempest-CreateVolumesFromImageTest-702184679 None] Flow 'volume_create_manager' (ad7161a2-f69d-4201-8254-81684ec25da2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:26:25 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-6f39f324-bda8-4553-a821-81d2344c13a6 tempest-CreateVolumesFromImageTest-702184679 None] Created volume successfully. Aug 29 01:26:25 devstack sudo[103720]: pam_unix(sudo:session): session closed for user root Aug 29 01:26:25 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-2d6e9eab-31c7-4716-9baa-e21182d17247 tempest-CreateVolumesFromImageTest-702184679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-1f0002ca-4043-4200-910d-7bca0faf7cd0 1073741824" returned: 0 in 0.420s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:26:25 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-2d6e9eab-31c7-4716-9baa-e21182d17247 tempest-CreateVolumesFromImageTest-702184679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-1f0002ca-4043-4200-910d-7bca0faf7cd0 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:26:25 devstack sudo[103726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-1f0002ca-4043-4200-910d-7bca0faf7cd0 Aug 29 01:26:25 devstack sudo[103726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:26:26 devstack sudo[103726]: pam_unix(sudo:session): session closed for user root Aug 29 01:26:26 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-2d6e9eab-31c7-4716-9baa-e21182d17247 tempest-CreateVolumesFromImageTest-702184679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-1f0002ca-4043-4200-910d-7bca0faf7cd0" returned: 0 in 0.255s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:26:26 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-2d6e9eab-31c7-4716-9baa-e21182d17247 tempest-CreateVolumesFromImageTest-702184679 None] <== create_volume: return (716ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:26:26 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-2d6e9eab-31c7-4716-9baa-e21182d17247 tempest-CreateVolumesFromImageTest-702184679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.719s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:26:26 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-a7d6ba53-1c61-4d01-b55f-68ccccd46986 tempest-CreateVolumesFromImageTest-702184679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.309s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:26:26 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-a7d6ba53-1c61-4d01-b55f-68ccccd46986 tempest-CreateVolumesFromImageTest-702184679 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:26:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1853866495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f74dd68c-96fc-478a-8492-9a74bdd8bdbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='264b1bd9981b45779143eb94db88a03e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:26:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:26:25Z,use_quota=True,user_id='615692482fae41cfa9b3886809ba71e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:26:26 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-a7d6ba53-1c61-4d01-b55f-68ccccd46986 tempest-CreateVolumesFromImageTest-702184679 None] Creating volume f74dd68c-96fc-478a-8492-9a74bdd8bdbe {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:26:26 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-a7d6ba53-1c61-4d01-b55f-68ccccd46986 tempest-CreateVolumesFromImageTest-702184679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:26:26 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-a7d6ba53-1c61-4d01-b55f-68ccccd46986 tempest-CreateVolumesFromImageTest-702184679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:26:26 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-a7d6ba53-1c61-4d01-b55f-68ccccd46986 tempest-CreateVolumesFromImageTest-702184679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:26:26 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-a7d6ba53-1c61-4d01-b55f-68ccccd46986 tempest-CreateVolumesFromImageTest-702184679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:26:26 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-a7d6ba53-1c61-4d01-b55f-68ccccd46986 tempest-CreateVolumesFromImageTest-702184679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:26:26 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-a7d6ba53-1c61-4d01-b55f-68ccccd46986 tempest-CreateVolumesFromImageTest-702184679 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:26:26 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-a7d6ba53-1c61-4d01-b55f-68ccccd46986 tempest-CreateVolumesFromImageTest-702184679 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:26:26 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-a7d6ba53-1c61-4d01-b55f-68ccccd46986 tempest-CreateVolumesFromImageTest-702184679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-f74dd68c-96fc-478a-8492-9a74bdd8bdbe 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:26:26 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-2d6e9eab-31c7-4716-9baa-e21182d17247 tempest-CreateVolumesFromImageTest-702184679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c54ad566-6fce-422a-a5df-0a802c5e8483) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f0002ca-4043-4200-910d-7bca0faf7cd0', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:26:26 devstack sudo[103735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-f74dd68c-96fc-478a-8492-9a74bdd8bdbe 1073741824 Aug 29 01:26:26 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-2d6e9eab-31c7-4716-9baa-e21182d17247 tempest-CreateVolumesFromImageTest-702184679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48421769-8e8e-4c11-b83c-7b14464bec10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:26:26 devstack sudo[103735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:26:26 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-2d6e9eab-31c7-4716-9baa-e21182d17247 tempest-CreateVolumesFromImageTest-702184679 None] Volume volume-1f0002ca-4043-4200-910d-7bca0faf7cd0 (1f0002ca-4043-4200-910d-7bca0faf7cd0): created successfully Aug 29 01:26:26 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-2d6e9eab-31c7-4716-9baa-e21182d17247 tempest-CreateVolumesFromImageTest-702184679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48421769-8e8e-4c11-b83c-7b14464bec10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:26:26 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-2d6e9eab-31c7-4716-9baa-e21182d17247 tempest-CreateVolumesFromImageTest-702184679 None] Flow 'volume_create_manager' (327d06af-ff6b-4d4f-b7f1-508af4d12d02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:26:26 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-2d6e9eab-31c7-4716-9baa-e21182d17247 tempest-CreateVolumesFromImageTest-702184679 None] Created volume successfully. Aug 29 01:26:26 devstack sudo[103735]: pam_unix(sudo:session): session closed for user root Aug 29 01:26:26 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-a7d6ba53-1c61-4d01-b55f-68ccccd46986 tempest-CreateVolumesFromImageTest-702184679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-f74dd68c-96fc-478a-8492-9a74bdd8bdbe 1073741824" returned: 0 in 0.450s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:26:26 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-a7d6ba53-1c61-4d01-b55f-68ccccd46986 tempest-CreateVolumesFromImageTest-702184679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-f74dd68c-96fc-478a-8492-9a74bdd8bdbe {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:26:26 devstack sudo[103749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-f74dd68c-96fc-478a-8492-9a74bdd8bdbe Aug 29 01:26:26 devstack sudo[103749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:26:26 devstack sudo[103749]: pam_unix(sudo:session): session closed for user root Aug 29 01:26:26 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-a7d6ba53-1c61-4d01-b55f-68ccccd46986 tempest-CreateVolumesFromImageTest-702184679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-f74dd68c-96fc-478a-8492-9a74bdd8bdbe" returned: 0 in 0.266s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:26:26 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-a7d6ba53-1c61-4d01-b55f-68ccccd46986 tempest-CreateVolumesFromImageTest-702184679 None] <== create_volume: return (759ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:26:26 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-a7d6ba53-1c61-4d01-b55f-68ccccd46986 tempest-CreateVolumesFromImageTest-702184679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.763s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:26:26 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-b5013ff2-7eef-43c4-bf11-9cb3f456d931 tempest-CreateVolumesFromImageTest-702184679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.419s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:26:26 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-b5013ff2-7eef-43c4-bf11-9cb3f456d931 tempest-CreateVolumesFromImageTest-702184679 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:26:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1894930050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=570e87e0-7c69-4728-a626-2d299568eadf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='264b1bd9981b45779143eb94db88a03e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:26:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:26:25Z,use_quota=True,user_id='615692482fae41cfa9b3886809ba71e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:26:26 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-b5013ff2-7eef-43c4-bf11-9cb3f456d931 tempest-CreateVolumesFromImageTest-702184679 None] Creating volume 570e87e0-7c69-4728-a626-2d299568eadf {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:26:26 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-b5013ff2-7eef-43c4-bf11-9cb3f456d931 tempest-CreateVolumesFromImageTest-702184679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:26:26 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-b5013ff2-7eef-43c4-bf11-9cb3f456d931 tempest-CreateVolumesFromImageTest-702184679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:26:26 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-b5013ff2-7eef-43c4-bf11-9cb3f456d931 tempest-CreateVolumesFromImageTest-702184679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:26:26 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-b5013ff2-7eef-43c4-bf11-9cb3f456d931 tempest-CreateVolumesFromImageTest-702184679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:26:26 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-b5013ff2-7eef-43c4-bf11-9cb3f456d931 tempest-CreateVolumesFromImageTest-702184679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:26:26 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-b5013ff2-7eef-43c4-bf11-9cb3f456d931 tempest-CreateVolumesFromImageTest-702184679 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:26:26 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-b5013ff2-7eef-43c4-bf11-9cb3f456d931 tempest-CreateVolumesFromImageTest-702184679 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:26:26 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-b5013ff2-7eef-43c4-bf11-9cb3f456d931 tempest-CreateVolumesFromImageTest-702184679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-570e87e0-7c69-4728-a626-2d299568eadf 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:26:26 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-a7d6ba53-1c61-4d01-b55f-68ccccd46986 tempest-CreateVolumesFromImageTest-702184679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77c88c1b-0390-4836-8b73-0565ac7e8f62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f74dd68c-96fc-478a-8492-9a74bdd8bdbe', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:26:26 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-a7d6ba53-1c61-4d01-b55f-68ccccd46986 tempest-CreateVolumesFromImageTest-702184679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed1038db-0066-43e4-a708-f431a402d143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:26:26 devstack sudo[103754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-570e87e0-7c69-4728-a626-2d299568eadf 1073741824 Aug 29 01:26:26 devstack sudo[103754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:26:26 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-a7d6ba53-1c61-4d01-b55f-68ccccd46986 tempest-CreateVolumesFromImageTest-702184679 None] Volume volume-f74dd68c-96fc-478a-8492-9a74bdd8bdbe (f74dd68c-96fc-478a-8492-9a74bdd8bdbe): created successfully Aug 29 01:26:26 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-a7d6ba53-1c61-4d01-b55f-68ccccd46986 tempest-CreateVolumesFromImageTest-702184679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed1038db-0066-43e4-a708-f431a402d143) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:26:26 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-a7d6ba53-1c61-4d01-b55f-68ccccd46986 tempest-CreateVolumesFromImageTest-702184679 None] Flow 'volume_create_manager' (6a1d3360-793c-44a9-a703-aef5310a821b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:26:27 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-a7d6ba53-1c61-4d01-b55f-68ccccd46986 tempest-CreateVolumesFromImageTest-702184679 None] Created volume successfully. Aug 29 01:26:27 devstack cinder-volume[86111]: INFO cinder.volume.manager [req-7c8dd928-189c-416b-970e-4e761e97d9b4 req-4f51dcab-eeba-48b8-9fcc-239ca4463424 tempest-TestStampPattern-1898898860 None] Terminate volume connection completed successfully. Aug 29 01:26:27 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [req-7c8dd928-189c-416b-970e-4e761e97d9b4 req-4f51dcab-eeba-48b8-9fcc-239ca4463424 tempest-TestStampPattern-1898898860 None] Deleting attachment d8ea2b37-baa6-4f95-ab73-157f6bcf6758. {{(pid=86111) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 29 01:26:27 devstack sudo[103754]: pam_unix(sudo:session): session closed for user root Aug 29 01:26:27 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-b5013ff2-7eef-43c4-bf11-9cb3f456d931 tempest-CreateVolumesFromImageTest-702184679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-570e87e0-7c69-4728-a626-2d299568eadf 1073741824" returned: 0 in 0.524s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:26:27 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-b5013ff2-7eef-43c4-bf11-9cb3f456d931 tempest-CreateVolumesFromImageTest-702184679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-570e87e0-7c69-4728-a626-2d299568eadf {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:26:27 devstack sudo[103786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-570e87e0-7c69-4728-a626-2d299568eadf Aug 29 01:26:27 devstack sudo[103786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:26:27 devstack sudo[103786]: pam_unix(sudo:session): session closed for user root Aug 29 01:26:27 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-b5013ff2-7eef-43c4-bf11-9cb3f456d931 tempest-CreateVolumesFromImageTest-702184679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-570e87e0-7c69-4728-a626-2d299568eadf" returned: 0 in 0.259s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:26:27 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-b5013ff2-7eef-43c4-bf11-9cb3f456d931 tempest-CreateVolumesFromImageTest-702184679 None] <== create_volume: return (847ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:26:27 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-b5013ff2-7eef-43c4-bf11-9cb3f456d931 tempest-CreateVolumesFromImageTest-702184679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.849s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:26:27 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-b5013ff2-7eef-43c4-bf11-9cb3f456d931 tempest-CreateVolumesFromImageTest-702184679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aea6e18a-2ada-43fd-8bcc-b24f04406953) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-570e87e0-7c69-4728-a626-2d299568eadf', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:26:27 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-b5013ff2-7eef-43c4-bf11-9cb3f456d931 tempest-CreateVolumesFromImageTest-702184679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e71e6fe9-4e9f-4ef0-833c-45baca554a9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:26:27 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-b5013ff2-7eef-43c4-bf11-9cb3f456d931 tempest-CreateVolumesFromImageTest-702184679 None] Volume volume-570e87e0-7c69-4728-a626-2d299568eadf (570e87e0-7c69-4728-a626-2d299568eadf): created successfully Aug 29 01:26:27 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-b5013ff2-7eef-43c4-bf11-9cb3f456d931 tempest-CreateVolumesFromImageTest-702184679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e71e6fe9-4e9f-4ef0-833c-45baca554a9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:26:27 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-b5013ff2-7eef-43c4-bf11-9cb3f456d931 tempest-CreateVolumesFromImageTest-702184679 None] Flow 'volume_create_manager' (fda8e33b-8764-4be8-88f4-951e225b5553) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:26:27 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-b5013ff2-7eef-43c4-bf11-9cb3f456d931 tempest-CreateVolumesFromImageTest-702184679 None] Created volume successfully. Aug 29 01:26:28 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-9a0510ba-04bd-4825-8cbd-d490f3c91985 tempest-CreateVolumesFromImageTest-702184679 None] Acquiring lock "cinder-570e87e0-7c69-4728-a626-2d299568eadf-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:26:28 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-9a0510ba-04bd-4825-8cbd-d490f3c91985 tempest-CreateVolumesFromImageTest-702184679 None] Lock "cinder-570e87e0-7c69-4728-a626-2d299568eadf-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:26:28 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-9a0510ba-04bd-4825-8cbd-d490f3c91985 tempest-CreateVolumesFromImageTest-702184679 None] Acquiring lock "cinder-quobyte-570e87e0-7c69-4728-a626-2d299568eadf" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:26:28 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-9a0510ba-04bd-4825-8cbd-d490f3c91985 tempest-CreateVolumesFromImageTest-702184679 None] Lock "cinder-quobyte-570e87e0-7c69-4728-a626-2d299568eadf" acquired by "delete_volume" :: waited 0.024s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:26:28 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[51c3d9af-c69a-4512-83a3-f843c651c843]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:26:28 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-9a0510ba-04bd-4825-8cbd-d490f3c91985 tempest-CreateVolumesFromImageTest-702184679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-570e87e0-7c69-4728-a626-2d299568eadf {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:26:28 devstack sudo[103790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-570e87e0-7c69-4728-a626-2d299568eadf Aug 29 01:26:28 devstack sudo[103790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:26:29 devstack sudo[103790]: pam_unix(sudo:session): session closed for user root Aug 29 01:26:29 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-9a0510ba-04bd-4825-8cbd-d490f3c91985 tempest-CreateVolumesFromImageTest-702184679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-570e87e0-7c69-4728-a626-2d299568eadf" returned: 0 in 0.411s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:26:29 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-9a0510ba-04bd-4825-8cbd-d490f3c91985 tempest-CreateVolumesFromImageTest-702184679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-570e87e0-7c69-4728-a626-2d299568eadf {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:26:29 devstack sudo[103796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-570e87e0-7c69-4728-a626-2d299568eadf Aug 29 01:26:29 devstack sudo[103796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:26:29 devstack sudo[103796]: pam_unix(sudo:session): session closed for user root Aug 29 01:26:29 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-9a0510ba-04bd-4825-8cbd-d490f3c91985 tempest-CreateVolumesFromImageTest-702184679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-570e87e0-7c69-4728-a626-2d299568eadf" returned: 0 in 0.388s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:26:29 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-9a0510ba-04bd-4825-8cbd-d490f3c91985 tempest-CreateVolumesFromImageTest-702184679 None] Lock "cinder-quobyte-570e87e0-7c69-4728-a626-2d299568eadf" released by "delete_volume" :: held 0.858s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:26:29 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-9a0510ba-04bd-4825-8cbd-d490f3c91985 tempest-CreateVolumesFromImageTest-702184679 None] Created reservations ['6d33b554-f8b9-4ed1-8e87-a43b0b4a2898', 'e31deb94-14fe-4c8d-9bdf-50a732631b22', '90463573-90a0-4487-9f26-90fbd4bc0c39', 'e965da8e-941a-47e0-92be-9e0e0e681522'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:26:29 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-9a0510ba-04bd-4825-8cbd-d490f3c91985 tempest-CreateVolumesFromImageTest-702184679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:26:29 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-9a0510ba-04bd-4825-8cbd-d490f3c91985 tempest-CreateVolumesFromImageTest-702184679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:26:29 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-9a0510ba-04bd-4825-8cbd-d490f3c91985 tempest-CreateVolumesFromImageTest-702184679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:26:29 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-9a0510ba-04bd-4825-8cbd-d490f3c91985 tempest-CreateVolumesFromImageTest-702184679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:26:29 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-9a0510ba-04bd-4825-8cbd-d490f3c91985 tempest-CreateVolumesFromImageTest-702184679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:26:29 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-9a0510ba-04bd-4825-8cbd-d490f3c91985 tempest-CreateVolumesFromImageTest-702184679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:26:29 devstack sudo[103822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:26:29 devstack sudo[103822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:26:29 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-ff59b93e-d6b7-402e-9ead-48be1ac946a8 tempest-CreateVolumesFromImageTest-702184679 None] Acquiring lock "cinder-f74dd68c-96fc-478a-8492-9a74bdd8bdbe-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:26:29 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-ff59b93e-d6b7-402e-9ead-48be1ac946a8 tempest-CreateVolumesFromImageTest-702184679 None] Lock "cinder-f74dd68c-96fc-478a-8492-9a74bdd8bdbe-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:26:30 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-ff59b93e-d6b7-402e-9ead-48be1ac946a8 tempest-CreateVolumesFromImageTest-702184679 None] Acquiring lock "cinder-quobyte-f74dd68c-96fc-478a-8492-9a74bdd8bdbe" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:26:30 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-ff59b93e-d6b7-402e-9ead-48be1ac946a8 tempest-CreateVolumesFromImageTest-702184679 None] Lock "cinder-quobyte-f74dd68c-96fc-478a-8492-9a74bdd8bdbe" acquired by "delete_volume" :: waited 0.019s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:26:30 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[93b04feb-e0ef-4675-af67-e40d80bd4f11]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:26:30 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-ff59b93e-d6b7-402e-9ead-48be1ac946a8 tempest-CreateVolumesFromImageTest-702184679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-f74dd68c-96fc-478a-8492-9a74bdd8bdbe {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:26:30 devstack sudo[103822]: pam_unix(sudo:session): session closed for user root Aug 29 01:26:30 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-9a0510ba-04bd-4825-8cbd-d490f3c91985 tempest-CreateVolumesFromImageTest-702184679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.359s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:26:30 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-9a0510ba-04bd-4825-8cbd-d490f3c91985 tempest-CreateVolumesFromImageTest-702184679 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:26:30 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-9a0510ba-04bd-4825-8cbd-d490f3c91985 tempest-CreateVolumesFromImageTest-702184679 None] Deleted volume successfully. Aug 29 01:26:30 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-9a0510ba-04bd-4825-8cbd-d490f3c91985 tempest-CreateVolumesFromImageTest-702184679 None] Lock "cinder-570e87e0-7c69-4728-a626-2d299568eadf-delete_volume" released by "delete_volume" :: held 1.470s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:26:30 devstack sudo[103826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-f74dd68c-96fc-478a-8492-9a74bdd8bdbe Aug 29 01:26:30 devstack sudo[103826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:26:30 devstack sudo[103826]: pam_unix(sudo:session): session closed for user root Aug 29 01:26:30 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-ff59b93e-d6b7-402e-9ead-48be1ac946a8 tempest-CreateVolumesFromImageTest-702184679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-f74dd68c-96fc-478a-8492-9a74bdd8bdbe" returned: 0 in 0.443s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:26:30 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-ff59b93e-d6b7-402e-9ead-48be1ac946a8 tempest-CreateVolumesFromImageTest-702184679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-f74dd68c-96fc-478a-8492-9a74bdd8bdbe {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:26:30 devstack sudo[103833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-f74dd68c-96fc-478a-8492-9a74bdd8bdbe Aug 29 01:26:30 devstack sudo[103833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:26:30 devstack sudo[103833]: pam_unix(sudo:session): session closed for user root Aug 29 01:26:30 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-ff59b93e-d6b7-402e-9ead-48be1ac946a8 tempest-CreateVolumesFromImageTest-702184679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-f74dd68c-96fc-478a-8492-9a74bdd8bdbe" returned: 0 in 0.284s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:26:30 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-ff59b93e-d6b7-402e-9ead-48be1ac946a8 tempest-CreateVolumesFromImageTest-702184679 None] Lock "cinder-quobyte-f74dd68c-96fc-478a-8492-9a74bdd8bdbe" released by "delete_volume" :: held 0.789s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:26:30 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-ff59b93e-d6b7-402e-9ead-48be1ac946a8 tempest-CreateVolumesFromImageTest-702184679 None] Created reservations ['7a358ea1-9c71-4def-afe4-5c4d63a71723', '0fef7560-fcbb-4738-a22e-4ea40618fd03', '82654b4e-8f07-46fe-9623-f19b0e5353c1', '7429f426-0e0e-4f2b-bf55-a83d42bf574d'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:26:30 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-ff59b93e-d6b7-402e-9ead-48be1ac946a8 tempest-CreateVolumesFromImageTest-702184679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:26:30 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-ff59b93e-d6b7-402e-9ead-48be1ac946a8 tempest-CreateVolumesFromImageTest-702184679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:26:30 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-ff59b93e-d6b7-402e-9ead-48be1ac946a8 tempest-CreateVolumesFromImageTest-702184679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:26:30 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-ff59b93e-d6b7-402e-9ead-48be1ac946a8 tempest-CreateVolumesFromImageTest-702184679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:26:30 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-ff59b93e-d6b7-402e-9ead-48be1ac946a8 tempest-CreateVolumesFromImageTest-702184679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:26:30 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-ff59b93e-d6b7-402e-9ead-48be1ac946a8 tempest-CreateVolumesFromImageTest-702184679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:26:31 devstack sudo[103836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:26:31 devstack sudo[103836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:26:31 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-66b4bd5e-e5b5-4bb0-9db6-7ef6e0709294 tempest-CreateVolumesFromImageTest-702184679 None] Acquiring lock "cinder-1f0002ca-4043-4200-910d-7bca0faf7cd0-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:26:31 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-66b4bd5e-e5b5-4bb0-9db6-7ef6e0709294 tempest-CreateVolumesFromImageTest-702184679 None] Lock "cinder-1f0002ca-4043-4200-910d-7bca0faf7cd0-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:26:31 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-66b4bd5e-e5b5-4bb0-9db6-7ef6e0709294 tempest-CreateVolumesFromImageTest-702184679 None] Acquiring lock "cinder-quobyte-1f0002ca-4043-4200-910d-7bca0faf7cd0" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:26:31 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-66b4bd5e-e5b5-4bb0-9db6-7ef6e0709294 tempest-CreateVolumesFromImageTest-702184679 None] Lock "cinder-quobyte-1f0002ca-4043-4200-910d-7bca0faf7cd0" acquired by "delete_volume" :: waited 0.015s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:26:31 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[13855ce8-07bb-4c31-a6f7-fb7ab587b40d]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:26:31 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-66b4bd5e-e5b5-4bb0-9db6-7ef6e0709294 tempest-CreateVolumesFromImageTest-702184679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-1f0002ca-4043-4200-910d-7bca0faf7cd0 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:26:31 devstack sudo[103836]: pam_unix(sudo:session): session closed for user root Aug 29 01:26:31 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-ff59b93e-d6b7-402e-9ead-48be1ac946a8 tempest-CreateVolumesFromImageTest-702184679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.262s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:26:31 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-ff59b93e-d6b7-402e-9ead-48be1ac946a8 tempest-CreateVolumesFromImageTest-702184679 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:26:31 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-ff59b93e-d6b7-402e-9ead-48be1ac946a8 tempest-CreateVolumesFromImageTest-702184679 None] Deleted volume successfully. Aug 29 01:26:31 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-ff59b93e-d6b7-402e-9ead-48be1ac946a8 tempest-CreateVolumesFromImageTest-702184679 None] Lock "cinder-f74dd68c-96fc-478a-8492-9a74bdd8bdbe-delete_volume" released by "delete_volume" :: held 1.312s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:26:31 devstack sudo[103839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-1f0002ca-4043-4200-910d-7bca0faf7cd0 Aug 29 01:26:31 devstack sudo[103839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:26:31 devstack sudo[103839]: pam_unix(sudo:session): session closed for user root Aug 29 01:26:31 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-66b4bd5e-e5b5-4bb0-9db6-7ef6e0709294 tempest-CreateVolumesFromImageTest-702184679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-1f0002ca-4043-4200-910d-7bca0faf7cd0" returned: 0 in 0.398s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:26:31 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-66b4bd5e-e5b5-4bb0-9db6-7ef6e0709294 tempest-CreateVolumesFromImageTest-702184679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-1f0002ca-4043-4200-910d-7bca0faf7cd0 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:26:31 devstack sudo[103878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-1f0002ca-4043-4200-910d-7bca0faf7cd0 Aug 29 01:26:31 devstack sudo[103878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:26:31 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-27c5bd21-dc27-429d-90c0-717e005982e5 tempest-TestStampPattern-1898898860 None] Acquiring lock "cinder-bbb88808-57ba-485a-b283-1d127546cab3-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:26:31 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-27c5bd21-dc27-429d-90c0-717e005982e5 tempest-TestStampPattern-1898898860 None] Lock "cinder-bbb88808-57ba-485a-b283-1d127546cab3-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:26:31 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-27c5bd21-dc27-429d-90c0-717e005982e5 tempest-TestStampPattern-1898898860 None] Acquiring lock "cinder-quobyte-bbb88808-57ba-485a-b283-1d127546cab3" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:26:31 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-27c5bd21-dc27-429d-90c0-717e005982e5 tempest-TestStampPattern-1898898860 None] Lock "cinder-quobyte-bbb88808-57ba-485a-b283-1d127546cab3" acquired by "delete_volume" :: waited 0.022s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:26:31 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc4b82a6-8296-466c-a2e9-e89dbe7ba51f]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:26:31 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-27c5bd21-dc27-429d-90c0-717e005982e5 tempest-TestStampPattern-1898898860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-bbb88808-57ba-485a-b283-1d127546cab3 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:26:31 devstack sudo[103880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-bbb88808-57ba-485a-b283-1d127546cab3 Aug 29 01:26:31 devstack sudo[103880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:26:31 devstack sudo[103878]: pam_unix(sudo:session): session closed for user root Aug 29 01:26:31 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-66b4bd5e-e5b5-4bb0-9db6-7ef6e0709294 tempest-CreateVolumesFromImageTest-702184679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-1f0002ca-4043-4200-910d-7bca0faf7cd0" returned: 0 in 0.304s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:26:31 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-66b4bd5e-e5b5-4bb0-9db6-7ef6e0709294 tempest-CreateVolumesFromImageTest-702184679 None] Lock "cinder-quobyte-1f0002ca-4043-4200-910d-7bca0faf7cd0" released by "delete_volume" :: held 0.744s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:26:32 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-66b4bd5e-e5b5-4bb0-9db6-7ef6e0709294 tempest-CreateVolumesFromImageTest-702184679 None] Created reservations ['02a55036-14bb-4f48-ae2a-f69f573737c7', '298893b0-a6f5-49e3-ad0a-5593c234410a', 'c5c6b5bc-eb18-4043-be44-e963141f2fe2', '95565b87-e481-45b6-8396-2b8d3511c9b3'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:26:32 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-66b4bd5e-e5b5-4bb0-9db6-7ef6e0709294 tempest-CreateVolumesFromImageTest-702184679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:26:32 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-66b4bd5e-e5b5-4bb0-9db6-7ef6e0709294 tempest-CreateVolumesFromImageTest-702184679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:26:32 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-66b4bd5e-e5b5-4bb0-9db6-7ef6e0709294 tempest-CreateVolumesFromImageTest-702184679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:26:32 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-66b4bd5e-e5b5-4bb0-9db6-7ef6e0709294 tempest-CreateVolumesFromImageTest-702184679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:26:32 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-66b4bd5e-e5b5-4bb0-9db6-7ef6e0709294 tempest-CreateVolumesFromImageTest-702184679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:26:32 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-66b4bd5e-e5b5-4bb0-9db6-7ef6e0709294 tempest-CreateVolumesFromImageTest-702184679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:26:32 devstack sudo[103885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:26:32 devstack sudo[103885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:26:32 devstack sudo[103880]: pam_unix(sudo:session): session closed for user root Aug 29 01:26:32 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-27c5bd21-dc27-429d-90c0-717e005982e5 tempest-TestStampPattern-1898898860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-bbb88808-57ba-485a-b283-1d127546cab3" returned: 0 in 0.403s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:26:32 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-27c5bd21-dc27-429d-90c0-717e005982e5 tempest-TestStampPattern-1898898860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-bbb88808-57ba-485a-b283-1d127546cab3 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:26:32 devstack sudo[103890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-bbb88808-57ba-485a-b283-1d127546cab3 Aug 29 01:26:32 devstack sudo[103890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:26:32 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-11b1dc58-ea41-4daf-adb6-2e3b06c904e3 tempest-CreateVolumesFromImageTest-702184679 None] Acquiring lock "cinder-6cfe6c6e-695f-4ba4-8d3b-5c95d22b1d45-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:26:32 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-11b1dc58-ea41-4daf-adb6-2e3b06c904e3 tempest-CreateVolumesFromImageTest-702184679 None] Lock "cinder-6cfe6c6e-695f-4ba4-8d3b-5c95d22b1d45-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:26:32 devstack sudo[103885]: pam_unix(sudo:session): session closed for user root Aug 29 01:26:32 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-66b4bd5e-e5b5-4bb0-9db6-7ef6e0709294 tempest-CreateVolumesFromImageTest-702184679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.306s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:26:32 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-66b4bd5e-e5b5-4bb0-9db6-7ef6e0709294 tempest-CreateVolumesFromImageTest-702184679 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:26:32 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-11b1dc58-ea41-4daf-adb6-2e3b06c904e3 tempest-CreateVolumesFromImageTest-702184679 None] Acquiring lock "cinder-quobyte-6cfe6c6e-695f-4ba4-8d3b-5c95d22b1d45" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:26:32 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-66b4bd5e-e5b5-4bb0-9db6-7ef6e0709294 tempest-CreateVolumesFromImageTest-702184679 None] Deleted volume successfully. Aug 29 01:26:32 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-11b1dc58-ea41-4daf-adb6-2e3b06c904e3 tempest-CreateVolumesFromImageTest-702184679 None] Lock "cinder-quobyte-6cfe6c6e-695f-4ba4-8d3b-5c95d22b1d45" acquired by "delete_volume" :: waited 0.023s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:26:32 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-66b4bd5e-e5b5-4bb0-9db6-7ef6e0709294 tempest-CreateVolumesFromImageTest-702184679 None] Lock "cinder-1f0002ca-4043-4200-910d-7bca0faf7cd0-delete_volume" released by "delete_volume" :: held 1.280s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:26:32 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e1dffcd-ab2b-4504-a9d2-a340a2750826]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:26:32 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-11b1dc58-ea41-4daf-adb6-2e3b06c904e3 tempest-CreateVolumesFromImageTest-702184679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-6cfe6c6e-695f-4ba4-8d3b-5c95d22b1d45 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:26:32 devstack sudo[103890]: pam_unix(sudo:session): session closed for user root Aug 29 01:26:32 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-27c5bd21-dc27-429d-90c0-717e005982e5 tempest-TestStampPattern-1898898860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-bbb88808-57ba-485a-b283-1d127546cab3" returned: 0 in 0.287s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:26:32 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-27c5bd21-dc27-429d-90c0-717e005982e5 tempest-TestStampPattern-1898898860 None] Lock "cinder-quobyte-bbb88808-57ba-485a-b283-1d127546cab3" released by "delete_volume" :: held 0.738s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:26:32 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-27c5bd21-dc27-429d-90c0-717e005982e5 tempest-TestStampPattern-1898898860 None] Created reservations ['f6625e21-3714-41cc-9b91-9ded01795500', 'f0409e27-bfd2-446c-b853-9808a55a7e4f', '0fe91d9b-e8d9-40cc-afa0-f65f3189b453', '85eb7a9d-df51-4ee5-9710-d073b649da63'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:26:32 devstack sudo[103894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-6cfe6c6e-695f-4ba4-8d3b-5c95d22b1d45 Aug 29 01:26:32 devstack sudo[103894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:26:32 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-27c5bd21-dc27-429d-90c0-717e005982e5 tempest-TestStampPattern-1898898860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:26:32 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-27c5bd21-dc27-429d-90c0-717e005982e5 tempest-TestStampPattern-1898898860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:26:32 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-27c5bd21-dc27-429d-90c0-717e005982e5 tempest-TestStampPattern-1898898860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:26:32 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-27c5bd21-dc27-429d-90c0-717e005982e5 tempest-TestStampPattern-1898898860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:26:32 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-27c5bd21-dc27-429d-90c0-717e005982e5 tempest-TestStampPattern-1898898860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:26:32 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-27c5bd21-dc27-429d-90c0-717e005982e5 tempest-TestStampPattern-1898898860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:26:32 devstack sudo[103896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:26:32 devstack sudo[103896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:26:32 devstack sudo[103894]: pam_unix(sudo:session): session closed for user root Aug 29 01:26:32 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-11b1dc58-ea41-4daf-adb6-2e3b06c904e3 tempest-CreateVolumesFromImageTest-702184679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-6cfe6c6e-695f-4ba4-8d3b-5c95d22b1d45" returned: 0 in 0.395s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:26:32 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-11b1dc58-ea41-4daf-adb6-2e3b06c904e3 tempest-CreateVolumesFromImageTest-702184679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-6cfe6c6e-695f-4ba4-8d3b-5c95d22b1d45 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:26:32 devstack sudo[103903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-6cfe6c6e-695f-4ba4-8d3b-5c95d22b1d45 Aug 29 01:26:32 devstack sudo[103903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:26:32 devstack sudo[103896]: pam_unix(sudo:session): session closed for user root Aug 29 01:26:32 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-27c5bd21-dc27-429d-90c0-717e005982e5 tempest-TestStampPattern-1898898860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.272s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:26:32 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-27c5bd21-dc27-429d-90c0-717e005982e5 tempest-TestStampPattern-1898898860 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:26:32 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-27c5bd21-dc27-429d-90c0-717e005982e5 tempest-TestStampPattern-1898898860 None] Deleted volume successfully. Aug 29 01:26:32 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-27c5bd21-dc27-429d-90c0-717e005982e5 tempest-TestStampPattern-1898898860 None] Lock "cinder-bbb88808-57ba-485a-b283-1d127546cab3-delete_volume" released by "delete_volume" :: held 1.223s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:26:33 devstack sudo[103903]: pam_unix(sudo:session): session closed for user root Aug 29 01:26:33 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-11b1dc58-ea41-4daf-adb6-2e3b06c904e3 tempest-CreateVolumesFromImageTest-702184679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-6cfe6c6e-695f-4ba4-8d3b-5c95d22b1d45" returned: 0 in 0.284s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:26:33 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-11b1dc58-ea41-4daf-adb6-2e3b06c904e3 tempest-CreateVolumesFromImageTest-702184679 None] Lock "cinder-quobyte-6cfe6c6e-695f-4ba4-8d3b-5c95d22b1d45" released by "delete_volume" :: held 0.720s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:26:33 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-c2122672-dda5-4418-9039-a8dc26d6eadd tempest-TestStampPattern-1898898860 None] Acquiring lock "cinder-72c82354-11d8-4731-9c12-d794cec2ee18-delete_snapshot" by "delete_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:26:33 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-c2122672-dda5-4418-9039-a8dc26d6eadd tempest-TestStampPattern-1898898860 None] Lock "cinder-72c82354-11d8-4731-9c12-d794cec2ee18-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:26:33 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-c2122672-dda5-4418-9039-a8dc26d6eadd tempest-TestStampPattern-1898898860 None] Acquiring lock "cinder-quobyte-62dbe5e4-d990-45e8-a189-d8953e058264" by "delete_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:26:33 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-c2122672-dda5-4418-9039-a8dc26d6eadd tempest-TestStampPattern-1898898860 None] Lock "cinder-quobyte-62dbe5e4-d990-45e8-a189-d8953e058264" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:26:33 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-c2122672-dda5-4418-9039-a8dc26d6eadd tempest-TestStampPattern-1898898860 None] Acquiring lock "cinder-quobyte-72c82354-11d8-4731-9c12-d794cec2ee18" by "_delete_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:26:33 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-11b1dc58-ea41-4daf-adb6-2e3b06c904e3 tempest-CreateVolumesFromImageTest-702184679 None] Created reservations ['efdc3e12-4632-4da2-ae5c-f28b83d60c8c', 'fcae55f6-38ac-490d-a236-0525324fab42', 'a4502957-9f77-474d-8f90-9a476cf18956', 'a38c2936-1d62-4041-a7ce-c4382b90ec74'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:26:33 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-c2122672-dda5-4418-9039-a8dc26d6eadd tempest-TestStampPattern-1898898860 None] Lock "cinder-quobyte-72c82354-11d8-4731-9c12-d794cec2ee18" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:26:33 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-c2122672-dda5-4418-9039-a8dc26d6eadd tempest-TestStampPattern-1898898860 None] Deleting offline snapshot 72c82354-11d8-4731-9c12-d794cec2ee18 of volume 62dbe5e4-d990-45e8-a189-d8953e058264 {{(pid=86111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 29 01:26:33 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-c2122672-dda5-4418-9039-a8dc26d6eadd tempest-TestStampPattern-1898898860 None] snapshot_file for this snap is: volume-62dbe5e4-d990-45e8-a189-d8953e058264.72c82354-11d8-4731-9c12-d794cec2ee18 {{(pid=86111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 29 01:26:33 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb77ce0b-abf9-41ee-99ce-7978812ca8a2]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:26:33 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c2122672-dda5-4418-9039-a8dc26d6eadd tempest-TestStampPattern-1898898860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-62dbe5e4-d990-45e8-a189-d8953e058264.72c82354-11d8-4731-9c12-d794cec2ee18 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:26:33 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-11b1dc58-ea41-4daf-adb6-2e3b06c904e3 tempest-CreateVolumesFromImageTest-702184679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:26:33 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-11b1dc58-ea41-4daf-adb6-2e3b06c904e3 tempest-CreateVolumesFromImageTest-702184679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:26:33 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-11b1dc58-ea41-4daf-adb6-2e3b06c904e3 tempest-CreateVolumesFromImageTest-702184679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:26:33 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-11b1dc58-ea41-4daf-adb6-2e3b06c904e3 tempest-CreateVolumesFromImageTest-702184679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:26:33 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-11b1dc58-ea41-4daf-adb6-2e3b06c904e3 tempest-CreateVolumesFromImageTest-702184679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:26:33 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-11b1dc58-ea41-4daf-adb6-2e3b06c904e3 tempest-CreateVolumesFromImageTest-702184679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:26:33 devstack sudo[103907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:26:33 devstack sudo[103907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:26:33 devstack sudo[103906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-62dbe5e4-d990-45e8-a189-d8953e058264.72c82354-11d8-4731-9c12-d794cec2ee18 Aug 29 01:26:33 devstack sudo[103906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:26:33 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-0644046c-ce06-4d9f-b84b-d5d40760f35b tempest-CreateVolumesFromImageTest-702184679 None] Acquiring lock "cinder-526282f4-f68d-4822-ab83-d9a49dc06bf9-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:26:33 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-0644046c-ce06-4d9f-b84b-d5d40760f35b tempest-CreateVolumesFromImageTest-702184679 None] Lock "cinder-526282f4-f68d-4822-ab83-d9a49dc06bf9-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:26:33 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-0644046c-ce06-4d9f-b84b-d5d40760f35b tempest-CreateVolumesFromImageTest-702184679 None] Acquiring lock "cinder-quobyte-526282f4-f68d-4822-ab83-d9a49dc06bf9" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:26:33 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-0644046c-ce06-4d9f-b84b-d5d40760f35b tempest-CreateVolumesFromImageTest-702184679 None] Lock "cinder-quobyte-526282f4-f68d-4822-ab83-d9a49dc06bf9" acquired by "delete_volume" :: waited 0.021s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:26:33 devstack sudo[103907]: pam_unix(sudo:session): session closed for user root Aug 29 01:26:33 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-11b1dc58-ea41-4daf-adb6-2e3b06c904e3 tempest-CreateVolumesFromImageTest-702184679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.281s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:26:33 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-11b1dc58-ea41-4daf-adb6-2e3b06c904e3 tempest-CreateVolumesFromImageTest-702184679 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:26:33 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-11b1dc58-ea41-4daf-adb6-2e3b06c904e3 tempest-CreateVolumesFromImageTest-702184679 None] Deleted volume successfully. Aug 29 01:26:33 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[a68a4d78-943b-4c48-89f5-2337e1f128ac]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:26:33 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-0644046c-ce06-4d9f-b84b-d5d40760f35b tempest-CreateVolumesFromImageTest-702184679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-526282f4-f68d-4822-ab83-d9a49dc06bf9 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:26:33 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-11b1dc58-ea41-4daf-adb6-2e3b06c904e3 tempest-CreateVolumesFromImageTest-702184679 None] Lock "cinder-6cfe6c6e-695f-4ba4-8d3b-5c95d22b1d45-delete_volume" released by "delete_volume" :: held 1.320s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:26:33 devstack sudo[103906]: pam_unix(sudo:session): session closed for user root Aug 29 01:26:33 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c2122672-dda5-4418-9039-a8dc26d6eadd tempest-TestStampPattern-1898898860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-62dbe5e4-d990-45e8-a189-d8953e058264.72c82354-11d8-4731-9c12-d794cec2ee18" returned: 0 in 0.417s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:26:33 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-c2122672-dda5-4418-9039-a8dc26d6eadd tempest-TestStampPattern-1898898860 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-62dbe5e4-d990-45e8-a189-d8953e058264(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 29 01:26:33 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[621e1fe6-383c-487d-8ef3-e535952e6e7d]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:26:33 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c2122672-dda5-4418-9039-a8dc26d6eadd tempest-TestStampPattern-1898898860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-62dbe5e4-d990-45e8-a189-d8953e058264 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:26:33 devstack sudo[103915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-526282f4-f68d-4822-ab83-d9a49dc06bf9 Aug 29 01:26:33 devstack sudo[103915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:26:33 devstack sudo[103916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-62dbe5e4-d990-45e8-a189-d8953e058264 Aug 29 01:26:33 devstack sudo[103916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:26:34 devstack sudo[103915]: pam_unix(sudo:session): session closed for user root Aug 29 01:26:34 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-0644046c-ce06-4d9f-b84b-d5d40760f35b tempest-CreateVolumesFromImageTest-702184679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-526282f4-f68d-4822-ab83-d9a49dc06bf9" returned: 0 in 0.382s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:26:34 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-0644046c-ce06-4d9f-b84b-d5d40760f35b tempest-CreateVolumesFromImageTest-702184679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-526282f4-f68d-4822-ab83-d9a49dc06bf9 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:26:34 devstack sudo[103924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-526282f4-f68d-4822-ab83-d9a49dc06bf9 Aug 29 01:26:34 devstack sudo[103924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:26:34 devstack sudo[103916]: pam_unix(sudo:session): session closed for user root Aug 29 01:26:34 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c2122672-dda5-4418-9039-a8dc26d6eadd tempest-TestStampPattern-1898898860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-62dbe5e4-d990-45e8-a189-d8953e058264" returned: 0 in 0.518s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:26:34 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c2122672-dda5-4418-9039-a8dc26d6eadd tempest-TestStampPattern-1898898860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-62dbe5e4-d990-45e8-a189-d8953e058264.72c82354-11d8-4731-9c12-d794cec2ee18 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:26:34 devstack sudo[103927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-62dbe5e4-d990-45e8-a189-d8953e058264.72c82354-11d8-4731-9c12-d794cec2ee18 Aug 29 01:26:34 devstack sudo[103927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:26:34 devstack sudo[103924]: pam_unix(sudo:session): session closed for user root Aug 29 01:26:34 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-0644046c-ce06-4d9f-b84b-d5d40760f35b tempest-CreateVolumesFromImageTest-702184679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-526282f4-f68d-4822-ab83-d9a49dc06bf9" returned: 0 in 0.254s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:26:34 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-0644046c-ce06-4d9f-b84b-d5d40760f35b tempest-CreateVolumesFromImageTest-702184679 None] Lock "cinder-quobyte-526282f4-f68d-4822-ab83-d9a49dc06bf9" released by "delete_volume" :: held 0.696s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:26:34 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-0644046c-ce06-4d9f-b84b-d5d40760f35b tempest-CreateVolumesFromImageTest-702184679 None] Created reservations ['9efdef7a-48a6-48bb-95b9-4f8ab961943d', '21a3b68f-780a-4302-973c-82ded93ec808', 'ab25e31e-2774-4ca6-8567-939b632d3369', '9579bfa8-ca96-4f05-b7e5-8cac2db90085'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:26:34 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-0644046c-ce06-4d9f-b84b-d5d40760f35b tempest-CreateVolumesFromImageTest-702184679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:26:34 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-0644046c-ce06-4d9f-b84b-d5d40760f35b tempest-CreateVolumesFromImageTest-702184679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:26:34 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-0644046c-ce06-4d9f-b84b-d5d40760f35b tempest-CreateVolumesFromImageTest-702184679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:26:34 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-0644046c-ce06-4d9f-b84b-d5d40760f35b tempest-CreateVolumesFromImageTest-702184679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:26:34 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-0644046c-ce06-4d9f-b84b-d5d40760f35b tempest-CreateVolumesFromImageTest-702184679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:26:34 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-0644046c-ce06-4d9f-b84b-d5d40760f35b tempest-CreateVolumesFromImageTest-702184679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:26:34 devstack sudo[103930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:26:34 devstack sudo[103930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:26:34 devstack sudo[103927]: pam_unix(sudo:session): session closed for user root Aug 29 01:26:34 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c2122672-dda5-4418-9039-a8dc26d6eadd tempest-TestStampPattern-1898898860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-62dbe5e4-d990-45e8-a189-d8953e058264.72c82354-11d8-4731-9c12-d794cec2ee18" returned: 0 in 0.360s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:26:34 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c2122672-dda5-4418-9039-a8dc26d6eadd tempest-TestStampPattern-1898898860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-62dbe5e4-d990-45e8-a189-d8953e058264.72c82354-11d8-4731-9c12-d794cec2ee18 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:26:34 devstack sudo[103936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-62dbe5e4-d990-45e8-a189-d8953e058264.72c82354-11d8-4731-9c12-d794cec2ee18 Aug 29 01:26:34 devstack sudo[103936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:26:34 devstack sudo[103930]: pam_unix(sudo:session): session closed for user root Aug 29 01:26:34 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-0644046c-ce06-4d9f-b84b-d5d40760f35b tempest-CreateVolumesFromImageTest-702184679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.279s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:26:34 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-0644046c-ce06-4d9f-b84b-d5d40760f35b tempest-CreateVolumesFromImageTest-702184679 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:26:34 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-0644046c-ce06-4d9f-b84b-d5d40760f35b tempest-CreateVolumesFromImageTest-702184679 None] Deleted volume successfully. Aug 29 01:26:34 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-0644046c-ce06-4d9f-b84b-d5d40760f35b tempest-CreateVolumesFromImageTest-702184679 None] Lock "cinder-526282f4-f68d-4822-ab83-d9a49dc06bf9-delete_volume" released by "delete_volume" :: held 1.198s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:26:34 devstack sudo[103936]: pam_unix(sudo:session): session closed for user root Aug 29 01:26:34 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c2122672-dda5-4418-9039-a8dc26d6eadd tempest-TestStampPattern-1898898860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-62dbe5e4-d990-45e8-a189-d8953e058264.72c82354-11d8-4731-9c12-d794cec2ee18" returned: 0 in 0.255s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:26:34 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-c2122672-dda5-4418-9039-a8dc26d6eadd tempest-TestStampPattern-1898898860 None] Lock "cinder-quobyte-72c82354-11d8-4731-9c12-d794cec2ee18" released by "_delete_snapshot" :: held 1.649s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:26:34 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-c2122672-dda5-4418-9039-a8dc26d6eadd tempest-TestStampPattern-1898898860 None] Lock "cinder-quobyte-62dbe5e4-d990-45e8-a189-d8953e058264" released by "delete_snapshot" :: held 1.676s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:26:34 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-c2122672-dda5-4418-9039-a8dc26d6eadd tempest-TestStampPattern-1898898860 None] Created reservations ['0236f806-1180-4b46-bcad-e2d4a309be54', 'a25b8326-b409-48c4-a45c-ad366e7d1b0f', 'b4a971a6-3d8f-4131-93a2-ee9d8995c88f', 'c782f205-3214-421c-ba61-c38a9d9889d3'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:26:34 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-c2122672-dda5-4418-9039-a8dc26d6eadd tempest-TestStampPattern-1898898860 None] Delete snapshot completed successfully. Aug 29 01:26:34 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-c2122672-dda5-4418-9039-a8dc26d6eadd tempest-TestStampPattern-1898898860 None] Lock "cinder-72c82354-11d8-4731-9c12-d794cec2ee18-delete_snapshot" released by "delete_snapshot" :: held 1.816s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:26:38 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-32f18a33-63a8-4ab3-a7f8-c02598211e1b tempest-VolumeDependencyTests-449359766 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:26:38 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-32f18a33-63a8-4ab3-a7f8-c02598211e1b tempest-VolumeDependencyTests-449359766 None] Flow 'volume_create_manager' (eace7b9f-739d-4380-9da7-0c6f3c27005e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:26:38 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-32f18a33-63a8-4ab3-a7f8-c02598211e1b tempest-VolumeDependencyTests-449359766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (303de019-ee36-4b2b-aa68-5173bf702a7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:26:38 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-32f18a33-63a8-4ab3-a7f8-c02598211e1b tempest-VolumeDependencyTests-449359766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (303de019-ee36-4b2b-aa68-5173bf702a7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:26:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1184382583',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66ea3541-97b8-47ac-b6ce-53b2420b6894,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ed7b22f68c14304b042a50ed6fd47d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:26:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:26:38Z,use_quota=True,user_id='4714f0b972f0480ba184e80031b8fd08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:26:38 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-32f18a33-63a8-4ab3-a7f8-c02598211e1b tempest-VolumeDependencyTests-449359766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d1a0ca7-e5ba-454e-ad2b-2ece0814db49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:26:38 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-32f18a33-63a8-4ab3-a7f8-c02598211e1b tempest-VolumeDependencyTests-449359766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d1a0ca7-e5ba-454e-ad2b-2ece0814db49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:26:38 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-32f18a33-63a8-4ab3-a7f8-c02598211e1b tempest-VolumeDependencyTests-449359766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (947b4802-08cf-4753-a890-0b0bf9c2c849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:26:38 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-32f18a33-63a8-4ab3-a7f8-c02598211e1b tempest-VolumeDependencyTests-449359766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (947b4802-08cf-4753-a890-0b0bf9c2c849) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66ea3541-97b8-47ac-b6ce-53b2420b6894', 'volume_name': 'volume-66ea3541-97b8-47ac-b6ce-53b2420b6894', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:26:38 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-32f18a33-63a8-4ab3-a7f8-c02598211e1b tempest-VolumeDependencyTests-449359766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac95061a-ad9b-4e0e-86e9-970a6c4af83e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:26:38 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-32f18a33-63a8-4ab3-a7f8-c02598211e1b tempest-VolumeDependencyTests-449359766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac95061a-ad9b-4e0e-86e9-970a6c4af83e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:26:38 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-32f18a33-63a8-4ab3-a7f8-c02598211e1b tempest-VolumeDependencyTests-449359766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7520eeab-8124-4952-9372-2c78ddc0d561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:26:38 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-32f18a33-63a8-4ab3-a7f8-c02598211e1b tempest-VolumeDependencyTests-449359766 None] Volume 66ea3541-97b8-47ac-b6ce-53b2420b6894: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66ea3541-97b8-47ac-b6ce-53b2420b6894', 'volume_size': 1} Aug 29 01:26:38 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-32f18a33-63a8-4ab3-a7f8-c02598211e1b tempest-VolumeDependencyTests-449359766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:26:38 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-32f18a33-63a8-4ab3-a7f8-c02598211e1b tempest-VolumeDependencyTests-449359766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:26:38 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-32f18a33-63a8-4ab3-a7f8-c02598211e1b tempest-VolumeDependencyTests-449359766 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:26:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1184382583',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66ea3541-97b8-47ac-b6ce-53b2420b6894,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ed7b22f68c14304b042a50ed6fd47d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:26:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:26:38Z,use_quota=True,user_id='4714f0b972f0480ba184e80031b8fd08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:26:38 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-32f18a33-63a8-4ab3-a7f8-c02598211e1b tempest-VolumeDependencyTests-449359766 None] Creating volume 66ea3541-97b8-47ac-b6ce-53b2420b6894 {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:26:38 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-32f18a33-63a8-4ab3-a7f8-c02598211e1b tempest-VolumeDependencyTests-449359766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:26:38 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-32f18a33-63a8-4ab3-a7f8-c02598211e1b tempest-VolumeDependencyTests-449359766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:26:38 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-32f18a33-63a8-4ab3-a7f8-c02598211e1b tempest-VolumeDependencyTests-449359766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:26:38 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-32f18a33-63a8-4ab3-a7f8-c02598211e1b tempest-VolumeDependencyTests-449359766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:26:38 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-32f18a33-63a8-4ab3-a7f8-c02598211e1b tempest-VolumeDependencyTests-449359766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:26:38 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-32f18a33-63a8-4ab3-a7f8-c02598211e1b tempest-VolumeDependencyTests-449359766 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:26:38 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-32f18a33-63a8-4ab3-a7f8-c02598211e1b tempest-VolumeDependencyTests-449359766 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:26:38 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-32f18a33-63a8-4ab3-a7f8-c02598211e1b tempest-VolumeDependencyTests-449359766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-66ea3541-97b8-47ac-b6ce-53b2420b6894 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:26:38 devstack sudo[103966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-66ea3541-97b8-47ac-b6ce-53b2420b6894 1073741824 Aug 29 01:26:38 devstack sudo[103966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:26:38 devstack sudo[103966]: pam_unix(sudo:session): session closed for user root Aug 29 01:26:38 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-32f18a33-63a8-4ab3-a7f8-c02598211e1b tempest-VolumeDependencyTests-449359766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-66ea3541-97b8-47ac-b6ce-53b2420b6894 1073741824" returned: 0 in 0.409s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:26:38 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-32f18a33-63a8-4ab3-a7f8-c02598211e1b tempest-VolumeDependencyTests-449359766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-66ea3541-97b8-47ac-b6ce-53b2420b6894 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:26:38 devstack sudo[103972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-66ea3541-97b8-47ac-b6ce-53b2420b6894 Aug 29 01:26:38 devstack sudo[103972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:26:38 devstack sudo[103972]: pam_unix(sudo:session): session closed for user root Aug 29 01:26:38 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-32f18a33-63a8-4ab3-a7f8-c02598211e1b tempest-VolumeDependencyTests-449359766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-66ea3541-97b8-47ac-b6ce-53b2420b6894" returned: 0 in 0.254s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:26:38 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-32f18a33-63a8-4ab3-a7f8-c02598211e1b tempest-VolumeDependencyTests-449359766 None] <== create_volume: return (701ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:26:38 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-32f18a33-63a8-4ab3-a7f8-c02598211e1b tempest-VolumeDependencyTests-449359766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.704s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:26:38 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-32f18a33-63a8-4ab3-a7f8-c02598211e1b tempest-VolumeDependencyTests-449359766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7520eeab-8124-4952-9372-2c78ddc0d561) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66ea3541-97b8-47ac-b6ce-53b2420b6894', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:26:38 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-32f18a33-63a8-4ab3-a7f8-c02598211e1b tempest-VolumeDependencyTests-449359766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aecab89a-fe53-4ec8-8456-bc749fef4990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:26:38 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-5944e94d-ab91-4b04-b173-3d559ec1c809 tempest-TestStampPattern-1898898860 None] Acquiring lock "cinder-62dbe5e4-d990-45e8-a189-d8953e058264-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:26:38 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-32f18a33-63a8-4ab3-a7f8-c02598211e1b tempest-VolumeDependencyTests-449359766 None] Volume volume-66ea3541-97b8-47ac-b6ce-53b2420b6894 (66ea3541-97b8-47ac-b6ce-53b2420b6894): created successfully Aug 29 01:26:38 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-32f18a33-63a8-4ab3-a7f8-c02598211e1b tempest-VolumeDependencyTests-449359766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aecab89a-fe53-4ec8-8456-bc749fef4990) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:26:38 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-32f18a33-63a8-4ab3-a7f8-c02598211e1b tempest-VolumeDependencyTests-449359766 None] Flow 'volume_create_manager' (eace7b9f-739d-4380-9da7-0c6f3c27005e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:26:39 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-5944e94d-ab91-4b04-b173-3d559ec1c809 tempest-TestStampPattern-1898898860 None] Lock "cinder-62dbe5e4-d990-45e8-a189-d8953e058264-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:26:39 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-32f18a33-63a8-4ab3-a7f8-c02598211e1b tempest-VolumeDependencyTests-449359766 None] Created volume successfully. Aug 29 01:26:39 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-5944e94d-ab91-4b04-b173-3d559ec1c809 tempest-TestStampPattern-1898898860 None] Acquiring lock "cinder-quobyte-62dbe5e4-d990-45e8-a189-d8953e058264" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:26:39 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-5944e94d-ab91-4b04-b173-3d559ec1c809 tempest-TestStampPattern-1898898860 None] Lock "cinder-quobyte-62dbe5e4-d990-45e8-a189-d8953e058264" acquired by "delete_volume" :: waited 0.014s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:26:39 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd73d85e-45f1-45a2-b95e-21693d1feb19]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:26:39 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-5944e94d-ab91-4b04-b173-3d559ec1c809 tempest-TestStampPattern-1898898860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-62dbe5e4-d990-45e8-a189-d8953e058264 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:26:39 devstack sudo[103975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-62dbe5e4-d990-45e8-a189-d8953e058264 Aug 29 01:26:39 devstack sudo[103975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:26:39 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-e0df5df7-e5cd-4c6f-9257-43f9df481e12 tempest-VolumeDependencyTests-449359766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:26:39 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-e0df5df7-e5cd-4c6f-9257-43f9df481e12 tempest-VolumeDependencyTests-449359766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:26:39 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-e0df5df7-e5cd-4c6f-9257-43f9df481e12 tempest-VolumeDependencyTests-449359766 None] Creating offline snapshot 8e824bd0-7513-4c7a-bf11-9449610b4bea of volume 66ea3541-97b8-47ac-b6ce-53b2420b6894 {{(pid=86111) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 29 01:26:39 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe5f7929-34e6-4f76-9e75-e903cb95e571]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:26:39 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-e0df5df7-e5cd-4c6f-9257-43f9df481e12 tempest-VolumeDependencyTests-449359766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-66ea3541-97b8-47ac-b6ce-53b2420b6894 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:26:39 devstack sudo[103975]: pam_unix(sudo:session): session closed for user root Aug 29 01:26:39 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-5944e94d-ab91-4b04-b173-3d559ec1c809 tempest-TestStampPattern-1898898860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-62dbe5e4-d990-45e8-a189-d8953e058264" returned: 0 in 0.375s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:26:39 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-5944e94d-ab91-4b04-b173-3d559ec1c809 tempest-TestStampPattern-1898898860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-62dbe5e4-d990-45e8-a189-d8953e058264 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:26:39 devstack sudo[103982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-62dbe5e4-d990-45e8-a189-d8953e058264 Aug 29 01:26:39 devstack sudo[103982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:26:39 devstack sudo[103978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-66ea3541-97b8-47ac-b6ce-53b2420b6894 Aug 29 01:26:39 devstack sudo[103978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:26:39 devstack sudo[103982]: pam_unix(sudo:session): session closed for user root Aug 29 01:26:39 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-5944e94d-ab91-4b04-b173-3d559ec1c809 tempest-TestStampPattern-1898898860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-62dbe5e4-d990-45e8-a189-d8953e058264" returned: 0 in 0.254s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:26:39 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-5944e94d-ab91-4b04-b173-3d559ec1c809 tempest-TestStampPattern-1898898860 None] Lock "cinder-quobyte-62dbe5e4-d990-45e8-a189-d8953e058264" released by "delete_volume" :: held 0.693s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:26:39 devstack sudo[103978]: pam_unix(sudo:session): session closed for user root Aug 29 01:26:39 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-e0df5df7-e5cd-4c6f-9257-43f9df481e12 tempest-VolumeDependencyTests-449359766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-66ea3541-97b8-47ac-b6ce-53b2420b6894" returned: 0 in 0.372s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:26:39 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-e0df5df7-e5cd-4c6f-9257-43f9df481e12 tempest-VolumeDependencyTests-449359766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-66ea3541-97b8-47ac-b6ce-53b2420b6894,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-66ea3541-97b8-47ac-b6ce-53b2420b6894.8e824bd0-7513-4c7a-bf11-9449610b4bea 1G {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:26:39 devstack sudo[103989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-66ea3541-97b8-47ac-b6ce-53b2420b6894,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-66ea3541-97b8-47ac-b6ce-53b2420b6894.8e824bd0-7513-4c7a-bf11-9449610b4bea 1G Aug 29 01:26:39 devstack sudo[103989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:26:39 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-5944e94d-ab91-4b04-b173-3d559ec1c809 tempest-TestStampPattern-1898898860 None] Created reservations ['91210da8-5b80-42e4-b5f1-368e210ac139', '920982c1-26bb-47e7-bb16-5e62b569279e', '47e29096-a0a6-4fb9-9d16-6e4288290b90', 'df752e1a-dd8a-44c0-9b8a-d86e96a14703'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:26:39 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-5944e94d-ab91-4b04-b173-3d559ec1c809 tempest-TestStampPattern-1898898860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:26:39 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-5944e94d-ab91-4b04-b173-3d559ec1c809 tempest-TestStampPattern-1898898860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:26:39 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-5944e94d-ab91-4b04-b173-3d559ec1c809 tempest-TestStampPattern-1898898860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:26:39 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-5944e94d-ab91-4b04-b173-3d559ec1c809 tempest-TestStampPattern-1898898860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:26:39 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-5944e94d-ab91-4b04-b173-3d559ec1c809 tempest-TestStampPattern-1898898860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:26:39 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-5944e94d-ab91-4b04-b173-3d559ec1c809 tempest-TestStampPattern-1898898860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:26:39 devstack sudo[103991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:26:39 devstack sudo[103991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:26:40 devstack sudo[103991]: pam_unix(sudo:session): session closed for user root Aug 29 01:26:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-5944e94d-ab91-4b04-b173-3d559ec1c809 tempest-TestStampPattern-1898898860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.275s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:26:40 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-5944e94d-ab91-4b04-b173-3d559ec1c809 tempest-TestStampPattern-1898898860 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:26:40 devstack sudo[103989]: pam_unix(sudo:session): session closed for user root Aug 29 01:26:40 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-5944e94d-ab91-4b04-b173-3d559ec1c809 tempest-TestStampPattern-1898898860 None] Deleted volume successfully. Aug 29 01:26:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-e0df5df7-e5cd-4c6f-9257-43f9df481e12 tempest-VolumeDependencyTests-449359766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-66ea3541-97b8-47ac-b6ce-53b2420b6894,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-66ea3541-97b8-47ac-b6ce-53b2420b6894.8e824bd0-7513-4c7a-bf11-9449610b4bea 1G" returned: 0 in 0.416s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:26:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-e0df5df7-e5cd-4c6f-9257-43f9df481e12 tempest-VolumeDependencyTests-449359766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66ea3541-97b8-47ac-b6ce-53b2420b6894 -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-66ea3541-97b8-47ac-b6ce-53b2420b6894.8e824bd0-7513-4c7a-bf11-9449610b4bea {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:26:40 devstack sudo[103998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66ea3541-97b8-47ac-b6ce-53b2420b6894 -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-66ea3541-97b8-47ac-b6ce-53b2420b6894.8e824bd0-7513-4c7a-bf11-9449610b4bea Aug 29 01:26:40 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-5944e94d-ab91-4b04-b173-3d559ec1c809 tempest-TestStampPattern-1898898860 None] Lock "cinder-62dbe5e4-d990-45e8-a189-d8953e058264-delete_volume" released by "delete_volume" :: held 1.196s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:26:40 devstack sudo[103998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:26:40 devstack sudo[103998]: pam_unix(sudo:session): session closed for user root Aug 29 01:26:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-e0df5df7-e5cd-4c6f-9257-43f9df481e12 tempest-VolumeDependencyTests-449359766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66ea3541-97b8-47ac-b6ce-53b2420b6894 -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-66ea3541-97b8-47ac-b6ce-53b2420b6894.8e824bd0-7513-4c7a-bf11-9449610b4bea" returned: 0 in 0.340s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:26:40 devstack cinder-volume[86111]: WARNING cinder.volume.drivers.remotefs [None req-e0df5df7-e5cd-4c6f-9257-43f9df481e12 tempest-VolumeDependencyTests-449359766 None] /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-66ea3541-97b8-47ac-b6ce-53b2420b6894.8e824bd0-7513-4c7a-bf11-9449610b4bea is being set with open permissions: ugo+rw Aug 29 01:26:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-e0df5df7-e5cd-4c6f-9257-43f9df481e12 tempest-VolumeDependencyTests-449359766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-66ea3541-97b8-47ac-b6ce-53b2420b6894.8e824bd0-7513-4c7a-bf11-9449610b4bea {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:26:40 devstack sudo[104003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-66ea3541-97b8-47ac-b6ce-53b2420b6894.8e824bd0-7513-4c7a-bf11-9449610b4bea Aug 29 01:26:40 devstack sudo[104003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:26:40 devstack sudo[104003]: pam_unix(sudo:session): session closed for user root Aug 29 01:26:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-e0df5df7-e5cd-4c6f-9257-43f9df481e12 tempest-VolumeDependencyTests-449359766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-66ea3541-97b8-47ac-b6ce-53b2420b6894.8e824bd0-7513-4c7a-bf11-9449610b4bea" returned: 0 in 0.255s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:26:40 devstack cinder-volume[86111]: DEBUG oslo_service.periodic_task [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86111) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 29 01:26:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:26:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:26:40 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:26:40 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:26:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:26:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:26:40 devstack sudo[104006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:26:40 devstack sudo[104006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:26:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-e0df5df7-e5cd-4c6f-9257-43f9df481e12 tempest-VolumeDependencyTests-449359766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-66ea3541-97b8-47ac-b6ce-53b2420b6894.info {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:26:40 devstack sudo[104008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-66ea3541-97b8-47ac-b6ce-53b2420b6894.info Aug 29 01:26:40 devstack sudo[104008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:26:41 devstack sudo[104006]: pam_unix(sudo:session): session closed for user root Aug 29 01:26:41 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-de752545-d617-440e-8362-d04fae0901a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.267s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:26:41 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:26:41 devstack cinder-volume[86111]: DEBUG oslo_service.periodic_task [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Running periodic task VolumeManager._thread_info {{(pid=86111) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 29 01:26:41 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-de752545-d617-440e-8362-d04fae0901a5 None None] thread count: 28 {{(pid=86111) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 29 01:26:41 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-de752545-d617-440e-8362-d04fae0901a5 None None] thread info: [<_MainThread(MainThread, started 129173440548992)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86111) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 29 01:26:41 devstack sudo[104008]: pam_unix(sudo:session): session closed for user root Aug 29 01:26:41 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-e0df5df7-e5cd-4c6f-9257-43f9df481e12 tempest-VolumeDependencyTests-449359766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-66ea3541-97b8-47ac-b6ce-53b2420b6894.info" returned: 0 in 0.275s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:26:41 devstack cinder-volume[86111]: WARNING cinder.volume.drivers.remotefs [None req-e0df5df7-e5cd-4c6f-9257-43f9df481e12 tempest-VolumeDependencyTests-449359766 None] /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-66ea3541-97b8-47ac-b6ce-53b2420b6894.info is being set with open permissions: ugo+rw Aug 29 01:26:41 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-e0df5df7-e5cd-4c6f-9257-43f9df481e12 tempest-VolumeDependencyTests-449359766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-66ea3541-97b8-47ac-b6ce-53b2420b6894.info {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:26:41 devstack sudo[104012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-66ea3541-97b8-47ac-b6ce-53b2420b6894.info Aug 29 01:26:41 devstack sudo[104012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:26:41 devstack sudo[104012]: pam_unix(sudo:session): session closed for user root Aug 29 01:26:41 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-e0df5df7-e5cd-4c6f-9257-43f9df481e12 tempest-VolumeDependencyTests-449359766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-66ea3541-97b8-47ac-b6ce-53b2420b6894.info" returned: 0 in 0.266s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:26:41 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-e0df5df7-e5cd-4c6f-9257-43f9df481e12 tempest-VolumeDependencyTests-449359766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.047s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:26:41 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-e0df5df7-e5cd-4c6f-9257-43f9df481e12 tempest-VolumeDependencyTests-449359766 None] Create snapshot completed successfully Aug 29 01:26:43 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-722e07e3-89f1-47bd-a898-d25fa28077a8 tempest-VolumeDependencyTests-449359766 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:26:43 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-722e07e3-89f1-47bd-a898-d25fa28077a8 tempest-VolumeDependencyTests-449359766 None] Flow 'volume_create_manager' (dec58204-0864-4a8a-8a43-888e72e5a3c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:26:43 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-722e07e3-89f1-47bd-a898-d25fa28077a8 tempest-VolumeDependencyTests-449359766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdf068e9-f36f-44a4-b67a-1909e65ffb4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:26:43 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-722e07e3-89f1-47bd-a898-d25fa28077a8 tempest-VolumeDependencyTests-449359766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdf068e9-f36f-44a4-b67a-1909e65ffb4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:26:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1701691792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec876d64-083b-4fdb-bc48-8fc2c64b3ea8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ed7b22f68c14304b042a50ed6fd47d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:26:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8e824bd0-7513-4c7a-bf11-9449610b4bea,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:26:43Z,use_quota=True,user_id='4714f0b972f0480ba184e80031b8fd08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:26:43 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-722e07e3-89f1-47bd-a898-d25fa28077a8 tempest-VolumeDependencyTests-449359766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (700ea60f-f14e-4140-86af-210af7f860dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:26:43 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-722e07e3-89f1-47bd-a898-d25fa28077a8 tempest-VolumeDependencyTests-449359766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (700ea60f-f14e-4140-86af-210af7f860dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:26:43 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-722e07e3-89f1-47bd-a898-d25fa28077a8 tempest-VolumeDependencyTests-449359766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (660cccc3-61e4-45ed-816b-5f42044f3fb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:26:43 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-722e07e3-89f1-47bd-a898-d25fa28077a8 tempest-VolumeDependencyTests-449359766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (660cccc3-61e4-45ed-816b-5f42044f3fb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ec876d64-083b-4fdb-bc48-8fc2c64b3ea8', 'volume_name': 'volume-ec876d64-083b-4fdb-bc48-8fc2c64b3ea8', 'volume_size': 1, 'snapshot_id': '8e824bd0-7513-4c7a-bf11-9449610b4bea'}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:26:43 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-722e07e3-89f1-47bd-a898-d25fa28077a8 tempest-VolumeDependencyTests-449359766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5b42fad-ed6d-441c-b538-6774a22690bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:26:43 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-722e07e3-89f1-47bd-a898-d25fa28077a8 tempest-VolumeDependencyTests-449359766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5b42fad-ed6d-441c-b538-6774a22690bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:26:43 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-722e07e3-89f1-47bd-a898-d25fa28077a8 tempest-VolumeDependencyTests-449359766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32c142e4-a8e2-4aec-b3bd-bb74774d9cf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:26:43 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-722e07e3-89f1-47bd-a898-d25fa28077a8 tempest-VolumeDependencyTests-449359766 None] Volume ec876d64-083b-4fdb-bc48-8fc2c64b3ea8: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ec876d64-083b-4fdb-bc48-8fc2c64b3ea8', 'volume_size': 1, 'snapshot_id': '8e824bd0-7513-4c7a-bf11-9449610b4bea'} Aug 29 01:26:43 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-722e07e3-89f1-47bd-a898-d25fa28077a8 tempest-VolumeDependencyTests-449359766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:26:43 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-722e07e3-89f1-47bd-a898-d25fa28077a8 tempest-VolumeDependencyTests-449359766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:26:43 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-722e07e3-89f1-47bd-a898-d25fa28077a8 tempest-VolumeDependencyTests-449359766 None] Acquiring lock "cinder-quobyte-8e824bd0-7513-4c7a-bf11-9449610b4bea-ec876d64-083b-4fdb-bc48-8fc2c64b3ea8" by "_create_volume_from_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:26:43 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-722e07e3-89f1-47bd-a898-d25fa28077a8 tempest-VolumeDependencyTests-449359766 None] Lock "cinder-quobyte-8e824bd0-7513-4c7a-bf11-9449610b4bea-ec876d64-083b-4fdb-bc48-8fc2c64b3ea8" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:26:43 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-722e07e3-89f1-47bd-a898-d25fa28077a8 tempest-VolumeDependencyTests-449359766 None] Creating volume ec876d64-083b-4fdb-bc48-8fc2c64b3ea8 from snapshot 8e824bd0-7513-4c7a-bf11-9449610b4bea {{(pid=86111) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Aug 29 01:26:43 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-722e07e3-89f1-47bd-a898-d25fa28077a8 tempest-VolumeDependencyTests-449359766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:26:43 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-722e07e3-89f1-47bd-a898-d25fa28077a8 tempest-VolumeDependencyTests-449359766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:26:43 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-722e07e3-89f1-47bd-a898-d25fa28077a8 tempest-VolumeDependencyTests-449359766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:26:43 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-722e07e3-89f1-47bd-a898-d25fa28077a8 tempest-VolumeDependencyTests-449359766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:26:43 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-722e07e3-89f1-47bd-a898-d25fa28077a8 tempest-VolumeDependencyTests-449359766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:26:43 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-722e07e3-89f1-47bd-a898-d25fa28077a8 tempest-VolumeDependencyTests-449359766 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:26:43 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-722e07e3-89f1-47bd-a898-d25fa28077a8 tempest-VolumeDependencyTests-449359766 None] Acquiring lock "cinder-quobyte-ec876d64-083b-4fdb-bc48-8fc2c64b3ea8" by "_copy_volume_from_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:26:43 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-722e07e3-89f1-47bd-a898-d25fa28077a8 tempest-VolumeDependencyTests-449359766 None] Lock "cinder-quobyte-ec876d64-083b-4fdb-bc48-8fc2c64b3ea8" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:26:43 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-722e07e3-89f1-47bd-a898-d25fa28077a8 tempest-VolumeDependencyTests-449359766 None] snapshot: 8e824bd0-7513-4c7a-bf11-9449610b4bea, volume: ec876d64-083b-4fdb-bc48-8fc2c64b3ea8, {{(pid=86111) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 29 01:26:43 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-722e07e3-89f1-47bd-a898-d25fa28077a8 tempest-VolumeDependencyTests-449359766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:26:43 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-722e07e3-89f1-47bd-a898-d25fa28077a8 tempest-VolumeDependencyTests-449359766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:26:43 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-722e07e3-89f1-47bd-a898-d25fa28077a8 tempest-VolumeDependencyTests-449359766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:26:43 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-722e07e3-89f1-47bd-a898-d25fa28077a8 tempest-VolumeDependencyTests-449359766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:26:43 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-722e07e3-89f1-47bd-a898-d25fa28077a8 tempest-VolumeDependencyTests-449359766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:26:43 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[40366e17-8cda-41ca-9516-1bac96763007]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:26:43 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-722e07e3-89f1-47bd-a898-d25fa28077a8 tempest-VolumeDependencyTests-449359766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-66ea3541-97b8-47ac-b6ce-53b2420b6894.8e824bd0-7513-4c7a-bf11-9449610b4bea {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:26:43 devstack sudo[104017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-66ea3541-97b8-47ac-b6ce-53b2420b6894.8e824bd0-7513-4c7a-bf11-9449610b4bea Aug 29 01:26:43 devstack sudo[104017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:26:43 devstack sudo[104017]: pam_unix(sudo:session): session closed for user root Aug 29 01:26:43 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-722e07e3-89f1-47bd-a898-d25fa28077a8 tempest-VolumeDependencyTests-449359766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-66ea3541-97b8-47ac-b6ce-53b2420b6894.8e824bd0-7513-4c7a-bf11-9449610b4bea" returned: 0 in 0.359s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:26:43 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-722e07e3-89f1-47bd-a898-d25fa28077a8 tempest-VolumeDependencyTests-449359766 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-66ea3541-97b8-47ac-b6ce-53b2420b6894(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 29 01:26:43 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[a795c0eb-202d-456f-908b-223dafd745be]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:26:43 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-722e07e3-89f1-47bd-a898-d25fa28077a8 tempest-VolumeDependencyTests-449359766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-66ea3541-97b8-47ac-b6ce-53b2420b6894 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:26:43 devstack sudo[104022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-66ea3541-97b8-47ac-b6ce-53b2420b6894 Aug 29 01:26:43 devstack sudo[104022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:26:44 devstack sudo[104022]: pam_unix(sudo:session): session closed for user root Aug 29 01:26:44 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-722e07e3-89f1-47bd-a898-d25fa28077a8 tempest-VolumeDependencyTests-449359766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-66ea3541-97b8-47ac-b6ce-53b2420b6894" returned: 0 in 0.400s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:26:44 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-722e07e3-89f1-47bd-a898-d25fa28077a8 tempest-VolumeDependencyTests-449359766 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-66ea3541-97b8-47ac-b6ce-53b2420b6894 {{(pid=86111) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 29 01:26:44 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-722e07e3-89f1-47bd-a898-d25fa28077a8 tempest-VolumeDependencyTests-449359766 None] Creating direct copy from snapshot {{(pid=86111) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 29 01:26:44 devstack cinder-volume[86111]: DEBUG cinder.utils [None req-722e07e3-89f1-47bd-a898-d25fa28077a8 tempest-VolumeDependencyTests-449359766 None] Path /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ec876d64-083b-4fdb-bc48-8fc2c64b3ea8 not found in is_blk_device check {{(pid=86111) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 29 01:26:44 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-722e07e3-89f1-47bd-a898-d25fa28077a8 tempest-VolumeDependencyTests-449359766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-66ea3541-97b8-47ac-b6ce-53b2420b6894 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ec876d64-083b-4fdb-bc48-8fc2c64b3ea8 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:26:44 devstack sudo[104028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-66ea3541-97b8-47ac-b6ce-53b2420b6894 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ec876d64-083b-4fdb-bc48-8fc2c64b3ea8 Aug 29 01:26:44 devstack sudo[104028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:26:48 devstack sudo[104028]: pam_unix(sudo:session): session closed for user root Aug 29 01:26:48 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-722e07e3-89f1-47bd-a898-d25fa28077a8 tempest-VolumeDependencyTests-449359766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-66ea3541-97b8-47ac-b6ce-53b2420b6894 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ec876d64-083b-4fdb-bc48-8fc2c64b3ea8" returned: 0 in 4.893s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:26:48 devstack cinder-volume[86111]: DEBUG cinder.image.image_utils [None req-722e07e3-89f1-47bd-a898-d25fa28077a8 tempest-VolumeDependencyTests-449359766 None] Image conversion details: src /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-66ea3541-97b8-47ac-b6ce-53b2420b6894, size 1024.00 MB, duration 4.89 sec, destination /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ec876d64-083b-4fdb-bc48-8fc2c64b3ea8 {{(pid=86111) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 29 01:26:48 devstack cinder-volume[86111]: INFO cinder.image.image_utils [None req-722e07e3-89f1-47bd-a898-d25fa28077a8 tempest-VolumeDependencyTests-449359766 None] Converted 1024.00 MB image at 209.22 MB/s Aug 29 01:26:48 devstack cinder-volume[86111]: WARNING cinder.volume.drivers.remotefs [None req-722e07e3-89f1-47bd-a898-d25fa28077a8 tempest-VolumeDependencyTests-449359766 None] /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ec876d64-083b-4fdb-bc48-8fc2c64b3ea8 is being set with open permissions: ugo+rw Aug 29 01:26:48 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-722e07e3-89f1-47bd-a898-d25fa28077a8 tempest-VolumeDependencyTests-449359766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ec876d64-083b-4fdb-bc48-8fc2c64b3ea8 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:26:48 devstack sudo[104043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ec876d64-083b-4fdb-bc48-8fc2c64b3ea8 Aug 29 01:26:48 devstack sudo[104043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:26:49 devstack sudo[104043]: pam_unix(sudo:session): session closed for user root Aug 29 01:26:49 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-722e07e3-89f1-47bd-a898-d25fa28077a8 tempest-VolumeDependencyTests-449359766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ec876d64-083b-4fdb-bc48-8fc2c64b3ea8" returned: 0 in 0.246s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:26:49 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-722e07e3-89f1-47bd-a898-d25fa28077a8 tempest-VolumeDependencyTests-449359766 None] Lock "cinder-quobyte-ec876d64-083b-4fdb-bc48-8fc2c64b3ea8" released by "_copy_volume_from_snapshot" :: held 5.974s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:26:49 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-722e07e3-89f1-47bd-a898-d25fa28077a8 tempest-VolumeDependencyTests-449359766 None] Lock "cinder-quobyte-8e824bd0-7513-4c7a-bf11-9449610b4bea-ec876d64-083b-4fdb-bc48-8fc2c64b3ea8" released by "_create_volume_from_snapshot" :: held 6.035s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:26:49 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-722e07e3-89f1-47bd-a898-d25fa28077a8 tempest-VolumeDependencyTests-449359766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.050s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:26:49 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-722e07e3-89f1-47bd-a898-d25fa28077a8 tempest-VolumeDependencyTests-449359766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32c142e4-a8e2-4aec-b3bd-bb74774d9cf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec876d64-083b-4fdb-bc48-8fc2c64b3ea8', 'volume_size': 1, 'snapshot_id': '8e824bd0-7513-4c7a-bf11-9449610b4bea'}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:26:49 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-722e07e3-89f1-47bd-a898-d25fa28077a8 tempest-VolumeDependencyTests-449359766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72117a11-9607-4ef8-9d79-0debc6c30ef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:26:49 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-722e07e3-89f1-47bd-a898-d25fa28077a8 tempest-VolumeDependencyTests-449359766 None] Volume volume-ec876d64-083b-4fdb-bc48-8fc2c64b3ea8 (ec876d64-083b-4fdb-bc48-8fc2c64b3ea8): created successfully Aug 29 01:26:49 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-722e07e3-89f1-47bd-a898-d25fa28077a8 tempest-VolumeDependencyTests-449359766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72117a11-9607-4ef8-9d79-0debc6c30ef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:26:49 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-722e07e3-89f1-47bd-a898-d25fa28077a8 tempest-VolumeDependencyTests-449359766 None] Flow 'volume_create_manager' (dec58204-0864-4a8a-8a43-888e72e5a3c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:26:49 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-722e07e3-89f1-47bd-a898-d25fa28077a8 tempest-VolumeDependencyTests-449359766 None] Created volume successfully. Aug 29 01:26:49 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-16ede933-c05b-481a-bd97-c9d1713292a7 tempest-VolumeDependencyTests-449359766 None] Acquiring lock "cinder-8e824bd0-7513-4c7a-bf11-9449610b4bea-delete_snapshot" by "delete_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:26:49 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-16ede933-c05b-481a-bd97-c9d1713292a7 tempest-VolumeDependencyTests-449359766 None] Lock "cinder-8e824bd0-7513-4c7a-bf11-9449610b4bea-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:26:49 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-16ede933-c05b-481a-bd97-c9d1713292a7 tempest-VolumeDependencyTests-449359766 None] Acquiring lock "cinder-quobyte-66ea3541-97b8-47ac-b6ce-53b2420b6894" by "delete_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:26:49 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-16ede933-c05b-481a-bd97-c9d1713292a7 tempest-VolumeDependencyTests-449359766 None] Lock "cinder-quobyte-66ea3541-97b8-47ac-b6ce-53b2420b6894" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:26:49 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-16ede933-c05b-481a-bd97-c9d1713292a7 tempest-VolumeDependencyTests-449359766 None] Acquiring lock "cinder-quobyte-8e824bd0-7513-4c7a-bf11-9449610b4bea" by "_delete_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:26:49 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-16ede933-c05b-481a-bd97-c9d1713292a7 tempest-VolumeDependencyTests-449359766 None] Lock "cinder-quobyte-8e824bd0-7513-4c7a-bf11-9449610b4bea" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:26:49 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-16ede933-c05b-481a-bd97-c9d1713292a7 tempest-VolumeDependencyTests-449359766 None] Deleting offline snapshot 8e824bd0-7513-4c7a-bf11-9449610b4bea of volume 66ea3541-97b8-47ac-b6ce-53b2420b6894 {{(pid=86111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 29 01:26:49 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-16ede933-c05b-481a-bd97-c9d1713292a7 tempest-VolumeDependencyTests-449359766 None] snapshot_file for this snap is: volume-66ea3541-97b8-47ac-b6ce-53b2420b6894.8e824bd0-7513-4c7a-bf11-9449610b4bea {{(pid=86111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 29 01:26:49 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[81e7aa61-9acb-44a7-9f32-544bafaacb45]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:26:49 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-16ede933-c05b-481a-bd97-c9d1713292a7 tempest-VolumeDependencyTests-449359766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-66ea3541-97b8-47ac-b6ce-53b2420b6894.8e824bd0-7513-4c7a-bf11-9449610b4bea {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:26:49 devstack sudo[104047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-66ea3541-97b8-47ac-b6ce-53b2420b6894.8e824bd0-7513-4c7a-bf11-9449610b4bea Aug 29 01:26:49 devstack sudo[104047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:26:50 devstack sudo[104047]: pam_unix(sudo:session): session closed for user root Aug 29 01:26:50 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-16ede933-c05b-481a-bd97-c9d1713292a7 tempest-VolumeDependencyTests-449359766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-66ea3541-97b8-47ac-b6ce-53b2420b6894.8e824bd0-7513-4c7a-bf11-9449610b4bea" returned: 0 in 0.352s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:26:50 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-16ede933-c05b-481a-bd97-c9d1713292a7 tempest-VolumeDependencyTests-449359766 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-66ea3541-97b8-47ac-b6ce-53b2420b6894(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 29 01:26:50 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c147074-5b99-4ab6-aef8-198eee2acf40]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:26:50 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-16ede933-c05b-481a-bd97-c9d1713292a7 tempest-VolumeDependencyTests-449359766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-66ea3541-97b8-47ac-b6ce-53b2420b6894 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:26:50 devstack sudo[104052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-66ea3541-97b8-47ac-b6ce-53b2420b6894 Aug 29 01:26:50 devstack sudo[104052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:26:50 devstack sudo[104052]: pam_unix(sudo:session): session closed for user root Aug 29 01:26:50 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-16ede933-c05b-481a-bd97-c9d1713292a7 tempest-VolumeDependencyTests-449359766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-66ea3541-97b8-47ac-b6ce-53b2420b6894" returned: 0 in 0.554s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:26:50 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-16ede933-c05b-481a-bd97-c9d1713292a7 tempest-VolumeDependencyTests-449359766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-66ea3541-97b8-47ac-b6ce-53b2420b6894.8e824bd0-7513-4c7a-bf11-9449610b4bea {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:26:50 devstack sudo[104057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-66ea3541-97b8-47ac-b6ce-53b2420b6894.8e824bd0-7513-4c7a-bf11-9449610b4bea Aug 29 01:26:50 devstack sudo[104057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:26:51 devstack sudo[104057]: pam_unix(sudo:session): session closed for user root Aug 29 01:26:51 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-16ede933-c05b-481a-bd97-c9d1713292a7 tempest-VolumeDependencyTests-449359766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-66ea3541-97b8-47ac-b6ce-53b2420b6894.8e824bd0-7513-4c7a-bf11-9449610b4bea" returned: 0 in 0.345s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:26:51 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-16ede933-c05b-481a-bd97-c9d1713292a7 tempest-VolumeDependencyTests-449359766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-66ea3541-97b8-47ac-b6ce-53b2420b6894.8e824bd0-7513-4c7a-bf11-9449610b4bea {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:26:51 devstack sudo[104063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-66ea3541-97b8-47ac-b6ce-53b2420b6894.8e824bd0-7513-4c7a-bf11-9449610b4bea Aug 29 01:26:51 devstack sudo[104063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:26:51 devstack sudo[104063]: pam_unix(sudo:session): session closed for user root Aug 29 01:26:51 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-16ede933-c05b-481a-bd97-c9d1713292a7 tempest-VolumeDependencyTests-449359766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-66ea3541-97b8-47ac-b6ce-53b2420b6894.8e824bd0-7513-4c7a-bf11-9449610b4bea" returned: 0 in 0.286s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:26:51 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-16ede933-c05b-481a-bd97-c9d1713292a7 tempest-VolumeDependencyTests-449359766 None] Lock "cinder-quobyte-8e824bd0-7513-4c7a-bf11-9449610b4bea" released by "_delete_snapshot" :: held 1.634s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:26:51 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-16ede933-c05b-481a-bd97-c9d1713292a7 tempest-VolumeDependencyTests-449359766 None] Lock "cinder-quobyte-66ea3541-97b8-47ac-b6ce-53b2420b6894" released by "delete_snapshot" :: held 1.660s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:26:51 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-16ede933-c05b-481a-bd97-c9d1713292a7 tempest-VolumeDependencyTests-449359766 None] Created reservations ['299648e4-8fb8-46fb-ba04-8773dcd63a8f', '296ce77c-8012-4270-a5f5-28cb99851236', 'd1afbda5-38e4-45a2-a48f-6a26c9ce0f5b', '6076fb6b-b4da-41aa-b042-d5ff4a7c9cc6'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:26:51 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-16ede933-c05b-481a-bd97-c9d1713292a7 tempest-VolumeDependencyTests-449359766 None] Delete snapshot completed successfully. Aug 29 01:26:51 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-16ede933-c05b-481a-bd97-c9d1713292a7 tempest-VolumeDependencyTests-449359766 None] Lock "cinder-8e824bd0-7513-4c7a-bf11-9449610b4bea-delete_snapshot" released by "delete_snapshot" :: held 1.806s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:26:51 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-7a013b1e-d6a5-4e01-9e44-21e679afe1c4 tempest-VolumeDependencyTests-449359766 None] Acquiring lock "cinder-66ea3541-97b8-47ac-b6ce-53b2420b6894-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:26:51 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-7a013b1e-d6a5-4e01-9e44-21e679afe1c4 tempest-VolumeDependencyTests-449359766 None] Lock "cinder-66ea3541-97b8-47ac-b6ce-53b2420b6894-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:26:51 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-7a013b1e-d6a5-4e01-9e44-21e679afe1c4 tempest-VolumeDependencyTests-449359766 None] Acquiring lock "cinder-quobyte-66ea3541-97b8-47ac-b6ce-53b2420b6894" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:26:51 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-7a013b1e-d6a5-4e01-9e44-21e679afe1c4 tempest-VolumeDependencyTests-449359766 None] Lock "cinder-quobyte-66ea3541-97b8-47ac-b6ce-53b2420b6894" acquired by "delete_volume" :: waited 0.020s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:26:52 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ab033f5-3cee-4991-8ec4-8a9e120e43a1]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:26:52 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-7a013b1e-d6a5-4e01-9e44-21e679afe1c4 tempest-VolumeDependencyTests-449359766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-66ea3541-97b8-47ac-b6ce-53b2420b6894 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:26:52 devstack sudo[104067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-66ea3541-97b8-47ac-b6ce-53b2420b6894 Aug 29 01:26:52 devstack sudo[104067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:26:52 devstack sudo[104067]: pam_unix(sudo:session): session closed for user root Aug 29 01:26:52 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-7a013b1e-d6a5-4e01-9e44-21e679afe1c4 tempest-VolumeDependencyTests-449359766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-66ea3541-97b8-47ac-b6ce-53b2420b6894" returned: 0 in 0.392s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:26:52 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-7a013b1e-d6a5-4e01-9e44-21e679afe1c4 tempest-VolumeDependencyTests-449359766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-66ea3541-97b8-47ac-b6ce-53b2420b6894 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:26:52 devstack sudo[104072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-66ea3541-97b8-47ac-b6ce-53b2420b6894 Aug 29 01:26:52 devstack sudo[104072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:26:52 devstack sudo[104072]: pam_unix(sudo:session): session closed for user root Aug 29 01:26:52 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-7a013b1e-d6a5-4e01-9e44-21e679afe1c4 tempest-VolumeDependencyTests-449359766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-66ea3541-97b8-47ac-b6ce-53b2420b6894" returned: 0 in 0.270s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:26:52 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-7a013b1e-d6a5-4e01-9e44-21e679afe1c4 tempest-VolumeDependencyTests-449359766 None] Lock "cinder-quobyte-66ea3541-97b8-47ac-b6ce-53b2420b6894" released by "delete_volume" :: held 0.725s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:26:52 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-7a013b1e-d6a5-4e01-9e44-21e679afe1c4 tempest-VolumeDependencyTests-449359766 None] Created reservations ['1bff82ef-455a-432a-88e7-79b639d8f86e', 'f0174e63-8f9b-4d24-a005-236784dad777', '89899434-ff01-4dbb-bea1-886de883d0ab', 'd8d0399d-8a94-44de-b467-63c281f58152'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:26:52 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-7a013b1e-d6a5-4e01-9e44-21e679afe1c4 tempest-VolumeDependencyTests-449359766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:26:52 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-7a013b1e-d6a5-4e01-9e44-21e679afe1c4 tempest-VolumeDependencyTests-449359766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:26:52 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-7a013b1e-d6a5-4e01-9e44-21e679afe1c4 tempest-VolumeDependencyTests-449359766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:26:52 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-7a013b1e-d6a5-4e01-9e44-21e679afe1c4 tempest-VolumeDependencyTests-449359766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:26:52 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-7a013b1e-d6a5-4e01-9e44-21e679afe1c4 tempest-VolumeDependencyTests-449359766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:26:52 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-7a013b1e-d6a5-4e01-9e44-21e679afe1c4 tempest-VolumeDependencyTests-449359766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:26:52 devstack sudo[104075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:26:52 devstack sudo[104075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:26:53 devstack sudo[104075]: pam_unix(sudo:session): session closed for user root Aug 29 01:26:53 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-7d25cf74-a02e-4e21-b281-a8bfa83c3917 tempest-VolumeDependencyTests-449359766 None] Acquiring lock "cinder-ec876d64-083b-4fdb-bc48-8fc2c64b3ea8-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:26:53 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-7a013b1e-d6a5-4e01-9e44-21e679afe1c4 tempest-VolumeDependencyTests-449359766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.269s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:26:53 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-7a013b1e-d6a5-4e01-9e44-21e679afe1c4 tempest-VolumeDependencyTests-449359766 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:26:53 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-7a013b1e-d6a5-4e01-9e44-21e679afe1c4 tempest-VolumeDependencyTests-449359766 None] Deleted volume successfully. Aug 29 01:26:53 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-7d25cf74-a02e-4e21-b281-a8bfa83c3917 tempest-VolumeDependencyTests-449359766 None] Lock "cinder-ec876d64-083b-4fdb-bc48-8fc2c64b3ea8-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:26:53 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-7a013b1e-d6a5-4e01-9e44-21e679afe1c4 tempest-VolumeDependencyTests-449359766 None] Lock "cinder-66ea3541-97b8-47ac-b6ce-53b2420b6894-delete_volume" released by "delete_volume" :: held 1.224s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:26:53 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-7d25cf74-a02e-4e21-b281-a8bfa83c3917 tempest-VolumeDependencyTests-449359766 None] Acquiring lock "cinder-quobyte-ec876d64-083b-4fdb-bc48-8fc2c64b3ea8" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:26:53 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-7d25cf74-a02e-4e21-b281-a8bfa83c3917 tempest-VolumeDependencyTests-449359766 None] Lock "cinder-quobyte-ec876d64-083b-4fdb-bc48-8fc2c64b3ea8" acquired by "delete_volume" :: waited 0.017s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:26:53 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[288c40d7-8eda-456d-9afc-c3bf4a4d1ab2]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:26:53 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-7d25cf74-a02e-4e21-b281-a8bfa83c3917 tempest-VolumeDependencyTests-449359766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ec876d64-083b-4fdb-bc48-8fc2c64b3ea8 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:26:53 devstack sudo[104078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ec876d64-083b-4fdb-bc48-8fc2c64b3ea8 Aug 29 01:26:53 devstack sudo[104078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:26:53 devstack sudo[104078]: pam_unix(sudo:session): session closed for user root Aug 29 01:26:53 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-7d25cf74-a02e-4e21-b281-a8bfa83c3917 tempest-VolumeDependencyTests-449359766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ec876d64-083b-4fdb-bc48-8fc2c64b3ea8" returned: 0 in 0.390s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:26:53 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-7d25cf74-a02e-4e21-b281-a8bfa83c3917 tempest-VolumeDependencyTests-449359766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ec876d64-083b-4fdb-bc48-8fc2c64b3ea8 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:26:53 devstack sudo[104083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ec876d64-083b-4fdb-bc48-8fc2c64b3ea8 Aug 29 01:26:53 devstack sudo[104083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:26:53 devstack sudo[104083]: pam_unix(sudo:session): session closed for user root Aug 29 01:26:53 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-7d25cf74-a02e-4e21-b281-a8bfa83c3917 tempest-VolumeDependencyTests-449359766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ec876d64-083b-4fdb-bc48-8fc2c64b3ea8" returned: 0 in 0.248s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:26:53 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-7d25cf74-a02e-4e21-b281-a8bfa83c3917 tempest-VolumeDependencyTests-449359766 None] Lock "cinder-quobyte-ec876d64-083b-4fdb-bc48-8fc2c64b3ea8" released by "delete_volume" :: held 0.681s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:26:53 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-7d25cf74-a02e-4e21-b281-a8bfa83c3917 tempest-VolumeDependencyTests-449359766 None] Created reservations ['1499f3a0-f110-4c3d-8457-28c05dd7c784', 'e831e0ee-197f-4232-9bb0-af546feb253e', '9cfe177f-1ba9-4719-9deb-f90609ace17e', '77efc7a1-1e36-48ad-a3e9-ed61269f1e5a'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:26:53 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-7d25cf74-a02e-4e21-b281-a8bfa83c3917 tempest-VolumeDependencyTests-449359766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:26:53 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-7d25cf74-a02e-4e21-b281-a8bfa83c3917 tempest-VolumeDependencyTests-449359766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:26:53 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-7d25cf74-a02e-4e21-b281-a8bfa83c3917 tempest-VolumeDependencyTests-449359766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:26:53 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-7d25cf74-a02e-4e21-b281-a8bfa83c3917 tempest-VolumeDependencyTests-449359766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:26:53 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-7d25cf74-a02e-4e21-b281-a8bfa83c3917 tempest-VolumeDependencyTests-449359766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:26:53 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-7d25cf74-a02e-4e21-b281-a8bfa83c3917 tempest-VolumeDependencyTests-449359766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:26:54 devstack sudo[104086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:26:54 devstack sudo[104086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:26:54 devstack sudo[104086]: pam_unix(sudo:session): session closed for user root Aug 29 01:26:54 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-7d25cf74-a02e-4e21-b281-a8bfa83c3917 tempest-VolumeDependencyTests-449359766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.262s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:26:54 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-7d25cf74-a02e-4e21-b281-a8bfa83c3917 tempest-VolumeDependencyTests-449359766 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:26:54 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-7d25cf74-a02e-4e21-b281-a8bfa83c3917 tempest-VolumeDependencyTests-449359766 None] Deleted volume successfully. Aug 29 01:26:54 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-7d25cf74-a02e-4e21-b281-a8bfa83c3917 tempest-VolumeDependencyTests-449359766 None] Lock "cinder-ec876d64-083b-4fdb-bc48-8fc2c64b3ea8-delete_volume" released by "delete_volume" :: held 1.168s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:26:57 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-23981690-9d00-4f86-8bab-2bb0834a9cfb tempest-VolumeImageDependencyTests-1086444190 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:26:57 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-23981690-9d00-4f86-8bab-2bb0834a9cfb tempest-VolumeImageDependencyTests-1086444190 None] Flow 'volume_create_manager' (32f7b5d7-fd93-48c2-955c-036ef9261348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:26:57 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-23981690-9d00-4f86-8bab-2bb0834a9cfb tempest-VolumeImageDependencyTests-1086444190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc0fd33b-5f40-4ebc-95f0-5685ea74067d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:26:57 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-23981690-9d00-4f86-8bab-2bb0834a9cfb tempest-VolumeImageDependencyTests-1086444190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc0fd33b-5f40-4ebc-95f0-5685ea74067d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:26:57Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=661a386a-68bd-4f88-824b-c553cc61204d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d982306c7b046899456a5b60489afe1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:26:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:26:57Z,use_quota=True,user_id='2afd7b026950455dada219a7b3d6adec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:26:57 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-23981690-9d00-4f86-8bab-2bb0834a9cfb tempest-VolumeImageDependencyTests-1086444190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6634480d-fd49-4858-9c13-3772513b454f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:26:57 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-23981690-9d00-4f86-8bab-2bb0834a9cfb tempest-VolumeImageDependencyTests-1086444190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6634480d-fd49-4858-9c13-3772513b454f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:26:57 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-23981690-9d00-4f86-8bab-2bb0834a9cfb tempest-VolumeImageDependencyTests-1086444190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9b86e0d-2427-4498-ba42-f24992341d57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:26:57 devstack cinder-volume[86111]: DEBUG cinder.image.glance [None req-23981690-9d00-4f86-8bab-2bb0834a9cfb tempest-VolumeImageDependencyTests-1086444190 None] Creating Keystone auth plugin from conf {{(pid=86111) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 29 01:26:57 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-23981690-9d00-4f86-8bab-2bb0834a9cfb tempest-VolumeImageDependencyTests-1086444190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9b86e0d-2427-4498-ba42-f24992341d57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '661a386a-68bd-4f88-824b-c553cc61204d', 'volume_name': 'volume-661a386a-68bd-4f88-824b-c553cc61204d', 'volume_size': 1, 'image_id': '272f1600-e991-4dee-a08b-fb0f3859e91f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/272f1600-e991-4dee-a08b-fb0f3859e91f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '628de4a79db473fdb66ca9b2277b9812', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4d982306c7b046899456a5b60489afe1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f89da469a9df3fe4b384dbe4a618aa98a9805bb8b99e0f41bd8286c65c210bd1ae2027cd9028ce545031c8fd0c3b7babca039494d6ab0f038d412ba4863dffbd', 'id': '272f1600-e991-4dee-a08b-fb0f3859e91f', 'created_at': datetime.datetime(2026, 8, 28, 23, 26, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 23, 26, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/272f1600-e991-4dee-a08b-fb0f3859e91f/file', 'properties': {}}, 'image_service': }' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:26:57 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-23981690-9d00-4f86-8bab-2bb0834a9cfb tempest-VolumeImageDependencyTests-1086444190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f79e4e6-c80b-4e3c-ab56-f9fe7157a0d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:26:57 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-23981690-9d00-4f86-8bab-2bb0834a9cfb tempest-VolumeImageDependencyTests-1086444190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f79e4e6-c80b-4e3c-ab56-f9fe7157a0d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:26:57 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-23981690-9d00-4f86-8bab-2bb0834a9cfb tempest-VolumeImageDependencyTests-1086444190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d779566b-0fdf-4c6e-aadf-b47243f59c9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:26:57 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-23981690-9d00-4f86-8bab-2bb0834a9cfb tempest-VolumeImageDependencyTests-1086444190 None] Volume 661a386a-68bd-4f88-824b-c553cc61204d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-661a386a-68bd-4f88-824b-c553cc61204d', 'volume_size': 1, 'image_id': '272f1600-e991-4dee-a08b-fb0f3859e91f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/272f1600-e991-4dee-a08b-fb0f3859e91f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '628de4a79db473fdb66ca9b2277b9812', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4d982306c7b046899456a5b60489afe1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f89da469a9df3fe4b384dbe4a618aa98a9805bb8b99e0f41bd8286c65c210bd1ae2027cd9028ce545031c8fd0c3b7babca039494d6ab0f038d412ba4863dffbd', 'id': '272f1600-e991-4dee-a08b-fb0f3859e91f', 'created_at': datetime.datetime(2026, 8, 28, 23, 26, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 23, 26, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/272f1600-e991-4dee-a08b-fb0f3859e91f/file', 'properties': {}}, 'image_service': } Aug 29 01:26:57 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-23981690-9d00-4f86-8bab-2bb0834a9cfb tempest-VolumeImageDependencyTests-1086444190 None] Trying to clone 661a386a-68bd-4f88-824b-c553cc61204d from image 272f1600-e991-4dee-a08b-fb0f3859e91f at location (None, [{'url': 'file:///opt/stack/data/glance/images/272f1600-e991-4dee-a08b-fb0f3859e91f', 'metadata': {}}]). {{(pid=86111) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 29 01:26:57 devstack cinder-volume[86111]: DEBUG cinder.image.image_utils [None req-23981690-9d00-4f86-8bab-2bb0834a9cfb tempest-VolumeImageDependencyTests-1086444190 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_272f1600-e991-4dee-a08b-fb0f3859e91f_7eaiy8sjdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86111) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 29 01:26:57 devstack cinder-volume[86111]: INFO cinder.image.image_utils [None req-23981690-9d00-4f86-8bab-2bb0834a9cfb tempest-VolumeImageDependencyTests-1086444190 None] Image download 0.00 MB at 0.00 MB/s Aug 29 01:26:57 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ee07bbb-2e77-4695-8f66-56e3a3987814]: (4, 'raw') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:26:57 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-23981690-9d00-4f86-8bab-2bb0834a9cfb tempest-VolumeImageDependencyTests-1086444190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_272f1600-e991-4dee-a08b-fb0f3859e91f_7eaiy8sjdevstack@QuobyteHD {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:26:57 devstack sudo[104091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_272f1600-e991-4dee-a08b-fb0f3859e91f_7eaiy8sjdevstack@QuobyteHD Aug 29 01:26:57 devstack sudo[104091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:26:58 devstack sudo[104091]: pam_unix(sudo:session): session closed for user root Aug 29 01:26:58 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-23981690-9d00-4f86-8bab-2bb0834a9cfb tempest-VolumeImageDependencyTests-1086444190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_272f1600-e991-4dee-a08b-fb0f3859e91f_7eaiy8sjdevstack@QuobyteHD" returned: 0 in 0.337s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:26:58 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-23981690-9d00-4f86-8bab-2bb0834a9cfb tempest-VolumeImageDependencyTests-1086444190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_272f1600-e991-4dee-a08b-fb0f3859e91f_7eaiy8sjdevstack@QuobyteHD {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:26:58 devstack sudo[104095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_272f1600-e991-4dee-a08b-fb0f3859e91f_7eaiy8sjdevstack@QuobyteHD Aug 29 01:26:58 devstack sudo[104095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:26:58 devstack sudo[104095]: pam_unix(sudo:session): session closed for user root Aug 29 01:26:58 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-23981690-9d00-4f86-8bab-2bb0834a9cfb tempest-VolumeImageDependencyTests-1086444190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_272f1600-e991-4dee-a08b-fb0f3859e91f_7eaiy8sjdevstack@QuobyteHD" returned: 1 in 0.318s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:26:58 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-23981690-9d00-4f86-8bab-2bb0834a9cfb tempest-VolumeImageDependencyTests-1086444190 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_272f1600-e991-4dee-a08b-fb0f3859e91f_7eaiy8sjdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 29 01:26:58 devstack cinder-volume[86111]: DEBUG cinder.image.image_utils [None req-23981690-9d00-4f86-8bab-2bb0834a9cfb tempest-VolumeImageDependencyTests-1086444190 None] Temporary image 272f1600-e991-4dee-a08b-fb0f3859e91f is fetched for user 2afd7b026950455dada219a7b3d6adec. {{(pid=86111) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 29 01:26:58 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a449437-5155-4ca1-9f1f-160098487efc]: (4, 'raw') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:26:58 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-23981690-9d00-4f86-8bab-2bb0834a9cfb tempest-VolumeImageDependencyTests-1086444190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_272f1600-e991-4dee-a08b-fb0f3859e91f_7eaiy8sjdevstack@QuobyteHD {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:26:58 devstack sudo[104100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_272f1600-e991-4dee-a08b-fb0f3859e91f_7eaiy8sjdevstack@QuobyteHD Aug 29 01:26:58 devstack sudo[104100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:26:58 devstack sudo[104100]: pam_unix(sudo:session): session closed for user root Aug 29 01:26:58 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-23981690-9d00-4f86-8bab-2bb0834a9cfb tempest-VolumeImageDependencyTests-1086444190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_272f1600-e991-4dee-a08b-fb0f3859e91f_7eaiy8sjdevstack@QuobyteHD" returned: 0 in 0.326s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:26:58 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-23981690-9d00-4f86-8bab-2bb0834a9cfb tempest-VolumeImageDependencyTests-1086444190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_272f1600-e991-4dee-a08b-fb0f3859e91f_7eaiy8sjdevstack@QuobyteHD {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:26:58 devstack sudo[104104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_272f1600-e991-4dee-a08b-fb0f3859e91f_7eaiy8sjdevstack@QuobyteHD Aug 29 01:26:58 devstack sudo[104104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:26:59 devstack sudo[104104]: pam_unix(sudo:session): session closed for user root Aug 29 01:26:59 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-23981690-9d00-4f86-8bab-2bb0834a9cfb tempest-VolumeImageDependencyTests-1086444190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_272f1600-e991-4dee-a08b-fb0f3859e91f_7eaiy8sjdevstack@QuobyteHD" returned: 1 in 0.319s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:26:59 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-23981690-9d00-4f86-8bab-2bb0834a9cfb tempest-VolumeImageDependencyTests-1086444190 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_272f1600-e991-4dee-a08b-fb0f3859e91f_7eaiy8sjdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 29 01:26:59 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-23981690-9d00-4f86-8bab-2bb0834a9cfb tempest-VolumeImageDependencyTests-1086444190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:26:59 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-23981690-9d00-4f86-8bab-2bb0834a9cfb tempest-VolumeImageDependencyTests-1086444190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:26:59 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-23981690-9d00-4f86-8bab-2bb0834a9cfb tempest-VolumeImageDependencyTests-1086444190 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:26:57Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=661a386a-68bd-4f88-824b-c553cc61204d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d982306c7b046899456a5b60489afe1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:26:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:26:57Z,use_quota=True,user_id='2afd7b026950455dada219a7b3d6adec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:26:59 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-23981690-9d00-4f86-8bab-2bb0834a9cfb tempest-VolumeImageDependencyTests-1086444190 None] Creating volume 661a386a-68bd-4f88-824b-c553cc61204d {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:26:59 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-23981690-9d00-4f86-8bab-2bb0834a9cfb tempest-VolumeImageDependencyTests-1086444190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:26:59 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-23981690-9d00-4f86-8bab-2bb0834a9cfb tempest-VolumeImageDependencyTests-1086444190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:26:59 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-23981690-9d00-4f86-8bab-2bb0834a9cfb tempest-VolumeImageDependencyTests-1086444190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:26:59 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-23981690-9d00-4f86-8bab-2bb0834a9cfb tempest-VolumeImageDependencyTests-1086444190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:26:59 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-23981690-9d00-4f86-8bab-2bb0834a9cfb tempest-VolumeImageDependencyTests-1086444190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:26:59 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-23981690-9d00-4f86-8bab-2bb0834a9cfb tempest-VolumeImageDependencyTests-1086444190 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:26:59 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-23981690-9d00-4f86-8bab-2bb0834a9cfb tempest-VolumeImageDependencyTests-1086444190 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:26:59 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-23981690-9d00-4f86-8bab-2bb0834a9cfb tempest-VolumeImageDependencyTests-1086444190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-661a386a-68bd-4f88-824b-c553cc61204d 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:26:59 devstack sudo[104109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-661a386a-68bd-4f88-824b-c553cc61204d 1073741824 Aug 29 01:26:59 devstack sudo[104109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:26:59 devstack sudo[104109]: pam_unix(sudo:session): session closed for user root Aug 29 01:26:59 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-23981690-9d00-4f86-8bab-2bb0834a9cfb tempest-VolumeImageDependencyTests-1086444190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-661a386a-68bd-4f88-824b-c553cc61204d 1073741824" returned: 0 in 0.404s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:26:59 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-23981690-9d00-4f86-8bab-2bb0834a9cfb tempest-VolumeImageDependencyTests-1086444190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-661a386a-68bd-4f88-824b-c553cc61204d {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:26:59 devstack sudo[104115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-661a386a-68bd-4f88-824b-c553cc61204d Aug 29 01:26:59 devstack sudo[104115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:26:59 devstack sudo[104115]: pam_unix(sudo:session): session closed for user root Aug 29 01:26:59 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-23981690-9d00-4f86-8bab-2bb0834a9cfb tempest-VolumeImageDependencyTests-1086444190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-661a386a-68bd-4f88-824b-c553cc61204d" returned: 0 in 0.236s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:26:59 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-23981690-9d00-4f86-8bab-2bb0834a9cfb tempest-VolumeImageDependencyTests-1086444190 None] <== create_volume: return (679ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:26:59 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-23981690-9d00-4f86-8bab-2bb0834a9cfb tempest-VolumeImageDependencyTests-1086444190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.681s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:26:59 devstack cinder-volume[86111]: DEBUG cinder.volume.volume_utils [None req-23981690-9d00-4f86-8bab-2bb0834a9cfb tempest-VolumeImageDependencyTests-1086444190 None] Attempting download of 272f1600-e991-4dee-a08b-fb0f3859e91f ((None, [{'url': 'file:///opt/stack/data/glance/images/272f1600-e991-4dee-a08b-fb0f3859e91f', 'metadata': {}}])) to volume 661a386a-68bd-4f88-824b-c553cc61204d. {{(pid=86111) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 29 01:26:59 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[acef1e9c-112e-47e2-8e94-34a1a9e7c597]: (4, 'raw') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:26:59 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-23981690-9d00-4f86-8bab-2bb0834a9cfb tempest-VolumeImageDependencyTests-1086444190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_272f1600-e991-4dee-a08b-fb0f3859e91f_5ha67l4m {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:26:59 devstack sudo[104118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_272f1600-e991-4dee-a08b-fb0f3859e91f_5ha67l4m Aug 29 01:26:59 devstack sudo[104118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:27:00 devstack sudo[104118]: pam_unix(sudo:session): session closed for user root Aug 29 01:27:00 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-23981690-9d00-4f86-8bab-2bb0834a9cfb tempest-VolumeImageDependencyTests-1086444190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_272f1600-e991-4dee-a08b-fb0f3859e91f_5ha67l4m" returned: 0 in 0.326s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:27:00 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-23981690-9d00-4f86-8bab-2bb0834a9cfb tempest-VolumeImageDependencyTests-1086444190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_272f1600-e991-4dee-a08b-fb0f3859e91f_5ha67l4m {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:27:00 devstack sudo[104122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_272f1600-e991-4dee-a08b-fb0f3859e91f_5ha67l4m Aug 29 01:27:00 devstack sudo[104122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:27:00 devstack sudo[104122]: pam_unix(sudo:session): session closed for user root Aug 29 01:27:00 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-23981690-9d00-4f86-8bab-2bb0834a9cfb tempest-VolumeImageDependencyTests-1086444190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_272f1600-e991-4dee-a08b-fb0f3859e91f_5ha67l4m" returned: 1 in 0.321s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:27:00 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-23981690-9d00-4f86-8bab-2bb0834a9cfb tempest-VolumeImageDependencyTests-1086444190 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_272f1600-e991-4dee-a08b-fb0f3859e91f_5ha67l4m' failed. Not Retrying. {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 29 01:27:00 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[948ec252-2232-40c9-b7aa-4c12e31a0146]: (4, 'raw') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:27:00 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-23981690-9d00-4f86-8bab-2bb0834a9cfb tempest-VolumeImageDependencyTests-1086444190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_272f1600-e991-4dee-a08b-fb0f3859e91f_7eaiy8sjdevstack@QuobyteHD {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:27:00 devstack sudo[104126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_272f1600-e991-4dee-a08b-fb0f3859e91f_7eaiy8sjdevstack@QuobyteHD Aug 29 01:27:00 devstack sudo[104126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:27:00 devstack sudo[104126]: pam_unix(sudo:session): session closed for user root Aug 29 01:27:00 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-23981690-9d00-4f86-8bab-2bb0834a9cfb tempest-VolumeImageDependencyTests-1086444190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_272f1600-e991-4dee-a08b-fb0f3859e91f_7eaiy8sjdevstack@QuobyteHD" returned: 0 in 0.317s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:27:00 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-23981690-9d00-4f86-8bab-2bb0834a9cfb tempest-VolumeImageDependencyTests-1086444190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_272f1600-e991-4dee-a08b-fb0f3859e91f_7eaiy8sjdevstack@QuobyteHD {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:27:00 devstack sudo[104130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_272f1600-e991-4dee-a08b-fb0f3859e91f_7eaiy8sjdevstack@QuobyteHD Aug 29 01:27:00 devstack sudo[104130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:27:01 devstack sudo[104130]: pam_unix(sudo:session): session closed for user root Aug 29 01:27:01 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-23981690-9d00-4f86-8bab-2bb0834a9cfb tempest-VolumeImageDependencyTests-1086444190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_272f1600-e991-4dee-a08b-fb0f3859e91f_7eaiy8sjdevstack@QuobyteHD" returned: 1 in 0.320s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:27:01 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-23981690-9d00-4f86-8bab-2bb0834a9cfb tempest-VolumeImageDependencyTests-1086444190 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_272f1600-e991-4dee-a08b-fb0f3859e91f_7eaiy8sjdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 29 01:27:01 devstack cinder-volume[86111]: DEBUG cinder.image.image_utils [None req-23981690-9d00-4f86-8bab-2bb0834a9cfb tempest-VolumeImageDependencyTests-1086444190 None] 272f1600-e991-4dee-a08b-fb0f3859e91f was raw, converting to qcow2 {{(pid=86111) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 29 01:27:01 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-23981690-9d00-4f86-8bab-2bb0834a9cfb tempest-VolumeImageDependencyTests-1086444190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_272f1600-e991-4dee-a08b-fb0f3859e91f_7eaiy8sjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-661a386a-68bd-4f88-824b-c553cc61204d {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:27:01 devstack sudo[104135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_272f1600-e991-4dee-a08b-fb0f3859e91f_7eaiy8sjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-661a386a-68bd-4f88-824b-c553cc61204d Aug 29 01:27:01 devstack sudo[104135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:27:01 devstack sudo[104135]: pam_unix(sudo:session): session closed for user root Aug 29 01:27:01 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-23981690-9d00-4f86-8bab-2bb0834a9cfb tempest-VolumeImageDependencyTests-1086444190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_272f1600-e991-4dee-a08b-fb0f3859e91f_7eaiy8sjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-661a386a-68bd-4f88-824b-c553cc61204d" returned: 0 in 0.412s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:27:01 devstack cinder-volume[86111]: DEBUG cinder.image.image_utils [None req-23981690-9d00-4f86-8bab-2bb0834a9cfb tempest-VolumeImageDependencyTests-1086444190 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_272f1600-e991-4dee-a08b-fb0f3859e91f_7eaiy8sjdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-661a386a-68bd-4f88-824b-c553cc61204d {{(pid=86111) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 29 01:27:01 devstack cinder-volume[86111]: INFO cinder.image.image_utils [None req-23981690-9d00-4f86-8bab-2bb0834a9cfb tempest-VolumeImageDependencyTests-1086444190 None] Converted 0.00 MB image at 0.00 MB/s Aug 29 01:27:01 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-23981690-9d00-4f86-8bab-2bb0834a9cfb tempest-VolumeImageDependencyTests-1086444190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-661a386a-68bd-4f88-824b-c553cc61204d 1G {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:27:01 devstack sudo[104140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-661a386a-68bd-4f88-824b-c553cc61204d 1G Aug 29 01:27:01 devstack sudo[104140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:27:01 devstack sudo[104140]: pam_unix(sudo:session): session closed for user root Aug 29 01:27:01 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-23981690-9d00-4f86-8bab-2bb0834a9cfb tempest-VolumeImageDependencyTests-1086444190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-661a386a-68bd-4f88-824b-c553cc61204d 1G" returned: 0 in 0.306s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:27:01 devstack cinder-volume[86111]: DEBUG cinder.volume.volume_utils [None req-23981690-9d00-4f86-8bab-2bb0834a9cfb tempest-VolumeImageDependencyTests-1086444190 None] Downloaded image 272f1600-e991-4dee-a08b-fb0f3859e91f ((None, [{'url': 'file:///opt/stack/data/glance/images/272f1600-e991-4dee-a08b-fb0f3859e91f', 'metadata': {}}])) to volume 661a386a-68bd-4f88-824b-c553cc61204d successfully. {{(pid=86111) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 29 01:27:01 devstack cinder-volume[86111]: DEBUG cinder.image.image_utils [None req-23981690-9d00-4f86-8bab-2bb0834a9cfb tempest-VolumeImageDependencyTests-1086444190 None] Temporary image 272f1600-e991-4dee-a08b-fb0f3859e91f for user 2afd7b026950455dada219a7b3d6adec is deleted. {{(pid=86111) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 29 01:27:01 devstack cinder-volume[86111]: DEBUG cinder.volume.volume_utils [None req-23981690-9d00-4f86-8bab-2bb0834a9cfb tempest-VolumeImageDependencyTests-1086444190 None] Marking volume 661a386a-68bd-4f88-824b-c553cc61204d as bootable. {{(pid=86111) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 29 01:27:01 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-23981690-9d00-4f86-8bab-2bb0834a9cfb tempest-VolumeImageDependencyTests-1086444190 None] Copying metadata from image 272f1600-e991-4dee-a08b-fb0f3859e91f to 661a386a-68bd-4f88-824b-c553cc61204d. {{(pid=86111) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 29 01:27:01 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-23981690-9d00-4f86-8bab-2bb0834a9cfb tempest-VolumeImageDependencyTests-1086444190 None] Creating volume glance metadata for volume 661a386a-68bd-4f88-824b-c553cc61204d backed by image 272f1600-e991-4dee-a08b-fb0f3859e91f with: {'image_id': '272f1600-e991-4dee-a08b-fb0f3859e91f', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '628de4a79db473fdb66ca9b2277b9812', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86111) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 29 01:27:01 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-23981690-9d00-4f86-8bab-2bb0834a9cfb tempest-VolumeImageDependencyTests-1086444190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d779566b-0fdf-4c6e-aadf-b47243f59c9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-661a386a-68bd-4f88-824b-c553cc61204d', 'volume_size': 1, 'image_id': '272f1600-e991-4dee-a08b-fb0f3859e91f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/272f1600-e991-4dee-a08b-fb0f3859e91f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '628de4a79db473fdb66ca9b2277b9812', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4d982306c7b046899456a5b60489afe1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f89da469a9df3fe4b384dbe4a618aa98a9805bb8b99e0f41bd8286c65c210bd1ae2027cd9028ce545031c8fd0c3b7babca039494d6ab0f038d412ba4863dffbd', 'id': '272f1600-e991-4dee-a08b-fb0f3859e91f', 'created_at': datetime.datetime(2026, 8, 28, 23, 26, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 23, 26, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/272f1600-e991-4dee-a08b-fb0f3859e91f/file', 'properties': {}}, 'image_service': }' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:27:01 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-23981690-9d00-4f86-8bab-2bb0834a9cfb tempest-VolumeImageDependencyTests-1086444190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ec7d8f9-08d8-4bd4-9bce-5f345e15560e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:27:01 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-23981690-9d00-4f86-8bab-2bb0834a9cfb tempest-VolumeImageDependencyTests-1086444190 None] Volume volume-661a386a-68bd-4f88-824b-c553cc61204d (661a386a-68bd-4f88-824b-c553cc61204d): created successfully Aug 29 01:27:01 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-23981690-9d00-4f86-8bab-2bb0834a9cfb tempest-VolumeImageDependencyTests-1086444190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ec7d8f9-08d8-4bd4-9bce-5f345e15560e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:27:01 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-23981690-9d00-4f86-8bab-2bb0834a9cfb tempest-VolumeImageDependencyTests-1086444190 None] Flow 'volume_create_manager' (32f7b5d7-fd93-48c2-955c-036ef9261348) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:27:01 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-23981690-9d00-4f86-8bab-2bb0834a9cfb tempest-VolumeImageDependencyTests-1086444190 None] Created volume successfully. Aug 29 01:27:02 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-825df3d9-0712-48df-ace7-93cc61c32d84 tempest-VolumeImageDependencyTests-1086444190 None] Acquiring lock "cinder-661a386a-68bd-4f88-824b-c553cc61204d-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:27:02 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-825df3d9-0712-48df-ace7-93cc61c32d84 tempest-VolumeImageDependencyTests-1086444190 None] Lock "cinder-661a386a-68bd-4f88-824b-c553cc61204d-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:27:02 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-825df3d9-0712-48df-ace7-93cc61c32d84 tempest-VolumeImageDependencyTests-1086444190 None] Acquiring lock "cinder-quobyte-661a386a-68bd-4f88-824b-c553cc61204d" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:27:02 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-825df3d9-0712-48df-ace7-93cc61c32d84 tempest-VolumeImageDependencyTests-1086444190 None] Lock "cinder-quobyte-661a386a-68bd-4f88-824b-c553cc61204d" acquired by "delete_volume" :: waited 0.013s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:27:02 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[1494e603-c83d-43d7-9e48-4053b89a3441]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:27:02 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-825df3d9-0712-48df-ace7-93cc61c32d84 tempest-VolumeImageDependencyTests-1086444190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-661a386a-68bd-4f88-824b-c553cc61204d {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:27:02 devstack sudo[104146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-661a386a-68bd-4f88-824b-c553cc61204d Aug 29 01:27:02 devstack sudo[104146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:27:02 devstack sudo[104146]: pam_unix(sudo:session): session closed for user root Aug 29 01:27:02 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-825df3d9-0712-48df-ace7-93cc61c32d84 tempest-VolumeImageDependencyTests-1086444190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-661a386a-68bd-4f88-824b-c553cc61204d" returned: 0 in 0.344s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:27:02 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-825df3d9-0712-48df-ace7-93cc61c32d84 tempest-VolumeImageDependencyTests-1086444190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-661a386a-68bd-4f88-824b-c553cc61204d {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:27:02 devstack sudo[104152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-661a386a-68bd-4f88-824b-c553cc61204d Aug 29 01:27:02 devstack sudo[104152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:27:03 devstack sudo[104152]: pam_unix(sudo:session): session closed for user root Aug 29 01:27:03 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-825df3d9-0712-48df-ace7-93cc61c32d84 tempest-VolumeImageDependencyTests-1086444190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-661a386a-68bd-4f88-824b-c553cc61204d" returned: 0 in 0.240s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:27:03 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-825df3d9-0712-48df-ace7-93cc61c32d84 tempest-VolumeImageDependencyTests-1086444190 None] Lock "cinder-quobyte-661a386a-68bd-4f88-824b-c553cc61204d" released by "delete_volume" :: held 0.619s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:27:03 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-825df3d9-0712-48df-ace7-93cc61c32d84 tempest-VolumeImageDependencyTests-1086444190 None] Created reservations ['2c825e10-b2ce-48ba-88a5-a829bdf1af67', '19b10415-7ce7-4ebe-ad58-94ed34126a72', 'c6d67238-cad1-4b03-a629-f19c6b543cfa', 'c205610b-c29f-4760-8a2e-887d84a31847'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:27:03 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-825df3d9-0712-48df-ace7-93cc61c32d84 tempest-VolumeImageDependencyTests-1086444190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:27:03 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-825df3d9-0712-48df-ace7-93cc61c32d84 tempest-VolumeImageDependencyTests-1086444190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:27:03 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-825df3d9-0712-48df-ace7-93cc61c32d84 tempest-VolumeImageDependencyTests-1086444190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:27:03 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-825df3d9-0712-48df-ace7-93cc61c32d84 tempest-VolumeImageDependencyTests-1086444190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:27:03 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-825df3d9-0712-48df-ace7-93cc61c32d84 tempest-VolumeImageDependencyTests-1086444190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:27:03 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-825df3d9-0712-48df-ace7-93cc61c32d84 tempest-VolumeImageDependencyTests-1086444190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:27:03 devstack sudo[104155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:27:03 devstack sudo[104155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:27:03 devstack sudo[104155]: pam_unix(sudo:session): session closed for user root Aug 29 01:27:03 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-825df3d9-0712-48df-ace7-93cc61c32d84 tempest-VolumeImageDependencyTests-1086444190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.260s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:27:03 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-825df3d9-0712-48df-ace7-93cc61c32d84 tempest-VolumeImageDependencyTests-1086444190 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:27:03 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-825df3d9-0712-48df-ace7-93cc61c32d84 tempest-VolumeImageDependencyTests-1086444190 None] Deleted volume successfully. Aug 29 01:27:03 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-825df3d9-0712-48df-ace7-93cc61c32d84 tempest-VolumeImageDependencyTests-1086444190 None] Lock "cinder-661a386a-68bd-4f88-824b-c553cc61204d-delete_volume" released by "delete_volume" :: held 1.086s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:27:06 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-761f1a2e-9bba-4244-9a02-1597a75be5d3 tempest-CinderUnicodeTest-2050719925 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:27:06 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-761f1a2e-9bba-4244-9a02-1597a75be5d3 tempest-CinderUnicodeTest-2050719925 None] Flow 'volume_create_manager' (192c6031-1c80-46a3-b87c-80d303371849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:27:06 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-761f1a2e-9bba-4244-9a02-1597a75be5d3 tempest-CinderUnicodeTest-2050719925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a1281b2-7ad7-42e4-a4bd-dcc5de37e89c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:27:06 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-761f1a2e-9bba-4244-9a02-1597a75be5d3 tempest-CinderUnicodeTest-2050719925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a1281b2-7ad7-42e4-a4bd-dcc5de37e89c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:27:06Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3f403c8-7a9a-49fb-975c-03c59a6eb11e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f357d45f0ed2403c8c2a571af2d0791d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:27:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:27:06Z,use_quota=True,user_id='07c4b0685f2e465485b74308dd38fa9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:27:06 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-761f1a2e-9bba-4244-9a02-1597a75be5d3 tempest-CinderUnicodeTest-2050719925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e882e21-0ff7-4f8c-8c84-23797e5a6d50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:27:06 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-761f1a2e-9bba-4244-9a02-1597a75be5d3 tempest-CinderUnicodeTest-2050719925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e882e21-0ff7-4f8c-8c84-23797e5a6d50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:27:06 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-761f1a2e-9bba-4244-9a02-1597a75be5d3 tempest-CinderUnicodeTest-2050719925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4670018-21ca-471e-89db-57af3f138dff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:27:06 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-761f1a2e-9bba-4244-9a02-1597a75be5d3 tempest-CinderUnicodeTest-2050719925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4670018-21ca-471e-89db-57af3f138dff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3f403c8-7a9a-49fb-975c-03c59a6eb11e', 'volume_name': 'volume-f3f403c8-7a9a-49fb-975c-03c59a6eb11e', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:27:06 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-761f1a2e-9bba-4244-9a02-1597a75be5d3 tempest-CinderUnicodeTest-2050719925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ecd001f-e278-4804-81ed-010430a61775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:27:06 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-761f1a2e-9bba-4244-9a02-1597a75be5d3 tempest-CinderUnicodeTest-2050719925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ecd001f-e278-4804-81ed-010430a61775) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:27:06 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-761f1a2e-9bba-4244-9a02-1597a75be5d3 tempest-CinderUnicodeTest-2050719925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dae46eb8-c128-4def-b1be-a61d7a92330f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:27:06 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-761f1a2e-9bba-4244-9a02-1597a75be5d3 tempest-CinderUnicodeTest-2050719925 None] Volume f3f403c8-7a9a-49fb-975c-03c59a6eb11e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3f403c8-7a9a-49fb-975c-03c59a6eb11e', 'volume_size': 1} Aug 29 01:27:06 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-761f1a2e-9bba-4244-9a02-1597a75be5d3 tempest-CinderUnicodeTest-2050719925 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:27:06 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-761f1a2e-9bba-4244-9a02-1597a75be5d3 tempest-CinderUnicodeTest-2050719925 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:27:06 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-761f1a2e-9bba-4244-9a02-1597a75be5d3 tempest-CinderUnicodeTest-2050719925 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:27:06Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3f403c8-7a9a-49fb-975c-03c59a6eb11e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f357d45f0ed2403c8c2a571af2d0791d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:27:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:27:06Z,use_quota=True,user_id='07c4b0685f2e465485b74308dd38fa9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:27:06 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-761f1a2e-9bba-4244-9a02-1597a75be5d3 tempest-CinderUnicodeTest-2050719925 None] Creating volume f3f403c8-7a9a-49fb-975c-03c59a6eb11e {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:27:06 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-761f1a2e-9bba-4244-9a02-1597a75be5d3 tempest-CinderUnicodeTest-2050719925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:27:06 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-761f1a2e-9bba-4244-9a02-1597a75be5d3 tempest-CinderUnicodeTest-2050719925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:27:06 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-761f1a2e-9bba-4244-9a02-1597a75be5d3 tempest-CinderUnicodeTest-2050719925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:27:06 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-761f1a2e-9bba-4244-9a02-1597a75be5d3 tempest-CinderUnicodeTest-2050719925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:27:06 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-761f1a2e-9bba-4244-9a02-1597a75be5d3 tempest-CinderUnicodeTest-2050719925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:27:06 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-761f1a2e-9bba-4244-9a02-1597a75be5d3 tempest-CinderUnicodeTest-2050719925 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:27:06 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-761f1a2e-9bba-4244-9a02-1597a75be5d3 tempest-CinderUnicodeTest-2050719925 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:27:06 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-761f1a2e-9bba-4244-9a02-1597a75be5d3 tempest-CinderUnicodeTest-2050719925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-f3f403c8-7a9a-49fb-975c-03c59a6eb11e 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:27:06 devstack sudo[104158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-f3f403c8-7a9a-49fb-975c-03c59a6eb11e 1073741824 Aug 29 01:27:06 devstack sudo[104158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:27:06 devstack sudo[104158]: pam_unix(sudo:session): session closed for user root Aug 29 01:27:06 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-761f1a2e-9bba-4244-9a02-1597a75be5d3 tempest-CinderUnicodeTest-2050719925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-f3f403c8-7a9a-49fb-975c-03c59a6eb11e 1073741824" returned: 0 in 0.398s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:27:07 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-761f1a2e-9bba-4244-9a02-1597a75be5d3 tempest-CinderUnicodeTest-2050719925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-f3f403c8-7a9a-49fb-975c-03c59a6eb11e {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:27:07 devstack sudo[104164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-f3f403c8-7a9a-49fb-975c-03c59a6eb11e Aug 29 01:27:07 devstack sudo[104164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:27:07 devstack sudo[104164]: pam_unix(sudo:session): session closed for user root Aug 29 01:27:07 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-761f1a2e-9bba-4244-9a02-1597a75be5d3 tempest-CinderUnicodeTest-2050719925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-f3f403c8-7a9a-49fb-975c-03c59a6eb11e" returned: 0 in 0.242s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:27:07 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-761f1a2e-9bba-4244-9a02-1597a75be5d3 tempest-CinderUnicodeTest-2050719925 None] <== create_volume: return (681ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:27:07 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-761f1a2e-9bba-4244-9a02-1597a75be5d3 tempest-CinderUnicodeTest-2050719925 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.684s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:27:07 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-761f1a2e-9bba-4244-9a02-1597a75be5d3 tempest-CinderUnicodeTest-2050719925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dae46eb8-c128-4def-b1be-a61d7a92330f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3f403c8-7a9a-49fb-975c-03c59a6eb11e', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:27:07 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-761f1a2e-9bba-4244-9a02-1597a75be5d3 tempest-CinderUnicodeTest-2050719925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fab70538-09d5-4165-a969-4abb19abfc2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:27:07 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-761f1a2e-9bba-4244-9a02-1597a75be5d3 tempest-CinderUnicodeTest-2050719925 None] Volume volume-f3f403c8-7a9a-49fb-975c-03c59a6eb11e (f3f403c8-7a9a-49fb-975c-03c59a6eb11e): created successfully Aug 29 01:27:07 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-761f1a2e-9bba-4244-9a02-1597a75be5d3 tempest-CinderUnicodeTest-2050719925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fab70538-09d5-4165-a969-4abb19abfc2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:27:07 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-761f1a2e-9bba-4244-9a02-1597a75be5d3 tempest-CinderUnicodeTest-2050719925 None] Flow 'volume_create_manager' (192c6031-1c80-46a3-b87c-80d303371849) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:27:07 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-761f1a2e-9bba-4244-9a02-1597a75be5d3 tempest-CinderUnicodeTest-2050719925 None] Created volume successfully. Aug 29 01:27:07 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d2f455d-0145-4bf2-9655-ae65ba198fdb tempest-CinderUnicodeTest-2050719925 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:27:07 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-2d2f455d-0145-4bf2-9655-ae65ba198fdb tempest-CinderUnicodeTest-2050719925 None] Flow 'volume_create_manager' (20ef889f-927e-44c7-9cc7-83975fdbb3db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:27:07 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-2d2f455d-0145-4bf2-9655-ae65ba198fdb tempest-CinderUnicodeTest-2050719925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb7755aa-1e26-42c0-817d-a5ff9d6fe70f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:27:07 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-2d2f455d-0145-4bf2-9655-ae65ba198fdb tempest-CinderUnicodeTest-2050719925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb7755aa-1e26-42c0-817d-a5ff9d6fe70f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:27:08Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2072237269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=878224b3-69e2-4ab9-9a4f-edf37690167a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f357d45f0ed2403c8c2a571af2d0791d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:27:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:27:08Z,use_quota=True,user_id='07c4b0685f2e465485b74308dd38fa9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:27:07 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-2d2f455d-0145-4bf2-9655-ae65ba198fdb tempest-CinderUnicodeTest-2050719925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00cc7439-4453-45bc-b154-87fe06fe0804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:27:08 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-2d2f455d-0145-4bf2-9655-ae65ba198fdb tempest-CinderUnicodeTest-2050719925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00cc7439-4453-45bc-b154-87fe06fe0804) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:27:08 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-2d2f455d-0145-4bf2-9655-ae65ba198fdb tempest-CinderUnicodeTest-2050719925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0999a6c5-2f1e-47aa-9582-6dc30318b613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:27:08 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-2d2f455d-0145-4bf2-9655-ae65ba198fdb tempest-CinderUnicodeTest-2050719925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0999a6c5-2f1e-47aa-9582-6dc30318b613) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '878224b3-69e2-4ab9-9a4f-edf37690167a', 'volume_name': 'volume-878224b3-69e2-4ab9-9a4f-edf37690167a', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:27:08 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-2d2f455d-0145-4bf2-9655-ae65ba198fdb tempest-CinderUnicodeTest-2050719925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cbfe8f3-9baf-441c-bbfb-cae5273d131e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:27:08 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-2d2f455d-0145-4bf2-9655-ae65ba198fdb tempest-CinderUnicodeTest-2050719925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cbfe8f3-9baf-441c-bbfb-cae5273d131e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:27:08 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-2d2f455d-0145-4bf2-9655-ae65ba198fdb tempest-CinderUnicodeTest-2050719925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19ba8aa1-6f98-4aa3-8811-90d3366b20b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:27:08 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-2d2f455d-0145-4bf2-9655-ae65ba198fdb tempest-CinderUnicodeTest-2050719925 None] Volume 878224b3-69e2-4ab9-9a4f-edf37690167a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-878224b3-69e2-4ab9-9a4f-edf37690167a', 'volume_size': 1} Aug 29 01:27:08 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-2d2f455d-0145-4bf2-9655-ae65ba198fdb tempest-CinderUnicodeTest-2050719925 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:27:08 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-2d2f455d-0145-4bf2-9655-ae65ba198fdb tempest-CinderUnicodeTest-2050719925 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:27:08 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-2d2f455d-0145-4bf2-9655-ae65ba198fdb tempest-CinderUnicodeTest-2050719925 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:27:08Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2072237269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=878224b3-69e2-4ab9-9a4f-edf37690167a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f357d45f0ed2403c8c2a571af2d0791d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:27:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:27:08Z,use_quota=True,user_id='07c4b0685f2e465485b74308dd38fa9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:27:08 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-2d2f455d-0145-4bf2-9655-ae65ba198fdb tempest-CinderUnicodeTest-2050719925 None] Creating volume 878224b3-69e2-4ab9-9a4f-edf37690167a {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:27:08 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-2d2f455d-0145-4bf2-9655-ae65ba198fdb tempest-CinderUnicodeTest-2050719925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:27:08 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-2d2f455d-0145-4bf2-9655-ae65ba198fdb tempest-CinderUnicodeTest-2050719925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:27:08 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-2d2f455d-0145-4bf2-9655-ae65ba198fdb tempest-CinderUnicodeTest-2050719925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:27:08 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-2d2f455d-0145-4bf2-9655-ae65ba198fdb tempest-CinderUnicodeTest-2050719925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:27:08 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-2d2f455d-0145-4bf2-9655-ae65ba198fdb tempest-CinderUnicodeTest-2050719925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:27:08 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-2d2f455d-0145-4bf2-9655-ae65ba198fdb tempest-CinderUnicodeTest-2050719925 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:27:08 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-2d2f455d-0145-4bf2-9655-ae65ba198fdb tempest-CinderUnicodeTest-2050719925 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:27:08 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-2d2f455d-0145-4bf2-9655-ae65ba198fdb tempest-CinderUnicodeTest-2050719925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-878224b3-69e2-4ab9-9a4f-edf37690167a 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:27:08 devstack sudo[104167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-878224b3-69e2-4ab9-9a4f-edf37690167a 1073741824 Aug 29 01:27:08 devstack sudo[104167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:27:08 devstack sudo[104167]: pam_unix(sudo:session): session closed for user root Aug 29 01:27:08 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-2d2f455d-0145-4bf2-9655-ae65ba198fdb tempest-CinderUnicodeTest-2050719925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-878224b3-69e2-4ab9-9a4f-edf37690167a 1073741824" returned: 0 in 0.397s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:27:08 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-2d2f455d-0145-4bf2-9655-ae65ba198fdb tempest-CinderUnicodeTest-2050719925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-878224b3-69e2-4ab9-9a4f-edf37690167a {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:27:08 devstack sudo[104173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-878224b3-69e2-4ab9-9a4f-edf37690167a Aug 29 01:27:08 devstack sudo[104173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:27:08 devstack sudo[104173]: pam_unix(sudo:session): session closed for user root Aug 29 01:27:08 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-2d2f455d-0145-4bf2-9655-ae65ba198fdb tempest-CinderUnicodeTest-2050719925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-878224b3-69e2-4ab9-9a4f-edf37690167a" returned: 0 in 0.256s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:27:08 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-2d2f455d-0145-4bf2-9655-ae65ba198fdb tempest-CinderUnicodeTest-2050719925 None] <== create_volume: return (694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:27:08 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-2d2f455d-0145-4bf2-9655-ae65ba198fdb tempest-CinderUnicodeTest-2050719925 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.698s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:27:08 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-2d2f455d-0145-4bf2-9655-ae65ba198fdb tempest-CinderUnicodeTest-2050719925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19ba8aa1-6f98-4aa3-8811-90d3366b20b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-878224b3-69e2-4ab9-9a4f-edf37690167a', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:27:08 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-2d2f455d-0145-4bf2-9655-ae65ba198fdb tempest-CinderUnicodeTest-2050719925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3b68cdd-8067-4229-99a5-ed341d105c3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:27:08 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-2d2f455d-0145-4bf2-9655-ae65ba198fdb tempest-CinderUnicodeTest-2050719925 None] Volume volume-878224b3-69e2-4ab9-9a4f-edf37690167a (878224b3-69e2-4ab9-9a4f-edf37690167a): created successfully Aug 29 01:27:08 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-2d2f455d-0145-4bf2-9655-ae65ba198fdb tempest-CinderUnicodeTest-2050719925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3b68cdd-8067-4229-99a5-ed341d105c3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:27:08 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-2d2f455d-0145-4bf2-9655-ae65ba198fdb tempest-CinderUnicodeTest-2050719925 None] Flow 'volume_create_manager' (20ef889f-927e-44c7-9cc7-83975fdbb3db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:27:08 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-2d2f455d-0145-4bf2-9655-ae65ba198fdb tempest-CinderUnicodeTest-2050719925 None] Created volume successfully. Aug 29 01:27:09 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-800905e3-af03-4ff7-a0e9-167804aefd5a tempest-CinderUnicodeTest-2050719925 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:27:09 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-800905e3-af03-4ff7-a0e9-167804aefd5a tempest-CinderUnicodeTest-2050719925 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:27:09 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-800905e3-af03-4ff7-a0e9-167804aefd5a tempest-CinderUnicodeTest-2050719925 None] Creating offline snapshot 6e623098-fd06-4732-b6e5-84e16da6d035 of volume 878224b3-69e2-4ab9-9a4f-edf37690167a {{(pid=86111) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 29 01:27:09 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[212c3ddf-a543-4e5e-9b33-e985cb989b58]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:27:09 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-800905e3-af03-4ff7-a0e9-167804aefd5a tempest-CinderUnicodeTest-2050719925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-878224b3-69e2-4ab9-9a4f-edf37690167a {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:27:09 devstack sudo[104176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-878224b3-69e2-4ab9-9a4f-edf37690167a Aug 29 01:27:09 devstack sudo[104176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:27:09 devstack sudo[104176]: pam_unix(sudo:session): session closed for user root Aug 29 01:27:09 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-800905e3-af03-4ff7-a0e9-167804aefd5a tempest-CinderUnicodeTest-2050719925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-878224b3-69e2-4ab9-9a4f-edf37690167a" returned: 0 in 0.363s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:27:09 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-800905e3-af03-4ff7-a0e9-167804aefd5a tempest-CinderUnicodeTest-2050719925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-878224b3-69e2-4ab9-9a4f-edf37690167a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-878224b3-69e2-4ab9-9a4f-edf37690167a.6e623098-fd06-4732-b6e5-84e16da6d035 1G {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:27:09 devstack sudo[104182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-878224b3-69e2-4ab9-9a4f-edf37690167a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-878224b3-69e2-4ab9-9a4f-edf37690167a.6e623098-fd06-4732-b6e5-84e16da6d035 1G Aug 29 01:27:09 devstack sudo[104182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:27:09 devstack sudo[104182]: pam_unix(sudo:session): session closed for user root Aug 29 01:27:09 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-800905e3-af03-4ff7-a0e9-167804aefd5a tempest-CinderUnicodeTest-2050719925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-878224b3-69e2-4ab9-9a4f-edf37690167a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-878224b3-69e2-4ab9-9a4f-edf37690167a.6e623098-fd06-4732-b6e5-84e16da6d035 1G" returned: 0 in 0.384s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:27:09 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-800905e3-af03-4ff7-a0e9-167804aefd5a tempest-CinderUnicodeTest-2050719925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-878224b3-69e2-4ab9-9a4f-edf37690167a -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-878224b3-69e2-4ab9-9a4f-edf37690167a.6e623098-fd06-4732-b6e5-84e16da6d035 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:27:09 devstack sudo[104187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-878224b3-69e2-4ab9-9a4f-edf37690167a -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-878224b3-69e2-4ab9-9a4f-edf37690167a.6e623098-fd06-4732-b6e5-84e16da6d035 Aug 29 01:27:09 devstack sudo[104187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:27:10 devstack sudo[104187]: pam_unix(sudo:session): session closed for user root Aug 29 01:27:10 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-800905e3-af03-4ff7-a0e9-167804aefd5a tempest-CinderUnicodeTest-2050719925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-878224b3-69e2-4ab9-9a4f-edf37690167a -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-878224b3-69e2-4ab9-9a4f-edf37690167a.6e623098-fd06-4732-b6e5-84e16da6d035" returned: 0 in 0.286s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:27:10 devstack cinder-volume[86111]: WARNING cinder.volume.drivers.remotefs [None req-800905e3-af03-4ff7-a0e9-167804aefd5a tempest-CinderUnicodeTest-2050719925 None] /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-878224b3-69e2-4ab9-9a4f-edf37690167a.6e623098-fd06-4732-b6e5-84e16da6d035 is being set with open permissions: ugo+rw Aug 29 01:27:10 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-800905e3-af03-4ff7-a0e9-167804aefd5a tempest-CinderUnicodeTest-2050719925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-878224b3-69e2-4ab9-9a4f-edf37690167a.6e623098-fd06-4732-b6e5-84e16da6d035 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:27:10 devstack sudo[104193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-878224b3-69e2-4ab9-9a4f-edf37690167a.6e623098-fd06-4732-b6e5-84e16da6d035 Aug 29 01:27:10 devstack sudo[104193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:27:10 devstack sudo[104193]: pam_unix(sudo:session): session closed for user root Aug 29 01:27:10 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-800905e3-af03-4ff7-a0e9-167804aefd5a tempest-CinderUnicodeTest-2050719925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-878224b3-69e2-4ab9-9a4f-edf37690167a.6e623098-fd06-4732-b6e5-84e16da6d035" returned: 0 in 0.236s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:27:10 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-800905e3-af03-4ff7-a0e9-167804aefd5a tempest-CinderUnicodeTest-2050719925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-878224b3-69e2-4ab9-9a4f-edf37690167a.info {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:27:10 devstack sudo[104196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-878224b3-69e2-4ab9-9a4f-edf37690167a.info Aug 29 01:27:10 devstack sudo[104196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:27:10 devstack sudo[104196]: pam_unix(sudo:session): session closed for user root Aug 29 01:27:10 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-800905e3-af03-4ff7-a0e9-167804aefd5a tempest-CinderUnicodeTest-2050719925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-878224b3-69e2-4ab9-9a4f-edf37690167a.info" returned: 0 in 0.240s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:27:10 devstack cinder-volume[86111]: WARNING cinder.volume.drivers.remotefs [None req-800905e3-af03-4ff7-a0e9-167804aefd5a tempest-CinderUnicodeTest-2050719925 None] /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-878224b3-69e2-4ab9-9a4f-edf37690167a.info is being set with open permissions: ugo+rw Aug 29 01:27:10 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-800905e3-af03-4ff7-a0e9-167804aefd5a tempest-CinderUnicodeTest-2050719925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-878224b3-69e2-4ab9-9a4f-edf37690167a.info {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:27:10 devstack sudo[104199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-878224b3-69e2-4ab9-9a4f-edf37690167a.info Aug 29 01:27:10 devstack sudo[104199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:27:10 devstack sudo[104199]: pam_unix(sudo:session): session closed for user root Aug 29 01:27:10 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-800905e3-af03-4ff7-a0e9-167804aefd5a tempest-CinderUnicodeTest-2050719925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-878224b3-69e2-4ab9-9a4f-edf37690167a.info" returned: 0 in 0.235s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:27:11 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-800905e3-af03-4ff7-a0e9-167804aefd5a tempest-CinderUnicodeTest-2050719925 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.822s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:27:11 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-800905e3-af03-4ff7-a0e9-167804aefd5a tempest-CinderUnicodeTest-2050719925 None] Create snapshot completed successfully Aug 29 01:27:11 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-01f47aae-fe36-490d-9caf-e916812cf1e2 tempest-CinderUnicodeTest-2050719925 None] Acquiring lock "cinder-6e623098-fd06-4732-b6e5-84e16da6d035-delete_snapshot" by "delete_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:27:11 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-01f47aae-fe36-490d-9caf-e916812cf1e2 tempest-CinderUnicodeTest-2050719925 None] Lock "cinder-6e623098-fd06-4732-b6e5-84e16da6d035-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:27:11 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-01f47aae-fe36-490d-9caf-e916812cf1e2 tempest-CinderUnicodeTest-2050719925 None] Acquiring lock "cinder-quobyte-878224b3-69e2-4ab9-9a4f-edf37690167a" by "delete_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:27:11 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-01f47aae-fe36-490d-9caf-e916812cf1e2 tempest-CinderUnicodeTest-2050719925 None] Lock "cinder-quobyte-878224b3-69e2-4ab9-9a4f-edf37690167a" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:27:11 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-01f47aae-fe36-490d-9caf-e916812cf1e2 tempest-CinderUnicodeTest-2050719925 None] Acquiring lock "cinder-quobyte-6e623098-fd06-4732-b6e5-84e16da6d035" by "_delete_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:27:11 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-01f47aae-fe36-490d-9caf-e916812cf1e2 tempest-CinderUnicodeTest-2050719925 None] Lock "cinder-quobyte-6e623098-fd06-4732-b6e5-84e16da6d035" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:27:11 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-01f47aae-fe36-490d-9caf-e916812cf1e2 tempest-CinderUnicodeTest-2050719925 None] Deleting offline snapshot 6e623098-fd06-4732-b6e5-84e16da6d035 of volume 878224b3-69e2-4ab9-9a4f-edf37690167a {{(pid=86111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 29 01:27:11 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-01f47aae-fe36-490d-9caf-e916812cf1e2 tempest-CinderUnicodeTest-2050719925 None] snapshot_file for this snap is: volume-878224b3-69e2-4ab9-9a4f-edf37690167a.6e623098-fd06-4732-b6e5-84e16da6d035 {{(pid=86111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 29 01:27:11 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[09e764f6-3934-4f24-99aa-25a305cf907e]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:27:11 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-01f47aae-fe36-490d-9caf-e916812cf1e2 tempest-CinderUnicodeTest-2050719925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-878224b3-69e2-4ab9-9a4f-edf37690167a.6e623098-fd06-4732-b6e5-84e16da6d035 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:27:11 devstack sudo[104202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-878224b3-69e2-4ab9-9a4f-edf37690167a.6e623098-fd06-4732-b6e5-84e16da6d035 Aug 29 01:27:11 devstack sudo[104202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:27:11 devstack sudo[104202]: pam_unix(sudo:session): session closed for user root Aug 29 01:27:11 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-01f47aae-fe36-490d-9caf-e916812cf1e2 tempest-CinderUnicodeTest-2050719925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-878224b3-69e2-4ab9-9a4f-edf37690167a.6e623098-fd06-4732-b6e5-84e16da6d035" returned: 0 in 0.373s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:27:11 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-01f47aae-fe36-490d-9caf-e916812cf1e2 tempest-CinderUnicodeTest-2050719925 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-878224b3-69e2-4ab9-9a4f-edf37690167a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 29 01:27:11 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b5d6916-bd2d-470d-aed8-81baf281bd5d]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:27:11 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-01f47aae-fe36-490d-9caf-e916812cf1e2 tempest-CinderUnicodeTest-2050719925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-878224b3-69e2-4ab9-9a4f-edf37690167a {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:27:11 devstack sudo[104209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-878224b3-69e2-4ab9-9a4f-edf37690167a Aug 29 01:27:11 devstack sudo[104209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:27:12 devstack sudo[104209]: pam_unix(sudo:session): session closed for user root Aug 29 01:27:12 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-01f47aae-fe36-490d-9caf-e916812cf1e2 tempest-CinderUnicodeTest-2050719925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-878224b3-69e2-4ab9-9a4f-edf37690167a" returned: 0 in 0.350s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:27:12 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-01f47aae-fe36-490d-9caf-e916812cf1e2 tempest-CinderUnicodeTest-2050719925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-878224b3-69e2-4ab9-9a4f-edf37690167a.6e623098-fd06-4732-b6e5-84e16da6d035 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:27:12 devstack sudo[104214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-878224b3-69e2-4ab9-9a4f-edf37690167a.6e623098-fd06-4732-b6e5-84e16da6d035 Aug 29 01:27:12 devstack sudo[104214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:27:12 devstack sudo[104214]: pam_unix(sudo:session): session closed for user root Aug 29 01:27:12 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-01f47aae-fe36-490d-9caf-e916812cf1e2 tempest-CinderUnicodeTest-2050719925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-878224b3-69e2-4ab9-9a4f-edf37690167a.6e623098-fd06-4732-b6e5-84e16da6d035" returned: 0 in 0.327s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:27:12 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-01f47aae-fe36-490d-9caf-e916812cf1e2 tempest-CinderUnicodeTest-2050719925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-878224b3-69e2-4ab9-9a4f-edf37690167a.6e623098-fd06-4732-b6e5-84e16da6d035 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:27:12 devstack sudo[104219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-878224b3-69e2-4ab9-9a4f-edf37690167a.6e623098-fd06-4732-b6e5-84e16da6d035 Aug 29 01:27:12 devstack sudo[104219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:27:12 devstack sudo[104219]: pam_unix(sudo:session): session closed for user root Aug 29 01:27:12 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-01f47aae-fe36-490d-9caf-e916812cf1e2 tempest-CinderUnicodeTest-2050719925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-878224b3-69e2-4ab9-9a4f-edf37690167a.6e623098-fd06-4732-b6e5-84e16da6d035" returned: 0 in 0.242s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:27:12 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-01f47aae-fe36-490d-9caf-e916812cf1e2 tempest-CinderUnicodeTest-2050719925 None] Lock "cinder-quobyte-6e623098-fd06-4732-b6e5-84e16da6d035" released by "_delete_snapshot" :: held 1.389s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:27:12 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-01f47aae-fe36-490d-9caf-e916812cf1e2 tempest-CinderUnicodeTest-2050719925 None] Lock "cinder-quobyte-878224b3-69e2-4ab9-9a4f-edf37690167a" released by "delete_snapshot" :: held 1.412s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:27:12 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-01f47aae-fe36-490d-9caf-e916812cf1e2 tempest-CinderUnicodeTest-2050719925 None] Created reservations ['74639943-ef5b-4432-9cbe-aac89fa2a45c', '97986dbd-6cbc-44c3-994f-6e12016b964c', '3f4a1eaa-1f49-49bb-aaf6-2c0ea58d9420', '80004d37-d28d-4a42-a7c8-5611b424fa36'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:27:12 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-01f47aae-fe36-490d-9caf-e916812cf1e2 tempest-CinderUnicodeTest-2050719925 None] Delete snapshot completed successfully. Aug 29 01:27:12 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-01f47aae-fe36-490d-9caf-e916812cf1e2 tempest-CinderUnicodeTest-2050719925 None] Lock "cinder-6e623098-fd06-4732-b6e5-84e16da6d035-delete_snapshot" released by "delete_snapshot" :: held 1.549s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:27:13 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-633b3bb9-593d-49ff-88a5-a40b33ed287e tempest-CinderUnicodeTest-2050719925 None] Acquiring lock "cinder-878224b3-69e2-4ab9-9a4f-edf37690167a-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:27:13 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-633b3bb9-593d-49ff-88a5-a40b33ed287e tempest-CinderUnicodeTest-2050719925 None] Lock "cinder-878224b3-69e2-4ab9-9a4f-edf37690167a-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:27:13 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-633b3bb9-593d-49ff-88a5-a40b33ed287e tempest-CinderUnicodeTest-2050719925 None] Acquiring lock "cinder-quobyte-878224b3-69e2-4ab9-9a4f-edf37690167a" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:27:13 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-633b3bb9-593d-49ff-88a5-a40b33ed287e tempest-CinderUnicodeTest-2050719925 None] Lock "cinder-quobyte-878224b3-69e2-4ab9-9a4f-edf37690167a" acquired by "delete_volume" :: waited 0.013s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:27:13 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ebb8e05-9a76-4924-a54e-64eae1ed0c16]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:27:13 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-633b3bb9-593d-49ff-88a5-a40b33ed287e tempest-CinderUnicodeTest-2050719925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-878224b3-69e2-4ab9-9a4f-edf37690167a {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:27:13 devstack sudo[104222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-878224b3-69e2-4ab9-9a4f-edf37690167a Aug 29 01:27:13 devstack sudo[104222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:27:13 devstack sudo[104222]: pam_unix(sudo:session): session closed for user root Aug 29 01:27:13 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-633b3bb9-593d-49ff-88a5-a40b33ed287e tempest-CinderUnicodeTest-2050719925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-878224b3-69e2-4ab9-9a4f-edf37690167a" returned: 0 in 0.355s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:27:13 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-633b3bb9-593d-49ff-88a5-a40b33ed287e tempest-CinderUnicodeTest-2050719925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-878224b3-69e2-4ab9-9a4f-edf37690167a {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:27:13 devstack sudo[104228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-878224b3-69e2-4ab9-9a4f-edf37690167a Aug 29 01:27:13 devstack sudo[104228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:27:14 devstack sudo[104228]: pam_unix(sudo:session): session closed for user root Aug 29 01:27:14 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-633b3bb9-593d-49ff-88a5-a40b33ed287e tempest-CinderUnicodeTest-2050719925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-878224b3-69e2-4ab9-9a4f-edf37690167a" returned: 0 in 0.240s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:27:14 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-633b3bb9-593d-49ff-88a5-a40b33ed287e tempest-CinderUnicodeTest-2050719925 None] Lock "cinder-quobyte-878224b3-69e2-4ab9-9a4f-edf37690167a" released by "delete_volume" :: held 0.650s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:27:14 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-633b3bb9-593d-49ff-88a5-a40b33ed287e tempest-CinderUnicodeTest-2050719925 None] Created reservations ['493be539-89b8-4a1f-9420-b4adac5d8d9d', '96f65d58-33dd-4bf5-859f-9d096d401e0c', '977745f6-92e1-4968-b2db-d104681e66c8', 'f05c3596-de1c-473b-9528-704a3f9f45e9'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:27:14 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-633b3bb9-593d-49ff-88a5-a40b33ed287e tempest-CinderUnicodeTest-2050719925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:27:14 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-633b3bb9-593d-49ff-88a5-a40b33ed287e tempest-CinderUnicodeTest-2050719925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:27:14 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-633b3bb9-593d-49ff-88a5-a40b33ed287e tempest-CinderUnicodeTest-2050719925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:27:14 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-633b3bb9-593d-49ff-88a5-a40b33ed287e tempest-CinderUnicodeTest-2050719925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:27:14 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-633b3bb9-593d-49ff-88a5-a40b33ed287e tempest-CinderUnicodeTest-2050719925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:27:14 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-633b3bb9-593d-49ff-88a5-a40b33ed287e tempest-CinderUnicodeTest-2050719925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:27:14 devstack sudo[104231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:27:14 devstack sudo[104231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:27:14 devstack sudo[104231]: pam_unix(sudo:session): session closed for user root Aug 29 01:27:14 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-633b3bb9-593d-49ff-88a5-a40b33ed287e tempest-CinderUnicodeTest-2050719925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.246s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:27:14 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-633b3bb9-593d-49ff-88a5-a40b33ed287e tempest-CinderUnicodeTest-2050719925 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:27:14 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-633b3bb9-593d-49ff-88a5-a40b33ed287e tempest-CinderUnicodeTest-2050719925 None] Deleted volume successfully. Aug 29 01:27:14 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-633b3bb9-593d-49ff-88a5-a40b33ed287e tempest-CinderUnicodeTest-2050719925 None] Lock "cinder-878224b3-69e2-4ab9-9a4f-edf37690167a-delete_volume" released by "delete_volume" :: held 1.068s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:27:14 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-f22c0adb-cfa3-4d5e-abda-58d57d20ee8f tempest-CinderUnicodeTest-2050719925 None] Acquiring lock "cinder-f3f403c8-7a9a-49fb-975c-03c59a6eb11e-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:27:14 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-f22c0adb-cfa3-4d5e-abda-58d57d20ee8f tempest-CinderUnicodeTest-2050719925 None] Lock "cinder-f3f403c8-7a9a-49fb-975c-03c59a6eb11e-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:27:14 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-f22c0adb-cfa3-4d5e-abda-58d57d20ee8f tempest-CinderUnicodeTest-2050719925 None] Acquiring lock "cinder-quobyte-f3f403c8-7a9a-49fb-975c-03c59a6eb11e" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:27:14 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-f22c0adb-cfa3-4d5e-abda-58d57d20ee8f tempest-CinderUnicodeTest-2050719925 None] Lock "cinder-quobyte-f3f403c8-7a9a-49fb-975c-03c59a6eb11e" acquired by "delete_volume" :: waited 0.020s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:27:14 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[00fcf590-4c92-4e53-9e80-985fdf14a62a]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:27:14 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-f22c0adb-cfa3-4d5e-abda-58d57d20ee8f tempest-CinderUnicodeTest-2050719925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-f3f403c8-7a9a-49fb-975c-03c59a6eb11e {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:27:14 devstack sudo[104234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-f3f403c8-7a9a-49fb-975c-03c59a6eb11e Aug 29 01:27:14 devstack sudo[104234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:27:15 devstack sudo[104234]: pam_unix(sudo:session): session closed for user root Aug 29 01:27:15 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-f22c0adb-cfa3-4d5e-abda-58d57d20ee8f tempest-CinderUnicodeTest-2050719925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-f3f403c8-7a9a-49fb-975c-03c59a6eb11e" returned: 0 in 0.345s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:27:15 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-f22c0adb-cfa3-4d5e-abda-58d57d20ee8f tempest-CinderUnicodeTest-2050719925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-f3f403c8-7a9a-49fb-975c-03c59a6eb11e {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:27:15 devstack sudo[104239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-f3f403c8-7a9a-49fb-975c-03c59a6eb11e Aug 29 01:27:15 devstack sudo[104239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:27:15 devstack sudo[104239]: pam_unix(sudo:session): session closed for user root Aug 29 01:27:15 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-f22c0adb-cfa3-4d5e-abda-58d57d20ee8f tempest-CinderUnicodeTest-2050719925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-f3f403c8-7a9a-49fb-975c-03c59a6eb11e" returned: 0 in 0.237s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:27:15 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-f22c0adb-cfa3-4d5e-abda-58d57d20ee8f tempest-CinderUnicodeTest-2050719925 None] Lock "cinder-quobyte-f3f403c8-7a9a-49fb-975c-03c59a6eb11e" released by "delete_volume" :: held 0.618s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:27:15 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-f22c0adb-cfa3-4d5e-abda-58d57d20ee8f tempest-CinderUnicodeTest-2050719925 None] Created reservations ['fed270c3-d084-43d1-91ce-afedfdd9b486', '682e3975-209c-4536-843b-68df5ef7df08', '24502c81-9f1c-4d17-9fa6-d9fed439e495', '91218a4a-2e5f-4e03-9847-a2b5b1a91a69'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:27:15 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-f22c0adb-cfa3-4d5e-abda-58d57d20ee8f tempest-CinderUnicodeTest-2050719925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:27:15 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-f22c0adb-cfa3-4d5e-abda-58d57d20ee8f tempest-CinderUnicodeTest-2050719925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:27:15 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-f22c0adb-cfa3-4d5e-abda-58d57d20ee8f tempest-CinderUnicodeTest-2050719925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:27:15 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-f22c0adb-cfa3-4d5e-abda-58d57d20ee8f tempest-CinderUnicodeTest-2050719925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:27:15 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-f22c0adb-cfa3-4d5e-abda-58d57d20ee8f tempest-CinderUnicodeTest-2050719925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:27:15 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-f22c0adb-cfa3-4d5e-abda-58d57d20ee8f tempest-CinderUnicodeTest-2050719925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:27:15 devstack sudo[104242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:27:15 devstack sudo[104242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:27:15 devstack sudo[104242]: pam_unix(sudo:session): session closed for user root Aug 29 01:27:15 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-f22c0adb-cfa3-4d5e-abda-58d57d20ee8f tempest-CinderUnicodeTest-2050719925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.237s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:27:15 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-f22c0adb-cfa3-4d5e-abda-58d57d20ee8f tempest-CinderUnicodeTest-2050719925 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:27:15 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-f22c0adb-cfa3-4d5e-abda-58d57d20ee8f tempest-CinderUnicodeTest-2050719925 None] Deleted volume successfully. Aug 29 01:27:15 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-f22c0adb-cfa3-4d5e-abda-58d57d20ee8f tempest-CinderUnicodeTest-2050719925 None] Lock "cinder-f3f403c8-7a9a-49fb-975c-03c59a6eb11e-delete_volume" released by "delete_volume" :: held 1.041s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:27:18 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-1828d138-e334-4fae-a2c2-3580edf4869a tempest-ProjectReaderTests-575634088 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:27:18 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-1828d138-e334-4fae-a2c2-3580edf4869a tempest-ProjectReaderTests-575634088 None] Flow 'volume_create_manager' (739163de-2ff1-4eb4-a46f-bc64970d95b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:27:18 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-1828d138-e334-4fae-a2c2-3580edf4869a tempest-ProjectReaderTests-575634088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7ebc72f-2b84-41e2-904d-a48c2ad88036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:27:18 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-1828d138-e334-4fae-a2c2-3580edf4869a tempest-ProjectReaderTests-575634088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7ebc72f-2b84-41e2-904d-a48c2ad88036) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:27:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-901058110',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81413f78-5751-4701-b1c6-ab51f4f0ea86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49528e3c8ec640c88cb663ac75077161',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:27:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:27:19Z,use_quota=True,user_id='0783635902954ca6a5e6dde76a7e3a02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:27:18 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-1828d138-e334-4fae-a2c2-3580edf4869a tempest-ProjectReaderTests-575634088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff1d7090-a10c-4b6f-ba4d-c553af2d6b70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:27:18 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-1828d138-e334-4fae-a2c2-3580edf4869a tempest-ProjectReaderTests-575634088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff1d7090-a10c-4b6f-ba4d-c553af2d6b70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:27:18 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-1828d138-e334-4fae-a2c2-3580edf4869a tempest-ProjectReaderTests-575634088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddecc958-799b-4987-b5b0-1d8ccc8afe5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:27:18 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-1828d138-e334-4fae-a2c2-3580edf4869a tempest-ProjectReaderTests-575634088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddecc958-799b-4987-b5b0-1d8ccc8afe5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81413f78-5751-4701-b1c6-ab51f4f0ea86', 'volume_name': 'volume-81413f78-5751-4701-b1c6-ab51f4f0ea86', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:27:18 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-1828d138-e334-4fae-a2c2-3580edf4869a tempest-ProjectReaderTests-575634088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14bbd99a-c3b9-4ba5-9eaf-6f6fe417c61b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:27:18 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-1828d138-e334-4fae-a2c2-3580edf4869a tempest-ProjectReaderTests-575634088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14bbd99a-c3b9-4ba5-9eaf-6f6fe417c61b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:27:18 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-1828d138-e334-4fae-a2c2-3580edf4869a tempest-ProjectReaderTests-575634088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0557e992-9df8-41bd-b545-32a987280f97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:27:18 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-1828d138-e334-4fae-a2c2-3580edf4869a tempest-ProjectReaderTests-575634088 None] Volume 81413f78-5751-4701-b1c6-ab51f4f0ea86: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81413f78-5751-4701-b1c6-ab51f4f0ea86', 'volume_size': 1} Aug 29 01:27:18 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-1828d138-e334-4fae-a2c2-3580edf4869a tempest-ProjectReaderTests-575634088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:27:18 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-1828d138-e334-4fae-a2c2-3580edf4869a tempest-ProjectReaderTests-575634088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:27:18 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-1828d138-e334-4fae-a2c2-3580edf4869a tempest-ProjectReaderTests-575634088 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:27:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-901058110',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81413f78-5751-4701-b1c6-ab51f4f0ea86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49528e3c8ec640c88cb663ac75077161',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:27:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:27:19Z,use_quota=True,user_id='0783635902954ca6a5e6dde76a7e3a02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:27:18 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-1828d138-e334-4fae-a2c2-3580edf4869a tempest-ProjectReaderTests-575634088 None] Creating volume 81413f78-5751-4701-b1c6-ab51f4f0ea86 {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:27:18 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-1828d138-e334-4fae-a2c2-3580edf4869a tempest-ProjectReaderTests-575634088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:27:18 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-1828d138-e334-4fae-a2c2-3580edf4869a tempest-ProjectReaderTests-575634088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:27:18 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-1828d138-e334-4fae-a2c2-3580edf4869a tempest-ProjectReaderTests-575634088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:27:18 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-1828d138-e334-4fae-a2c2-3580edf4869a tempest-ProjectReaderTests-575634088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:27:18 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-1828d138-e334-4fae-a2c2-3580edf4869a tempest-ProjectReaderTests-575634088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:27:18 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-1828d138-e334-4fae-a2c2-3580edf4869a tempest-ProjectReaderTests-575634088 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:27:18 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-1828d138-e334-4fae-a2c2-3580edf4869a tempest-ProjectReaderTests-575634088 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:27:18 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-1828d138-e334-4fae-a2c2-3580edf4869a tempest-ProjectReaderTests-575634088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-81413f78-5751-4701-b1c6-ab51f4f0ea86 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:27:19 devstack sudo[104246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-81413f78-5751-4701-b1c6-ab51f4f0ea86 1073741824 Aug 29 01:27:19 devstack sudo[104246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:27:19 devstack sudo[104246]: pam_unix(sudo:session): session closed for user root Aug 29 01:27:19 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-1828d138-e334-4fae-a2c2-3580edf4869a tempest-ProjectReaderTests-575634088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-81413f78-5751-4701-b1c6-ab51f4f0ea86 1073741824" returned: 0 in 0.390s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:27:19 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-1828d138-e334-4fae-a2c2-3580edf4869a tempest-ProjectReaderTests-575634088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-81413f78-5751-4701-b1c6-ab51f4f0ea86 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:27:19 devstack sudo[104252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-81413f78-5751-4701-b1c6-ab51f4f0ea86 Aug 29 01:27:19 devstack sudo[104252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:27:19 devstack sudo[104252]: pam_unix(sudo:session): session closed for user root Aug 29 01:27:19 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-1828d138-e334-4fae-a2c2-3580edf4869a tempest-ProjectReaderTests-575634088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-81413f78-5751-4701-b1c6-ab51f4f0ea86" returned: 0 in 0.235s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:27:19 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-1828d138-e334-4fae-a2c2-3580edf4869a tempest-ProjectReaderTests-575634088 None] <== create_volume: return (666ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:27:19 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-1828d138-e334-4fae-a2c2-3580edf4869a tempest-ProjectReaderTests-575634088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.669s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:27:19 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-1828d138-e334-4fae-a2c2-3580edf4869a tempest-ProjectReaderTests-575634088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0557e992-9df8-41bd-b545-32a987280f97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81413f78-5751-4701-b1c6-ab51f4f0ea86', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:27:19 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-1828d138-e334-4fae-a2c2-3580edf4869a tempest-ProjectReaderTests-575634088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4773fc2-2e6d-4c13-aba8-e109f25d4473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:27:19 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-1828d138-e334-4fae-a2c2-3580edf4869a tempest-ProjectReaderTests-575634088 None] Volume volume-81413f78-5751-4701-b1c6-ab51f4f0ea86 (81413f78-5751-4701-b1c6-ab51f4f0ea86): created successfully Aug 29 01:27:19 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-1828d138-e334-4fae-a2c2-3580edf4869a tempest-ProjectReaderTests-575634088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4773fc2-2e6d-4c13-aba8-e109f25d4473) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:27:19 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-1828d138-e334-4fae-a2c2-3580edf4869a tempest-ProjectReaderTests-575634088 None] Flow 'volume_create_manager' (739163de-2ff1-4eb4-a46f-bc64970d95b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:27:19 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-1828d138-e334-4fae-a2c2-3580edf4869a tempest-ProjectReaderTests-575634088 None] Created volume successfully. Aug 29 01:27:20 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-c4649c20-5c16-4126-883f-4c08207a6dc2 tempest-ProjectReaderTests-575634088 None] Acquiring lock "cinder-81413f78-5751-4701-b1c6-ab51f4f0ea86-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:27:20 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-c4649c20-5c16-4126-883f-4c08207a6dc2 tempest-ProjectReaderTests-575634088 None] Lock "cinder-81413f78-5751-4701-b1c6-ab51f4f0ea86-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:27:20 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-c4649c20-5c16-4126-883f-4c08207a6dc2 tempest-ProjectReaderTests-575634088 None] Acquiring lock "cinder-quobyte-81413f78-5751-4701-b1c6-ab51f4f0ea86" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:27:20 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-c4649c20-5c16-4126-883f-4c08207a6dc2 tempest-ProjectReaderTests-575634088 None] Lock "cinder-quobyte-81413f78-5751-4701-b1c6-ab51f4f0ea86" acquired by "delete_volume" :: waited 0.013s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:27:20 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[543b9cd3-cc61-441b-a88c-406ba4ce522b]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:27:20 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c4649c20-5c16-4126-883f-4c08207a6dc2 tempest-ProjectReaderTests-575634088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-81413f78-5751-4701-b1c6-ab51f4f0ea86 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:27:20 devstack sudo[104255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-81413f78-5751-4701-b1c6-ab51f4f0ea86 Aug 29 01:27:20 devstack sudo[104255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:27:20 devstack sudo[104255]: pam_unix(sudo:session): session closed for user root Aug 29 01:27:20 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c4649c20-5c16-4126-883f-4c08207a6dc2 tempest-ProjectReaderTests-575634088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-81413f78-5751-4701-b1c6-ab51f4f0ea86" returned: 0 in 0.342s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:27:20 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c4649c20-5c16-4126-883f-4c08207a6dc2 tempest-ProjectReaderTests-575634088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-81413f78-5751-4701-b1c6-ab51f4f0ea86 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:27:20 devstack sudo[104260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-81413f78-5751-4701-b1c6-ab51f4f0ea86 Aug 29 01:27:20 devstack sudo[104260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:27:20 devstack sudo[104260]: pam_unix(sudo:session): session closed for user root Aug 29 01:27:20 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c4649c20-5c16-4126-883f-4c08207a6dc2 tempest-ProjectReaderTests-575634088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-81413f78-5751-4701-b1c6-ab51f4f0ea86" returned: 0 in 0.239s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:27:20 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-c4649c20-5c16-4126-883f-4c08207a6dc2 tempest-ProjectReaderTests-575634088 None] Lock "cinder-quobyte-81413f78-5751-4701-b1c6-ab51f4f0ea86" released by "delete_volume" :: held 0.618s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:27:20 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-c4649c20-5c16-4126-883f-4c08207a6dc2 tempest-ProjectReaderTests-575634088 None] Created reservations ['de391aef-ce7c-448b-8b0e-e0ac81edaa9a', 'd242792d-33ae-4f97-b051-97204586a579', '8bd2d280-d291-4fd4-82ad-55cc91757841', '6b4d5eff-445f-4d15-a644-2b77eb65227d'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:27:20 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-c4649c20-5c16-4126-883f-4c08207a6dc2 tempest-ProjectReaderTests-575634088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:27:20 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-c4649c20-5c16-4126-883f-4c08207a6dc2 tempest-ProjectReaderTests-575634088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:27:20 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-c4649c20-5c16-4126-883f-4c08207a6dc2 tempest-ProjectReaderTests-575634088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:27:20 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-c4649c20-5c16-4126-883f-4c08207a6dc2 tempest-ProjectReaderTests-575634088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:27:20 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-c4649c20-5c16-4126-883f-4c08207a6dc2 tempest-ProjectReaderTests-575634088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:27:20 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c4649c20-5c16-4126-883f-4c08207a6dc2 tempest-ProjectReaderTests-575634088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:27:20 devstack sudo[104263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:27:20 devstack sudo[104263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:27:21 devstack sudo[104263]: pam_unix(sudo:session): session closed for user root Aug 29 01:27:21 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c4649c20-5c16-4126-883f-4c08207a6dc2 tempest-ProjectReaderTests-575634088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.240s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:27:21 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-c4649c20-5c16-4126-883f-4c08207a6dc2 tempest-ProjectReaderTests-575634088 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:27:21 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-c4649c20-5c16-4126-883f-4c08207a6dc2 tempest-ProjectReaderTests-575634088 None] Deleted volume successfully. Aug 29 01:27:21 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-c4649c20-5c16-4126-883f-4c08207a6dc2 tempest-ProjectReaderTests-575634088 None] Lock "cinder-81413f78-5751-4701-b1c6-ab51f4f0ea86-delete_volume" released by "delete_volume" :: held 1.034s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:27:21 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0c7ca8c-8db7-4563-898e-d2cdc3d04290 tempest-ProjectReaderTests-575634088 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:27:21 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-a0c7ca8c-8db7-4563-898e-d2cdc3d04290 tempest-ProjectReaderTests-575634088 None] Flow 'volume_create_manager' (fa6d8ccf-9c21-4c0a-8079-63543587beb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:27:21 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-a0c7ca8c-8db7-4563-898e-d2cdc3d04290 tempest-ProjectReaderTests-575634088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1e7477d-2cea-416d-80de-8c840458569d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:27:21 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-a0c7ca8c-8db7-4563-898e-d2cdc3d04290 tempest-ProjectReaderTests-575634088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1e7477d-2cea-416d-80de-8c840458569d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:27:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1535144152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a115898b-128d-4659-af09-c8db61de2634,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49528e3c8ec640c88cb663ac75077161',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:27:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:27:22Z,use_quota=True,user_id='0783635902954ca6a5e6dde76a7e3a02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:27:21 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-a0c7ca8c-8db7-4563-898e-d2cdc3d04290 tempest-ProjectReaderTests-575634088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (742aaa58-af6d-4f77-bb7b-018823233456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:27:21 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-a0c7ca8c-8db7-4563-898e-d2cdc3d04290 tempest-ProjectReaderTests-575634088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (742aaa58-af6d-4f77-bb7b-018823233456) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:27:21 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-a0c7ca8c-8db7-4563-898e-d2cdc3d04290 tempest-ProjectReaderTests-575634088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b005d8f-c32d-4ab6-8888-be25c5ac6054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:27:21 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-a0c7ca8c-8db7-4563-898e-d2cdc3d04290 tempest-ProjectReaderTests-575634088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b005d8f-c32d-4ab6-8888-be25c5ac6054) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a115898b-128d-4659-af09-c8db61de2634', 'volume_name': 'volume-a115898b-128d-4659-af09-c8db61de2634', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:27:21 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-a0c7ca8c-8db7-4563-898e-d2cdc3d04290 tempest-ProjectReaderTests-575634088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39a85eb3-9aea-4f1a-81cf-a45f5182f21d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:27:21 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-a0c7ca8c-8db7-4563-898e-d2cdc3d04290 tempest-ProjectReaderTests-575634088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39a85eb3-9aea-4f1a-81cf-a45f5182f21d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:27:21 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-a0c7ca8c-8db7-4563-898e-d2cdc3d04290 tempest-ProjectReaderTests-575634088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b68041cc-ac1a-44c1-b623-364afb69632f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:27:21 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-a0c7ca8c-8db7-4563-898e-d2cdc3d04290 tempest-ProjectReaderTests-575634088 None] Volume a115898b-128d-4659-af09-c8db61de2634: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a115898b-128d-4659-af09-c8db61de2634', 'volume_size': 1} Aug 29 01:27:21 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-a0c7ca8c-8db7-4563-898e-d2cdc3d04290 tempest-ProjectReaderTests-575634088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:27:21 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-a0c7ca8c-8db7-4563-898e-d2cdc3d04290 tempest-ProjectReaderTests-575634088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:27:21 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-a0c7ca8c-8db7-4563-898e-d2cdc3d04290 tempest-ProjectReaderTests-575634088 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:27:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1535144152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a115898b-128d-4659-af09-c8db61de2634,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49528e3c8ec640c88cb663ac75077161',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:27:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:27:22Z,use_quota=True,user_id='0783635902954ca6a5e6dde76a7e3a02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:27:21 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-a0c7ca8c-8db7-4563-898e-d2cdc3d04290 tempest-ProjectReaderTests-575634088 None] Creating volume a115898b-128d-4659-af09-c8db61de2634 {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:27:21 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-a0c7ca8c-8db7-4563-898e-d2cdc3d04290 tempest-ProjectReaderTests-575634088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:27:21 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-a0c7ca8c-8db7-4563-898e-d2cdc3d04290 tempest-ProjectReaderTests-575634088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:27:21 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-a0c7ca8c-8db7-4563-898e-d2cdc3d04290 tempest-ProjectReaderTests-575634088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:27:21 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-a0c7ca8c-8db7-4563-898e-d2cdc3d04290 tempest-ProjectReaderTests-575634088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:27:21 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-a0c7ca8c-8db7-4563-898e-d2cdc3d04290 tempest-ProjectReaderTests-575634088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:27:21 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-a0c7ca8c-8db7-4563-898e-d2cdc3d04290 tempest-ProjectReaderTests-575634088 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:27:21 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-a0c7ca8c-8db7-4563-898e-d2cdc3d04290 tempest-ProjectReaderTests-575634088 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:27:21 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-a0c7ca8c-8db7-4563-898e-d2cdc3d04290 tempest-ProjectReaderTests-575634088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a115898b-128d-4659-af09-c8db61de2634 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:27:21 devstack sudo[104267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a115898b-128d-4659-af09-c8db61de2634 1073741824 Aug 29 01:27:21 devstack sudo[104267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:27:22 devstack sudo[104267]: pam_unix(sudo:session): session closed for user root Aug 29 01:27:22 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-a0c7ca8c-8db7-4563-898e-d2cdc3d04290 tempest-ProjectReaderTests-575634088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a115898b-128d-4659-af09-c8db61de2634 1073741824" returned: 0 in 0.401s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:27:22 devstack cinder-volume[86111]: DEBUG dbcounter [-] [86111] Writing DB stats cinder:SELECT=118,cinder:UPDATE=162,cinder:INSERT=39,cinder:DELETE=14 {{(pid=86111) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 29 01:27:22 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-a0c7ca8c-8db7-4563-898e-d2cdc3d04290 tempest-ProjectReaderTests-575634088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a115898b-128d-4659-af09-c8db61de2634 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:27:22 devstack sudo[104272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a115898b-128d-4659-af09-c8db61de2634 Aug 29 01:27:22 devstack sudo[104272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:27:22 devstack sudo[104272]: pam_unix(sudo:session): session closed for user root Aug 29 01:27:22 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-a0c7ca8c-8db7-4563-898e-d2cdc3d04290 tempest-ProjectReaderTests-575634088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a115898b-128d-4659-af09-c8db61de2634" returned: 0 in 0.239s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:27:22 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-a0c7ca8c-8db7-4563-898e-d2cdc3d04290 tempest-ProjectReaderTests-575634088 None] <== create_volume: return (680ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:27:22 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-a0c7ca8c-8db7-4563-898e-d2cdc3d04290 tempest-ProjectReaderTests-575634088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.683s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:27:22 devstack cinder-volume[86111]: DEBUG dbcounter [-] [86111] Writing DB stats cinder:SELECT=137,cinder:UPDATE=162,cinder:INSERT=48,cinder:DELETE=12 {{(pid=86111) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 29 01:27:22 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-a0c7ca8c-8db7-4563-898e-d2cdc3d04290 tempest-ProjectReaderTests-575634088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b68041cc-ac1a-44c1-b623-364afb69632f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a115898b-128d-4659-af09-c8db61de2634', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:27:22 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-a0c7ca8c-8db7-4563-898e-d2cdc3d04290 tempest-ProjectReaderTests-575634088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67cffb0d-9820-4f8c-b87c-279f3c90cd9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:27:22 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-a0c7ca8c-8db7-4563-898e-d2cdc3d04290 tempest-ProjectReaderTests-575634088 None] Volume volume-a115898b-128d-4659-af09-c8db61de2634 (a115898b-128d-4659-af09-c8db61de2634): created successfully Aug 29 01:27:22 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-a0c7ca8c-8db7-4563-898e-d2cdc3d04290 tempest-ProjectReaderTests-575634088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67cffb0d-9820-4f8c-b87c-279f3c90cd9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:27:22 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-a0c7ca8c-8db7-4563-898e-d2cdc3d04290 tempest-ProjectReaderTests-575634088 None] Flow 'volume_create_manager' (fa6d8ccf-9c21-4c0a-8079-63543587beb7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:27:22 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-a0c7ca8c-8db7-4563-898e-d2cdc3d04290 tempest-ProjectReaderTests-575634088 None] Created volume successfully. Aug 29 01:27:22 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-fe38a67e-82c2-47e8-a374-d77fbb59f932 tempest-ProjectReaderTests-575634088 None] Acquiring lock "cinder-a115898b-128d-4659-af09-c8db61de2634-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:27:22 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-fe38a67e-82c2-47e8-a374-d77fbb59f932 tempest-ProjectReaderTests-575634088 None] Lock "cinder-a115898b-128d-4659-af09-c8db61de2634-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:27:22 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-fe38a67e-82c2-47e8-a374-d77fbb59f932 tempest-ProjectReaderTests-575634088 None] Acquiring lock "cinder-quobyte-a115898b-128d-4659-af09-c8db61de2634" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:27:22 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-fe38a67e-82c2-47e8-a374-d77fbb59f932 tempest-ProjectReaderTests-575634088 None] Lock "cinder-quobyte-a115898b-128d-4659-af09-c8db61de2634" acquired by "delete_volume" :: waited 0.015s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:27:22 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cdd1dfd-436a-4722-91b4-d09ca9f32bae]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:27:22 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-fe38a67e-82c2-47e8-a374-d77fbb59f932 tempest-ProjectReaderTests-575634088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a115898b-128d-4659-af09-c8db61de2634 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:27:22 devstack sudo[104281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a115898b-128d-4659-af09-c8db61de2634 Aug 29 01:27:22 devstack sudo[104281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:27:23 devstack sudo[104281]: pam_unix(sudo:session): session closed for user root Aug 29 01:27:23 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-fe38a67e-82c2-47e8-a374-d77fbb59f932 tempest-ProjectReaderTests-575634088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a115898b-128d-4659-af09-c8db61de2634" returned: 0 in 0.347s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:27:23 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-fe38a67e-82c2-47e8-a374-d77fbb59f932 tempest-ProjectReaderTests-575634088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a115898b-128d-4659-af09-c8db61de2634 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:27:23 devstack sudo[104286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a115898b-128d-4659-af09-c8db61de2634 Aug 29 01:27:23 devstack sudo[104286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:27:23 devstack sudo[104286]: pam_unix(sudo:session): session closed for user root Aug 29 01:27:23 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-fe38a67e-82c2-47e8-a374-d77fbb59f932 tempest-ProjectReaderTests-575634088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a115898b-128d-4659-af09-c8db61de2634" returned: 0 in 0.240s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:27:23 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-fe38a67e-82c2-47e8-a374-d77fbb59f932 tempest-ProjectReaderTests-575634088 None] Lock "cinder-quobyte-a115898b-128d-4659-af09-c8db61de2634" released by "delete_volume" :: held 0.626s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:27:23 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-fe38a67e-82c2-47e8-a374-d77fbb59f932 tempest-ProjectReaderTests-575634088 None] Created reservations ['ba89ca62-cb56-4c65-b29a-d2ab1791fc57', 'd3a06db6-f653-490f-a5e8-9039c3b7378e', '2231df8a-c112-4230-ae10-f851b2decb56', '15370d5d-848b-43d9-86a2-f70c11a738ff'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:27:23 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-fe38a67e-82c2-47e8-a374-d77fbb59f932 tempest-ProjectReaderTests-575634088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:27:23 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-fe38a67e-82c2-47e8-a374-d77fbb59f932 tempest-ProjectReaderTests-575634088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:27:23 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-fe38a67e-82c2-47e8-a374-d77fbb59f932 tempest-ProjectReaderTests-575634088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:27:23 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-fe38a67e-82c2-47e8-a374-d77fbb59f932 tempest-ProjectReaderTests-575634088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:27:23 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-fe38a67e-82c2-47e8-a374-d77fbb59f932 tempest-ProjectReaderTests-575634088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:27:23 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-fe38a67e-82c2-47e8-a374-d77fbb59f932 tempest-ProjectReaderTests-575634088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:27:23 devstack sudo[104289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:27:23 devstack sudo[104289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:27:23 devstack sudo[104289]: pam_unix(sudo:session): session closed for user root Aug 29 01:27:23 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-fe38a67e-82c2-47e8-a374-d77fbb59f932 tempest-ProjectReaderTests-575634088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.243s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:27:23 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-fe38a67e-82c2-47e8-a374-d77fbb59f932 tempest-ProjectReaderTests-575634088 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:27:23 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-fe38a67e-82c2-47e8-a374-d77fbb59f932 tempest-ProjectReaderTests-575634088 None] Deleted volume successfully. Aug 29 01:27:23 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-fe38a67e-82c2-47e8-a374-d77fbb59f932 tempest-ProjectReaderTests-575634088 None] Lock "cinder-a115898b-128d-4659-af09-c8db61de2634-delete_volume" released by "delete_volume" :: held 1.057s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:27:24 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-e089f828-7474-435b-8b3d-84cde5ea81f8 tempest-ProjectReaderTests-575634088 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:27:24 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-e089f828-7474-435b-8b3d-84cde5ea81f8 tempest-ProjectReaderTests-575634088 None] Flow 'volume_create_manager' (c5852eec-be0f-4232-83ff-19b5b12f2a8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:27:24 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-e089f828-7474-435b-8b3d-84cde5ea81f8 tempest-ProjectReaderTests-575634088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd95ef74-f743-4295-9c7d-78472b3bab4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:27:24 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-e089f828-7474-435b-8b3d-84cde5ea81f8 tempest-ProjectReaderTests-575634088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd95ef74-f743-4295-9c7d-78472b3bab4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:27:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1101335567',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe1cc655-0187-4458-b320-a86a8441d040,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49528e3c8ec640c88cb663ac75077161',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:27:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:27:24Z,use_quota=True,user_id='0783635902954ca6a5e6dde76a7e3a02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:27:24 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-e089f828-7474-435b-8b3d-84cde5ea81f8 tempest-ProjectReaderTests-575634088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ae8b727-1f6f-4b61-8b5b-3bbf21b1fb39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:27:24 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-e089f828-7474-435b-8b3d-84cde5ea81f8 tempest-ProjectReaderTests-575634088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ae8b727-1f6f-4b61-8b5b-3bbf21b1fb39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:27:24 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-e089f828-7474-435b-8b3d-84cde5ea81f8 tempest-ProjectReaderTests-575634088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4b8dec2-1bb3-453c-ae3d-1a4306de84ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:27:24 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-e089f828-7474-435b-8b3d-84cde5ea81f8 tempest-ProjectReaderTests-575634088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4b8dec2-1bb3-453c-ae3d-1a4306de84ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe1cc655-0187-4458-b320-a86a8441d040', 'volume_name': 'volume-fe1cc655-0187-4458-b320-a86a8441d040', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:27:24 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-e089f828-7474-435b-8b3d-84cde5ea81f8 tempest-ProjectReaderTests-575634088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89eee091-0f57-4e0c-90f2-e70e7d36561b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:27:24 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-e089f828-7474-435b-8b3d-84cde5ea81f8 tempest-ProjectReaderTests-575634088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89eee091-0f57-4e0c-90f2-e70e7d36561b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:27:24 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-e089f828-7474-435b-8b3d-84cde5ea81f8 tempest-ProjectReaderTests-575634088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8956c37d-18d9-4f23-bdd6-2eafdf8e9993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:27:24 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-e089f828-7474-435b-8b3d-84cde5ea81f8 tempest-ProjectReaderTests-575634088 None] Volume fe1cc655-0187-4458-b320-a86a8441d040: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe1cc655-0187-4458-b320-a86a8441d040', 'volume_size': 1} Aug 29 01:27:24 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-e089f828-7474-435b-8b3d-84cde5ea81f8 tempest-ProjectReaderTests-575634088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:27:24 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-e089f828-7474-435b-8b3d-84cde5ea81f8 tempest-ProjectReaderTests-575634088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:27:24 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-e089f828-7474-435b-8b3d-84cde5ea81f8 tempest-ProjectReaderTests-575634088 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:27:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1101335567',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe1cc655-0187-4458-b320-a86a8441d040,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49528e3c8ec640c88cb663ac75077161',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:27:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:27:24Z,use_quota=True,user_id='0783635902954ca6a5e6dde76a7e3a02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:27:24 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-e089f828-7474-435b-8b3d-84cde5ea81f8 tempest-ProjectReaderTests-575634088 None] Creating volume fe1cc655-0187-4458-b320-a86a8441d040 {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:27:24 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-e089f828-7474-435b-8b3d-84cde5ea81f8 tempest-ProjectReaderTests-575634088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:27:24 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-e089f828-7474-435b-8b3d-84cde5ea81f8 tempest-ProjectReaderTests-575634088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:27:24 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-e089f828-7474-435b-8b3d-84cde5ea81f8 tempest-ProjectReaderTests-575634088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:27:24 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-e089f828-7474-435b-8b3d-84cde5ea81f8 tempest-ProjectReaderTests-575634088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:27:24 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-e089f828-7474-435b-8b3d-84cde5ea81f8 tempest-ProjectReaderTests-575634088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:27:24 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-e089f828-7474-435b-8b3d-84cde5ea81f8 tempest-ProjectReaderTests-575634088 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:27:24 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-e089f828-7474-435b-8b3d-84cde5ea81f8 tempest-ProjectReaderTests-575634088 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:27:24 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-e089f828-7474-435b-8b3d-84cde5ea81f8 tempest-ProjectReaderTests-575634088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-fe1cc655-0187-4458-b320-a86a8441d040 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:27:24 devstack sudo[104294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-fe1cc655-0187-4458-b320-a86a8441d040 1073741824 Aug 29 01:27:24 devstack sudo[104294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:27:24 devstack sudo[104294]: pam_unix(sudo:session): session closed for user root Aug 29 01:27:24 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-e089f828-7474-435b-8b3d-84cde5ea81f8 tempest-ProjectReaderTests-575634088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-fe1cc655-0187-4458-b320-a86a8441d040 1073741824" returned: 0 in 0.408s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:27:24 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-e089f828-7474-435b-8b3d-84cde5ea81f8 tempest-ProjectReaderTests-575634088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-fe1cc655-0187-4458-b320-a86a8441d040 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:27:24 devstack sudo[104300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-fe1cc655-0187-4458-b320-a86a8441d040 Aug 29 01:27:24 devstack sudo[104300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:27:25 devstack sudo[104300]: pam_unix(sudo:session): session closed for user root Aug 29 01:27:25 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-e089f828-7474-435b-8b3d-84cde5ea81f8 tempest-ProjectReaderTests-575634088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-fe1cc655-0187-4458-b320-a86a8441d040" returned: 0 in 0.243s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:27:25 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-e089f828-7474-435b-8b3d-84cde5ea81f8 tempest-ProjectReaderTests-575634088 None] <== create_volume: return (692ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:27:25 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-e089f828-7474-435b-8b3d-84cde5ea81f8 tempest-ProjectReaderTests-575634088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.694s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:27:25 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-e089f828-7474-435b-8b3d-84cde5ea81f8 tempest-ProjectReaderTests-575634088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8956c37d-18d9-4f23-bdd6-2eafdf8e9993) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe1cc655-0187-4458-b320-a86a8441d040', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:27:25 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-e089f828-7474-435b-8b3d-84cde5ea81f8 tempest-ProjectReaderTests-575634088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21c31daa-16aa-4121-9779-7f6022e24d4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:27:25 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-e089f828-7474-435b-8b3d-84cde5ea81f8 tempest-ProjectReaderTests-575634088 None] Volume volume-fe1cc655-0187-4458-b320-a86a8441d040 (fe1cc655-0187-4458-b320-a86a8441d040): created successfully Aug 29 01:27:25 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-e089f828-7474-435b-8b3d-84cde5ea81f8 tempest-ProjectReaderTests-575634088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21c31daa-16aa-4121-9779-7f6022e24d4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:27:25 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-e089f828-7474-435b-8b3d-84cde5ea81f8 tempest-ProjectReaderTests-575634088 None] Flow 'volume_create_manager' (c5852eec-be0f-4232-83ff-19b5b12f2a8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:27:25 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-e089f828-7474-435b-8b3d-84cde5ea81f8 tempest-ProjectReaderTests-575634088 None] Created volume successfully. Aug 29 01:27:25 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-4c75a072-9197-4e63-b28a-cc195824757e tempest-ProjectReaderTests-575634088 None] Acquiring lock "cinder-fe1cc655-0187-4458-b320-a86a8441d040-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:27:25 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-4c75a072-9197-4e63-b28a-cc195824757e tempest-ProjectReaderTests-575634088 None] Lock "cinder-fe1cc655-0187-4458-b320-a86a8441d040-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:27:25 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-4c75a072-9197-4e63-b28a-cc195824757e tempest-ProjectReaderTests-575634088 None] Acquiring lock "cinder-quobyte-fe1cc655-0187-4458-b320-a86a8441d040" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:27:25 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-4c75a072-9197-4e63-b28a-cc195824757e tempest-ProjectReaderTests-575634088 None] Lock "cinder-quobyte-fe1cc655-0187-4458-b320-a86a8441d040" acquired by "delete_volume" :: waited 0.015s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:27:25 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[fef8ee70-dca7-4a03-98b6-29694f99b464]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:27:25 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-4c75a072-9197-4e63-b28a-cc195824757e tempest-ProjectReaderTests-575634088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-fe1cc655-0187-4458-b320-a86a8441d040 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:27:25 devstack sudo[104303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-fe1cc655-0187-4458-b320-a86a8441d040 Aug 29 01:27:25 devstack sudo[104303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:27:25 devstack sudo[104303]: pam_unix(sudo:session): session closed for user root Aug 29 01:27:25 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-4c75a072-9197-4e63-b28a-cc195824757e tempest-ProjectReaderTests-575634088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-fe1cc655-0187-4458-b320-a86a8441d040" returned: 0 in 0.346s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:27:25 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-4c75a072-9197-4e63-b28a-cc195824757e tempest-ProjectReaderTests-575634088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-fe1cc655-0187-4458-b320-a86a8441d040 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:27:25 devstack sudo[104308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-fe1cc655-0187-4458-b320-a86a8441d040 Aug 29 01:27:25 devstack sudo[104308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:27:26 devstack sudo[104308]: pam_unix(sudo:session): session closed for user root Aug 29 01:27:26 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-4c75a072-9197-4e63-b28a-cc195824757e tempest-ProjectReaderTests-575634088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-fe1cc655-0187-4458-b320-a86a8441d040" returned: 0 in 0.238s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:27:26 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-4c75a072-9197-4e63-b28a-cc195824757e tempest-ProjectReaderTests-575634088 None] Lock "cinder-quobyte-fe1cc655-0187-4458-b320-a86a8441d040" released by "delete_volume" :: held 0.620s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:27:26 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-4c75a072-9197-4e63-b28a-cc195824757e tempest-ProjectReaderTests-575634088 None] Created reservations ['0ab7c3b3-7a95-49b3-b367-80200824c98d', '050bbc5a-58cc-4b39-99d5-1cc255fc3c3d', '43b98a3a-7b66-42d4-b387-0568c24c3076', '698fa043-09a6-4f1d-af3c-e03289045e1e'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:27:26 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-4c75a072-9197-4e63-b28a-cc195824757e tempest-ProjectReaderTests-575634088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:27:26 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-4c75a072-9197-4e63-b28a-cc195824757e tempest-ProjectReaderTests-575634088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:27:26 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-4c75a072-9197-4e63-b28a-cc195824757e tempest-ProjectReaderTests-575634088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:27:26 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-4c75a072-9197-4e63-b28a-cc195824757e tempest-ProjectReaderTests-575634088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:27:26 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-4c75a072-9197-4e63-b28a-cc195824757e tempest-ProjectReaderTests-575634088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:27:26 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-4c75a072-9197-4e63-b28a-cc195824757e tempest-ProjectReaderTests-575634088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:27:26 devstack sudo[104311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:27:26 devstack sudo[104311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:27:26 devstack sudo[104311]: pam_unix(sudo:session): session closed for user root Aug 29 01:27:26 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-4c75a072-9197-4e63-b28a-cc195824757e tempest-ProjectReaderTests-575634088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.237s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:27:26 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-4c75a072-9197-4e63-b28a-cc195824757e tempest-ProjectReaderTests-575634088 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:27:26 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-4c75a072-9197-4e63-b28a-cc195824757e tempest-ProjectReaderTests-575634088 None] Deleted volume successfully. Aug 29 01:27:26 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-4c75a072-9197-4e63-b28a-cc195824757e tempest-ProjectReaderTests-575634088 None] Lock "cinder-fe1cc655-0187-4458-b320-a86a8441d040-delete_volume" released by "delete_volume" :: held 1.039s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:27:26 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-45b0b4af-6587-4c5f-8973-ab7d89fe178c tempest-ProjectReaderTests-575634088 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:27:26 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-45b0b4af-6587-4c5f-8973-ab7d89fe178c tempest-ProjectReaderTests-575634088 None] Flow 'volume_create_manager' (363cc905-8bbb-4d1a-975d-5f2085526b79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:27:26 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-45b0b4af-6587-4c5f-8973-ab7d89fe178c tempest-ProjectReaderTests-575634088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16082ecf-d67b-45fa-aa75-bfe59e9f6035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:27:26 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-45b0b4af-6587-4c5f-8973-ab7d89fe178c tempest-ProjectReaderTests-575634088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16082ecf-d67b-45fa-aa75-bfe59e9f6035) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:27:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1144919650',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a896aa4e-05fe-4725-bfc0-129fb1bb3296,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49528e3c8ec640c88cb663ac75077161',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:27:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:27:27Z,use_quota=True,user_id='0783635902954ca6a5e6dde76a7e3a02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:27:26 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-45b0b4af-6587-4c5f-8973-ab7d89fe178c tempest-ProjectReaderTests-575634088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b08f5e9-33a7-4223-8cc7-cd818396b00c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:27:26 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-45b0b4af-6587-4c5f-8973-ab7d89fe178c tempest-ProjectReaderTests-575634088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b08f5e9-33a7-4223-8cc7-cd818396b00c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:27:26 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-45b0b4af-6587-4c5f-8973-ab7d89fe178c tempest-ProjectReaderTests-575634088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b475c575-a6aa-4b78-af38-32b5e15aaf42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:27:26 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-45b0b4af-6587-4c5f-8973-ab7d89fe178c tempest-ProjectReaderTests-575634088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b475c575-a6aa-4b78-af38-32b5e15aaf42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a896aa4e-05fe-4725-bfc0-129fb1bb3296', 'volume_name': 'volume-a896aa4e-05fe-4725-bfc0-129fb1bb3296', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:27:26 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-45b0b4af-6587-4c5f-8973-ab7d89fe178c tempest-ProjectReaderTests-575634088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d432f472-3d6e-41ac-b4a5-edc58d04c606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:27:26 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-45b0b4af-6587-4c5f-8973-ab7d89fe178c tempest-ProjectReaderTests-575634088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d432f472-3d6e-41ac-b4a5-edc58d04c606) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:27:26 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-45b0b4af-6587-4c5f-8973-ab7d89fe178c tempest-ProjectReaderTests-575634088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (659063a0-79d1-4d99-8321-2c81dcf36107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:27:26 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-45b0b4af-6587-4c5f-8973-ab7d89fe178c tempest-ProjectReaderTests-575634088 None] Volume a896aa4e-05fe-4725-bfc0-129fb1bb3296: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a896aa4e-05fe-4725-bfc0-129fb1bb3296', 'volume_size': 1} Aug 29 01:27:26 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-45b0b4af-6587-4c5f-8973-ab7d89fe178c tempest-ProjectReaderTests-575634088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:27:26 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-45b0b4af-6587-4c5f-8973-ab7d89fe178c tempest-ProjectReaderTests-575634088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:27:26 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-45b0b4af-6587-4c5f-8973-ab7d89fe178c tempest-ProjectReaderTests-575634088 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:27:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1144919650',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a896aa4e-05fe-4725-bfc0-129fb1bb3296,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49528e3c8ec640c88cb663ac75077161',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:27:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:27:27Z,use_quota=True,user_id='0783635902954ca6a5e6dde76a7e3a02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:27:26 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-45b0b4af-6587-4c5f-8973-ab7d89fe178c tempest-ProjectReaderTests-575634088 None] Creating volume a896aa4e-05fe-4725-bfc0-129fb1bb3296 {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:27:26 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-45b0b4af-6587-4c5f-8973-ab7d89fe178c tempest-ProjectReaderTests-575634088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:27:26 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-45b0b4af-6587-4c5f-8973-ab7d89fe178c tempest-ProjectReaderTests-575634088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:27:26 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-45b0b4af-6587-4c5f-8973-ab7d89fe178c tempest-ProjectReaderTests-575634088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:27:26 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-45b0b4af-6587-4c5f-8973-ab7d89fe178c tempest-ProjectReaderTests-575634088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:27:26 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-45b0b4af-6587-4c5f-8973-ab7d89fe178c tempest-ProjectReaderTests-575634088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:27:26 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-45b0b4af-6587-4c5f-8973-ab7d89fe178c tempest-ProjectReaderTests-575634088 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:27:26 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-45b0b4af-6587-4c5f-8973-ab7d89fe178c tempest-ProjectReaderTests-575634088 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:27:27 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-45b0b4af-6587-4c5f-8973-ab7d89fe178c tempest-ProjectReaderTests-575634088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a896aa4e-05fe-4725-bfc0-129fb1bb3296 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:27:27 devstack sudo[104314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a896aa4e-05fe-4725-bfc0-129fb1bb3296 1073741824 Aug 29 01:27:27 devstack sudo[104314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:27:27 devstack sudo[104314]: pam_unix(sudo:session): session closed for user root Aug 29 01:27:27 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-45b0b4af-6587-4c5f-8973-ab7d89fe178c tempest-ProjectReaderTests-575634088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a896aa4e-05fe-4725-bfc0-129fb1bb3296 1073741824" returned: 0 in 0.406s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:27:27 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-45b0b4af-6587-4c5f-8973-ab7d89fe178c tempest-ProjectReaderTests-575634088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a896aa4e-05fe-4725-bfc0-129fb1bb3296 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:27:27 devstack sudo[104320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a896aa4e-05fe-4725-bfc0-129fb1bb3296 Aug 29 01:27:27 devstack sudo[104320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:27:27 devstack sudo[104320]: pam_unix(sudo:session): session closed for user root Aug 29 01:27:27 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-45b0b4af-6587-4c5f-8973-ab7d89fe178c tempest-ProjectReaderTests-575634088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a896aa4e-05fe-4725-bfc0-129fb1bb3296" returned: 0 in 0.241s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:27:27 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-45b0b4af-6587-4c5f-8973-ab7d89fe178c tempest-ProjectReaderTests-575634088 None] <== create_volume: return (685ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:27:27 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-45b0b4af-6587-4c5f-8973-ab7d89fe178c tempest-ProjectReaderTests-575634088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.689s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:27:27 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-45b0b4af-6587-4c5f-8973-ab7d89fe178c tempest-ProjectReaderTests-575634088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (659063a0-79d1-4d99-8321-2c81dcf36107) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a896aa4e-05fe-4725-bfc0-129fb1bb3296', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:27:27 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-45b0b4af-6587-4c5f-8973-ab7d89fe178c tempest-ProjectReaderTests-575634088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3d935f0-ff7f-4acd-b43e-e329b43b80cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:27:27 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-45b0b4af-6587-4c5f-8973-ab7d89fe178c tempest-ProjectReaderTests-575634088 None] Volume volume-a896aa4e-05fe-4725-bfc0-129fb1bb3296 (a896aa4e-05fe-4725-bfc0-129fb1bb3296): created successfully Aug 29 01:27:27 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-45b0b4af-6587-4c5f-8973-ab7d89fe178c tempest-ProjectReaderTests-575634088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3d935f0-ff7f-4acd-b43e-e329b43b80cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:27:27 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-45b0b4af-6587-4c5f-8973-ab7d89fe178c tempest-ProjectReaderTests-575634088 None] Flow 'volume_create_manager' (363cc905-8bbb-4d1a-975d-5f2085526b79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:27:27 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-45b0b4af-6587-4c5f-8973-ab7d89fe178c tempest-ProjectReaderTests-575634088 None] Created volume successfully. Aug 29 01:27:27 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-3849c829-5dcc-4acb-a749-de1741013e61 tempest-ProjectReaderTests-575634088 None] Acquiring lock "cinder-a896aa4e-05fe-4725-bfc0-129fb1bb3296-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:27:27 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-3849c829-5dcc-4acb-a749-de1741013e61 tempest-ProjectReaderTests-575634088 None] Lock "cinder-a896aa4e-05fe-4725-bfc0-129fb1bb3296-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:27:28 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-3849c829-5dcc-4acb-a749-de1741013e61 tempest-ProjectReaderTests-575634088 None] Acquiring lock "cinder-quobyte-a896aa4e-05fe-4725-bfc0-129fb1bb3296" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:27:28 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-3849c829-5dcc-4acb-a749-de1741013e61 tempest-ProjectReaderTests-575634088 None] Lock "cinder-quobyte-a896aa4e-05fe-4725-bfc0-129fb1bb3296" acquired by "delete_volume" :: waited 0.015s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:27:28 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffc02610-f55b-4b8b-92cd-92e1e1183446]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:27:28 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-3849c829-5dcc-4acb-a749-de1741013e61 tempest-ProjectReaderTests-575634088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a896aa4e-05fe-4725-bfc0-129fb1bb3296 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:27:28 devstack sudo[104323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a896aa4e-05fe-4725-bfc0-129fb1bb3296 Aug 29 01:27:28 devstack sudo[104323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:27:28 devstack sudo[104323]: pam_unix(sudo:session): session closed for user root Aug 29 01:27:28 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-3849c829-5dcc-4acb-a749-de1741013e61 tempest-ProjectReaderTests-575634088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a896aa4e-05fe-4725-bfc0-129fb1bb3296" returned: 0 in 0.350s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:27:28 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-3849c829-5dcc-4acb-a749-de1741013e61 tempest-ProjectReaderTests-575634088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a896aa4e-05fe-4725-bfc0-129fb1bb3296 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:27:28 devstack sudo[104328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a896aa4e-05fe-4725-bfc0-129fb1bb3296 Aug 29 01:27:28 devstack sudo[104328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:27:28 devstack sudo[104328]: pam_unix(sudo:session): session closed for user root Aug 29 01:27:28 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-3849c829-5dcc-4acb-a749-de1741013e61 tempest-ProjectReaderTests-575634088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a896aa4e-05fe-4725-bfc0-129fb1bb3296" returned: 0 in 0.237s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:27:28 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-3849c829-5dcc-4acb-a749-de1741013e61 tempest-ProjectReaderTests-575634088 None] Lock "cinder-quobyte-a896aa4e-05fe-4725-bfc0-129fb1bb3296" released by "delete_volume" :: held 0.624s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:27:28 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-3849c829-5dcc-4acb-a749-de1741013e61 tempest-ProjectReaderTests-575634088 None] Created reservations ['18c97304-5b90-4f04-be9c-615edf368eff', '3ee556a8-efca-4b07-a5dd-00abb77d856a', '225eebb9-f44f-4762-8e66-2f09a6bf7f25', '44aaa334-e10c-4000-87f0-cf3c86babae3'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:27:28 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-3849c829-5dcc-4acb-a749-de1741013e61 tempest-ProjectReaderTests-575634088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:27:28 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-3849c829-5dcc-4acb-a749-de1741013e61 tempest-ProjectReaderTests-575634088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:27:28 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-3849c829-5dcc-4acb-a749-de1741013e61 tempest-ProjectReaderTests-575634088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:27:28 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-3849c829-5dcc-4acb-a749-de1741013e61 tempest-ProjectReaderTests-575634088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:27:28 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-3849c829-5dcc-4acb-a749-de1741013e61 tempest-ProjectReaderTests-575634088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:27:28 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-3849c829-5dcc-4acb-a749-de1741013e61 tempest-ProjectReaderTests-575634088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:27:28 devstack sudo[104331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:27:28 devstack sudo[104331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:27:29 devstack sudo[104331]: pam_unix(sudo:session): session closed for user root Aug 29 01:27:29 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-3849c829-5dcc-4acb-a749-de1741013e61 tempest-ProjectReaderTests-575634088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.241s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:27:29 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-3849c829-5dcc-4acb-a749-de1741013e61 tempest-ProjectReaderTests-575634088 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:27:29 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-3849c829-5dcc-4acb-a749-de1741013e61 tempest-ProjectReaderTests-575634088 None] Deleted volume successfully. Aug 29 01:27:29 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-3849c829-5dcc-4acb-a749-de1741013e61 tempest-ProjectReaderTests-575634088 None] Lock "cinder-a896aa4e-05fe-4725-bfc0-129fb1bb3296-delete_volume" released by "delete_volume" :: held 1.051s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:27:38 devstack cinder-volume[86111]: DEBUG dbcounter [-] [86111] Writing DB stats cinder:UPDATE=34,cinder:DELETE=2,cinder:SELECT=15,cinder:INSERT=8 {{(pid=86111) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 29 01:27:39 devstack cinder-volume[86111]: DEBUG dbcounter [-] [86111] Writing DB stats cinder:SELECT=23,cinder:UPDATE=28,cinder:INSERT=6,cinder:DELETE=4 {{(pid=86111) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 29 01:27:40 devstack cinder-volume[86111]: DEBUG oslo_service.periodic_task [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86111) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 29 01:27:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:27:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:27:40 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:27:40 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:27:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:27:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:27:40 devstack sudo[104408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:27:40 devstack sudo[104408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:27:40 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a2400d5-16fe-4a9b-8352-3b7051258e39 tempest-CreateVolumesFromSnapshotTest-198098050 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:27:41 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6a2400d5-16fe-4a9b-8352-3b7051258e39 tempest-CreateVolumesFromSnapshotTest-198098050 None] Flow 'volume_create_manager' (93fa5d93-7233-4d05-a39a-a8a3784031fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:27:41 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6a2400d5-16fe-4a9b-8352-3b7051258e39 tempest-CreateVolumesFromSnapshotTest-198098050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c97c37e-c16b-4687-aa38-fab447cd3bee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:27:41 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6a2400d5-16fe-4a9b-8352-3b7051258e39 tempest-CreateVolumesFromSnapshotTest-198098050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c97c37e-c16b-4687-aa38-fab447cd3bee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:27:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1553043418',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21da70b2-5db7-4690-aa08-c73d2272e3b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e17418253c84515a6bc38dad1914444',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:27:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:27:41Z,use_quota=True,user_id='c518dccf017f4ac7ab2b4fd47a97a42c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:27:41 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6a2400d5-16fe-4a9b-8352-3b7051258e39 tempest-CreateVolumesFromSnapshotTest-198098050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4260e3a-8908-4d44-864c-fb550c708871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:27:41 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6a2400d5-16fe-4a9b-8352-3b7051258e39 tempest-CreateVolumesFromSnapshotTest-198098050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4260e3a-8908-4d44-864c-fb550c708871) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:27:41 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6a2400d5-16fe-4a9b-8352-3b7051258e39 tempest-CreateVolumesFromSnapshotTest-198098050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d8edf32-742a-4c40-9453-b85cb6c36ca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:27:41 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6a2400d5-16fe-4a9b-8352-3b7051258e39 tempest-CreateVolumesFromSnapshotTest-198098050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d8edf32-742a-4c40-9453-b85cb6c36ca1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21da70b2-5db7-4690-aa08-c73d2272e3b8', 'volume_name': 'volume-21da70b2-5db7-4690-aa08-c73d2272e3b8', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:27:41 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6a2400d5-16fe-4a9b-8352-3b7051258e39 tempest-CreateVolumesFromSnapshotTest-198098050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bc61d22-cf01-4a05-b5a1-ed50490f8fc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:27:41 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6a2400d5-16fe-4a9b-8352-3b7051258e39 tempest-CreateVolumesFromSnapshotTest-198098050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bc61d22-cf01-4a05-b5a1-ed50490f8fc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:27:41 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6a2400d5-16fe-4a9b-8352-3b7051258e39 tempest-CreateVolumesFromSnapshotTest-198098050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db2e5c4e-0ef8-46ff-ab8a-3be1a88d0d8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:27:41 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-6a2400d5-16fe-4a9b-8352-3b7051258e39 tempest-CreateVolumesFromSnapshotTest-198098050 None] Volume 21da70b2-5db7-4690-aa08-c73d2272e3b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21da70b2-5db7-4690-aa08-c73d2272e3b8', 'volume_size': 1} Aug 29 01:27:41 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-6a2400d5-16fe-4a9b-8352-3b7051258e39 tempest-CreateVolumesFromSnapshotTest-198098050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:27:41 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-6a2400d5-16fe-4a9b-8352-3b7051258e39 tempest-CreateVolumesFromSnapshotTest-198098050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:27:41 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-6a2400d5-16fe-4a9b-8352-3b7051258e39 tempest-CreateVolumesFromSnapshotTest-198098050 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:27:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1553043418',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21da70b2-5db7-4690-aa08-c73d2272e3b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e17418253c84515a6bc38dad1914444',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:27:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:27:41Z,use_quota=True,user_id='c518dccf017f4ac7ab2b4fd47a97a42c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:27:41 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-6a2400d5-16fe-4a9b-8352-3b7051258e39 tempest-CreateVolumesFromSnapshotTest-198098050 None] Creating volume 21da70b2-5db7-4690-aa08-c73d2272e3b8 {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:27:41 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-6a2400d5-16fe-4a9b-8352-3b7051258e39 tempest-CreateVolumesFromSnapshotTest-198098050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:27:41 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-6a2400d5-16fe-4a9b-8352-3b7051258e39 tempest-CreateVolumesFromSnapshotTest-198098050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:27:41 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-6a2400d5-16fe-4a9b-8352-3b7051258e39 tempest-CreateVolumesFromSnapshotTest-198098050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:27:41 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-6a2400d5-16fe-4a9b-8352-3b7051258e39 tempest-CreateVolumesFromSnapshotTest-198098050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:27:41 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-6a2400d5-16fe-4a9b-8352-3b7051258e39 tempest-CreateVolumesFromSnapshotTest-198098050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:27:41 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-6a2400d5-16fe-4a9b-8352-3b7051258e39 tempest-CreateVolumesFromSnapshotTest-198098050 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:27:41 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-6a2400d5-16fe-4a9b-8352-3b7051258e39 tempest-CreateVolumesFromSnapshotTest-198098050 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:27:41 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-6a2400d5-16fe-4a9b-8352-3b7051258e39 tempest-CreateVolumesFromSnapshotTest-198098050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-21da70b2-5db7-4690-aa08-c73d2272e3b8 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:27:41 devstack sudo[104408]: pam_unix(sudo:session): session closed for user root Aug 29 01:27:41 devstack sudo[104411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-21da70b2-5db7-4690-aa08-c73d2272e3b8 1073741824 Aug 29 01:27:41 devstack sudo[104411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:27:41 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-de752545-d617-440e-8362-d04fae0901a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.351s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:27:41 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:27:41 devstack cinder-volume[86111]: DEBUG oslo_service.periodic_task [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Running periodic task VolumeManager._thread_info {{(pid=86111) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 29 01:27:41 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-de752545-d617-440e-8362-d04fae0901a5 None None] thread count: 28 {{(pid=86111) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 29 01:27:41 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-de752545-d617-440e-8362-d04fae0901a5 None None] thread info: [<_MainThread(MainThread, started 129173440548992)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86111) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 29 01:27:41 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8691966-4c47-457b-a0d9-d117b759ef88 tempest-VolumeDependencyTests-162034196 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:27:41 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-d8691966-4c47-457b-a0d9-d117b759ef88 tempest-VolumeDependencyTests-162034196 None] Flow 'volume_create_manager' (4e8c484d-a543-409f-8f97-68c0d283360a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:27:41 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-d8691966-4c47-457b-a0d9-d117b759ef88 tempest-VolumeDependencyTests-162034196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f628b6a4-c5dc-4702-a13c-58d8f2cf5b5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:27:41 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-d8691966-4c47-457b-a0d9-d117b759ef88 tempest-VolumeDependencyTests-162034196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f628b6a4-c5dc-4702-a13c-58d8f2cf5b5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:27:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2021680816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdac5d05-f835-43b4-ab10-91657b676a76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f17dfec0bd1c45ecb8ae3b35d4553242',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:27:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:27:41Z,use_quota=True,user_id='8144453e1c894f87871ade8f82718d0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:27:41 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-d8691966-4c47-457b-a0d9-d117b759ef88 tempest-VolumeDependencyTests-162034196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e513efc7-2dd6-425c-9f31-42c1eacd19c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:27:41 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-d8691966-4c47-457b-a0d9-d117b759ef88 tempest-VolumeDependencyTests-162034196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e513efc7-2dd6-425c-9f31-42c1eacd19c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:27:41 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-d8691966-4c47-457b-a0d9-d117b759ef88 tempest-VolumeDependencyTests-162034196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52744fcf-71b6-413d-88f8-65dbe400f3b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:27:41 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-d8691966-4c47-457b-a0d9-d117b759ef88 tempest-VolumeDependencyTests-162034196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52744fcf-71b6-413d-88f8-65dbe400f3b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fdac5d05-f835-43b4-ab10-91657b676a76', 'volume_name': 'volume-fdac5d05-f835-43b4-ab10-91657b676a76', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:27:41 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-d8691966-4c47-457b-a0d9-d117b759ef88 tempest-VolumeDependencyTests-162034196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b110ff65-6842-48d7-b11c-370d639884b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:27:41 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-d8691966-4c47-457b-a0d9-d117b759ef88 tempest-VolumeDependencyTests-162034196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b110ff65-6842-48d7-b11c-370d639884b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:27:41 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-d8691966-4c47-457b-a0d9-d117b759ef88 tempest-VolumeDependencyTests-162034196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05333ea5-df6e-4766-8e23-f3867e3e8ca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:27:41 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-d8691966-4c47-457b-a0d9-d117b759ef88 tempest-VolumeDependencyTests-162034196 None] Volume fdac5d05-f835-43b4-ab10-91657b676a76: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fdac5d05-f835-43b4-ab10-91657b676a76', 'volume_size': 1} Aug 29 01:27:41 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-d8691966-4c47-457b-a0d9-d117b759ef88 tempest-VolumeDependencyTests-162034196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:27:41 devstack sudo[104411]: pam_unix(sudo:session): session closed for user root Aug 29 01:27:41 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-6a2400d5-16fe-4a9b-8352-3b7051258e39 tempest-CreateVolumesFromSnapshotTest-198098050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-21da70b2-5db7-4690-aa08-c73d2272e3b8 1073741824" returned: 0 in 0.532s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:27:41 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-6a2400d5-16fe-4a9b-8352-3b7051258e39 tempest-CreateVolumesFromSnapshotTest-198098050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-21da70b2-5db7-4690-aa08-c73d2272e3b8 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:27:41 devstack sudo[104417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-21da70b2-5db7-4690-aa08-c73d2272e3b8 Aug 29 01:27:41 devstack sudo[104417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:27:41 devstack sudo[104417]: pam_unix(sudo:session): session closed for user root Aug 29 01:27:41 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-6a2400d5-16fe-4a9b-8352-3b7051258e39 tempest-CreateVolumesFromSnapshotTest-198098050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-21da70b2-5db7-4690-aa08-c73d2272e3b8" returned: 0 in 0.275s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:27:41 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-6a2400d5-16fe-4a9b-8352-3b7051258e39 tempest-CreateVolumesFromSnapshotTest-198098050 None] <== create_volume: return (862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:27:41 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-6a2400d5-16fe-4a9b-8352-3b7051258e39 tempest-CreateVolumesFromSnapshotTest-198098050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.865s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:27:41 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-d8691966-4c47-457b-a0d9-d117b759ef88 tempest-VolumeDependencyTests-162034196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.718s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:27:41 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-d8691966-4c47-457b-a0d9-d117b759ef88 tempest-VolumeDependencyTests-162034196 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:27:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2021680816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdac5d05-f835-43b4-ab10-91657b676a76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f17dfec0bd1c45ecb8ae3b35d4553242',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:27:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:27:41Z,use_quota=True,user_id='8144453e1c894f87871ade8f82718d0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:27:41 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-d8691966-4c47-457b-a0d9-d117b759ef88 tempest-VolumeDependencyTests-162034196 None] Creating volume fdac5d05-f835-43b4-ab10-91657b676a76 {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:27:41 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-d8691966-4c47-457b-a0d9-d117b759ef88 tempest-VolumeDependencyTests-162034196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:27:41 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-d8691966-4c47-457b-a0d9-d117b759ef88 tempest-VolumeDependencyTests-162034196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:27:41 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-d8691966-4c47-457b-a0d9-d117b759ef88 tempest-VolumeDependencyTests-162034196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:27:41 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-d8691966-4c47-457b-a0d9-d117b759ef88 tempest-VolumeDependencyTests-162034196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:27:41 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-d8691966-4c47-457b-a0d9-d117b759ef88 tempest-VolumeDependencyTests-162034196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:27:41 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-d8691966-4c47-457b-a0d9-d117b759ef88 tempest-VolumeDependencyTests-162034196 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:27:41 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-d8691966-4c47-457b-a0d9-d117b759ef88 tempest-VolumeDependencyTests-162034196 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:27:41 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d8691966-4c47-457b-a0d9-d117b759ef88 tempest-VolumeDependencyTests-162034196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-fdac5d05-f835-43b4-ab10-91657b676a76 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:27:41 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6a2400d5-16fe-4a9b-8352-3b7051258e39 tempest-CreateVolumesFromSnapshotTest-198098050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db2e5c4e-0ef8-46ff-ab8a-3be1a88d0d8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21da70b2-5db7-4690-aa08-c73d2272e3b8', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:27:42 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6a2400d5-16fe-4a9b-8352-3b7051258e39 tempest-CreateVolumesFromSnapshotTest-198098050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61b5850c-7200-4732-8b60-7f93482ee812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:27:42 devstack sudo[104420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-fdac5d05-f835-43b4-ab10-91657b676a76 1073741824 Aug 29 01:27:42 devstack sudo[104420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:27:42 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-6a2400d5-16fe-4a9b-8352-3b7051258e39 tempest-CreateVolumesFromSnapshotTest-198098050 None] Volume volume-21da70b2-5db7-4690-aa08-c73d2272e3b8 (21da70b2-5db7-4690-aa08-c73d2272e3b8): created successfully Aug 29 01:27:42 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6a2400d5-16fe-4a9b-8352-3b7051258e39 tempest-CreateVolumesFromSnapshotTest-198098050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61b5850c-7200-4732-8b60-7f93482ee812) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:27:42 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6a2400d5-16fe-4a9b-8352-3b7051258e39 tempest-CreateVolumesFromSnapshotTest-198098050 None] Flow 'volume_create_manager' (93fa5d93-7233-4d05-a39a-a8a3784031fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:27:42 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-6a2400d5-16fe-4a9b-8352-3b7051258e39 tempest-CreateVolumesFromSnapshotTest-198098050 None] Created volume successfully. Aug 29 01:27:42 devstack sudo[104420]: pam_unix(sudo:session): session closed for user root Aug 29 01:27:42 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d8691966-4c47-457b-a0d9-d117b759ef88 tempest-VolumeDependencyTests-162034196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-fdac5d05-f835-43b4-ab10-91657b676a76 1073741824" returned: 0 in 0.504s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:27:42 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d8691966-4c47-457b-a0d9-d117b759ef88 tempest-VolumeDependencyTests-162034196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-fdac5d05-f835-43b4-ab10-91657b676a76 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:27:42 devstack sudo[104426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-fdac5d05-f835-43b4-ab10-91657b676a76 Aug 29 01:27:42 devstack sudo[104426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:27:42 devstack sudo[104426]: pam_unix(sudo:session): session closed for user root Aug 29 01:27:42 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d8691966-4c47-457b-a0d9-d117b759ef88 tempest-VolumeDependencyTests-162034196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-fdac5d05-f835-43b4-ab10-91657b676a76" returned: 0 in 0.290s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:27:42 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-d8691966-4c47-457b-a0d9-d117b759ef88 tempest-VolumeDependencyTests-162034196 None] <== create_volume: return (841ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:27:42 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-d8691966-4c47-457b-a0d9-d117b759ef88 tempest-VolumeDependencyTests-162034196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.845s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:27:42 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-d8691966-4c47-457b-a0d9-d117b759ef88 tempest-VolumeDependencyTests-162034196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05333ea5-df6e-4766-8e23-f3867e3e8ca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fdac5d05-f835-43b4-ab10-91657b676a76', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:27:42 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-d8691966-4c47-457b-a0d9-d117b759ef88 tempest-VolumeDependencyTests-162034196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a755fdd-2a2a-4563-8b2b-fa6ea8490dc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:27:42 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-d8691966-4c47-457b-a0d9-d117b759ef88 tempest-VolumeDependencyTests-162034196 None] Volume volume-fdac5d05-f835-43b4-ab10-91657b676a76 (fdac5d05-f835-43b4-ab10-91657b676a76): created successfully Aug 29 01:27:42 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-d8691966-4c47-457b-a0d9-d117b759ef88 tempest-VolumeDependencyTests-162034196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a755fdd-2a2a-4563-8b2b-fa6ea8490dc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:27:42 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-d8691966-4c47-457b-a0d9-d117b759ef88 tempest-VolumeDependencyTests-162034196 None] Flow 'volume_create_manager' (4e8c484d-a543-409f-8f97-68c0d283360a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:27:42 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-d8691966-4c47-457b-a0d9-d117b759ef88 tempest-VolumeDependencyTests-162034196 None] Created volume successfully. Aug 29 01:27:43 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-12af84e6-dd45-4e16-a154-43f71126f3f1 tempest-CreateVolumesFromSnapshotTest-198098050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:27:43 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-12af84e6-dd45-4e16-a154-43f71126f3f1 tempest-CreateVolumesFromSnapshotTest-198098050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:27:43 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-12af84e6-dd45-4e16-a154-43f71126f3f1 tempest-CreateVolumesFromSnapshotTest-198098050 None] Creating offline snapshot fd5541c7-a626-42a1-80a6-1d317bf6f530 of volume 21da70b2-5db7-4690-aa08-c73d2272e3b8 {{(pid=86111) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 29 01:27:43 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[55c2ff83-9ff5-4e0d-9838-62ec98695c7e]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:27:43 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-12af84e6-dd45-4e16-a154-43f71126f3f1 tempest-CreateVolumesFromSnapshotTest-198098050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-21da70b2-5db7-4690-aa08-c73d2272e3b8 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:27:43 devstack sudo[104429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-21da70b2-5db7-4690-aa08-c73d2272e3b8 Aug 29 01:27:43 devstack sudo[104429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:27:43 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-ed67b900-280d-4493-abdf-7f72404cece8 tempest-VolumeDependencyTests-162034196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:27:43 devstack sudo[104429]: pam_unix(sudo:session): session closed for user root Aug 29 01:27:43 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-12af84e6-dd45-4e16-a154-43f71126f3f1 tempest-CreateVolumesFromSnapshotTest-198098050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-21da70b2-5db7-4690-aa08-c73d2272e3b8" returned: 0 in 0.437s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:27:43 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-12af84e6-dd45-4e16-a154-43f71126f3f1 tempest-CreateVolumesFromSnapshotTest-198098050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-21da70b2-5db7-4690-aa08-c73d2272e3b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-21da70b2-5db7-4690-aa08-c73d2272e3b8.fd5541c7-a626-42a1-80a6-1d317bf6f530 1G {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:27:43 devstack sudo[104434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-21da70b2-5db7-4690-aa08-c73d2272e3b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-21da70b2-5db7-4690-aa08-c73d2272e3b8.fd5541c7-a626-42a1-80a6-1d317bf6f530 1G Aug 29 01:27:43 devstack sudo[104434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:27:44 devstack sudo[104434]: pam_unix(sudo:session): session closed for user root Aug 29 01:27:44 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-12af84e6-dd45-4e16-a154-43f71126f3f1 tempest-CreateVolumesFromSnapshotTest-198098050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-21da70b2-5db7-4690-aa08-c73d2272e3b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-21da70b2-5db7-4690-aa08-c73d2272e3b8.fd5541c7-a626-42a1-80a6-1d317bf6f530 1G" returned: 0 in 0.480s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:27:44 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-12af84e6-dd45-4e16-a154-43f71126f3f1 tempest-CreateVolumesFromSnapshotTest-198098050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21da70b2-5db7-4690-aa08-c73d2272e3b8 -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-21da70b2-5db7-4690-aa08-c73d2272e3b8.fd5541c7-a626-42a1-80a6-1d317bf6f530 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:27:44 devstack sudo[104440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21da70b2-5db7-4690-aa08-c73d2272e3b8 -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-21da70b2-5db7-4690-aa08-c73d2272e3b8.fd5541c7-a626-42a1-80a6-1d317bf6f530 Aug 29 01:27:44 devstack sudo[104440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:27:44 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee446520-a01d-43cc-8c84-b9631e67fd95 tempest-VolumeImageDependencyTests-9500009 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:27:44 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-ee446520-a01d-43cc-8c84-b9631e67fd95 tempest-VolumeImageDependencyTests-9500009 None] Flow 'volume_create_manager' (dc2f599c-97dc-4aba-9332-09491ee4e163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:27:44 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-ee446520-a01d-43cc-8c84-b9631e67fd95 tempest-VolumeImageDependencyTests-9500009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a57d49ba-73ef-40c3-b698-72a27a4f2058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:27:44 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-ee446520-a01d-43cc-8c84-b9631e67fd95 tempest-VolumeImageDependencyTests-9500009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a57d49ba-73ef-40c3-b698-72a27a4f2058) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:27:44Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d169348-af19-443a-808c-eaa018e5553c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54e2c09b6c25415987bc4de2891f0259',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:27:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:27:44Z,use_quota=True,user_id='0e0ac9f294c947068111b6c2bf04a544',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:27:44 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-ee446520-a01d-43cc-8c84-b9631e67fd95 tempest-VolumeImageDependencyTests-9500009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cc8f87e-d35a-48d1-add5-72d66b6b94c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:27:44 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-ee446520-a01d-43cc-8c84-b9631e67fd95 tempest-VolumeImageDependencyTests-9500009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cc8f87e-d35a-48d1-add5-72d66b6b94c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:27:44 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-ee446520-a01d-43cc-8c84-b9631e67fd95 tempest-VolumeImageDependencyTests-9500009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9913e0cd-027d-4060-a1a1-dd8ca0a6c173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:27:44 devstack cinder-volume[86111]: DEBUG cinder.image.glance [None req-ee446520-a01d-43cc-8c84-b9631e67fd95 tempest-VolumeImageDependencyTests-9500009 None] Creating Keystone auth plugin from conf {{(pid=86111) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 29 01:27:44 devstack sudo[104440]: pam_unix(sudo:session): session closed for user root Aug 29 01:27:44 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-12af84e6-dd45-4e16-a154-43f71126f3f1 tempest-CreateVolumesFromSnapshotTest-198098050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21da70b2-5db7-4690-aa08-c73d2272e3b8 -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-21da70b2-5db7-4690-aa08-c73d2272e3b8.fd5541c7-a626-42a1-80a6-1d317bf6f530" returned: 0 in 0.361s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:27:44 devstack cinder-volume[86111]: WARNING cinder.volume.drivers.remotefs [None req-12af84e6-dd45-4e16-a154-43f71126f3f1 tempest-CreateVolumesFromSnapshotTest-198098050 None] /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-21da70b2-5db7-4690-aa08-c73d2272e3b8.fd5541c7-a626-42a1-80a6-1d317bf6f530 is being set with open permissions: ugo+rw Aug 29 01:27:44 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-12af84e6-dd45-4e16-a154-43f71126f3f1 tempest-CreateVolumesFromSnapshotTest-198098050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-21da70b2-5db7-4690-aa08-c73d2272e3b8.fd5541c7-a626-42a1-80a6-1d317bf6f530 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:27:44 devstack sudo[104446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-21da70b2-5db7-4690-aa08-c73d2272e3b8.fd5541c7-a626-42a1-80a6-1d317bf6f530 Aug 29 01:27:44 devstack sudo[104446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:27:44 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-ee446520-a01d-43cc-8c84-b9631e67fd95 tempest-VolumeImageDependencyTests-9500009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9913e0cd-027d-4060-a1a1-dd8ca0a6c173) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7d169348-af19-443a-808c-eaa018e5553c', 'volume_name': 'volume-7d169348-af19-443a-808c-eaa018e5553c', 'volume_size': 1, 'image_id': 'c058c115-3036-4b0a-935d-f027499758da', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c058c115-3036-4b0a-935d-f027499758da', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f5ad6e597848168d6a35516c193034f2', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '54e2c09b6c25415987bc4de2891f0259', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '71bac90079bc67a676c93613934bcd3c25c7ff8f03968744700ddd79b68eb903d6c2515ac200cbdb846176d48085008987cdcdc194f046e81c23407a6024ba6e', 'id': 'c058c115-3036-4b0a-935d-f027499758da', 'created_at': datetime.datetime(2026, 8, 28, 23, 27, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 23, 27, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c058c115-3036-4b0a-935d-f027499758da/file', 'properties': {}}, 'image_service': }' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:27:44 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-ee446520-a01d-43cc-8c84-b9631e67fd95 tempest-VolumeImageDependencyTests-9500009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76b871e8-ea22-44a3-a5a1-5cced83f8950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:27:44 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-ee446520-a01d-43cc-8c84-b9631e67fd95 tempest-VolumeImageDependencyTests-9500009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76b871e8-ea22-44a3-a5a1-5cced83f8950) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:27:44 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-ee446520-a01d-43cc-8c84-b9631e67fd95 tempest-VolumeImageDependencyTests-9500009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7ffb9a2-9e29-4e87-9ff8-6f6b24b48451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:27:44 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-ee446520-a01d-43cc-8c84-b9631e67fd95 tempest-VolumeImageDependencyTests-9500009 None] Volume 7d169348-af19-443a-808c-eaa018e5553c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7d169348-af19-443a-808c-eaa018e5553c', 'volume_size': 1, 'image_id': 'c058c115-3036-4b0a-935d-f027499758da', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c058c115-3036-4b0a-935d-f027499758da', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f5ad6e597848168d6a35516c193034f2', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '54e2c09b6c25415987bc4de2891f0259', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '71bac90079bc67a676c93613934bcd3c25c7ff8f03968744700ddd79b68eb903d6c2515ac200cbdb846176d48085008987cdcdc194f046e81c23407a6024ba6e', 'id': 'c058c115-3036-4b0a-935d-f027499758da', 'created_at': datetime.datetime(2026, 8, 28, 23, 27, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 23, 27, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c058c115-3036-4b0a-935d-f027499758da/file', 'properties': {}}, 'image_service': } Aug 29 01:27:44 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee446520-a01d-43cc-8c84-b9631e67fd95 tempest-VolumeImageDependencyTests-9500009 None] Trying to clone 7d169348-af19-443a-808c-eaa018e5553c from image c058c115-3036-4b0a-935d-f027499758da at location (None, [{'url': 'file:///opt/stack/data/glance/images/c058c115-3036-4b0a-935d-f027499758da', 'metadata': {}}]). {{(pid=86111) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 29 01:27:44 devstack cinder-volume[86111]: DEBUG cinder.image.image_utils [None req-ee446520-a01d-43cc-8c84-b9631e67fd95 tempest-VolumeImageDependencyTests-9500009 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c058c115-3036-4b0a-935d-f027499758da_e8tv01wwdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86111) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 29 01:27:44 devstack cinder-volume[86111]: INFO cinder.image.image_utils [None req-ee446520-a01d-43cc-8c84-b9631e67fd95 tempest-VolumeImageDependencyTests-9500009 None] Image download 0.00 MB at 0.00 MB/s Aug 29 01:27:44 devstack sudo[104446]: pam_unix(sudo:session): session closed for user root Aug 29 01:27:44 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-12af84e6-dd45-4e16-a154-43f71126f3f1 tempest-CreateVolumesFromSnapshotTest-198098050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-21da70b2-5db7-4690-aa08-c73d2272e3b8.fd5541c7-a626-42a1-80a6-1d317bf6f530" returned: 0 in 0.288s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:27:44 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[c57dbd04-2f98-4e34-985e-c1545c62ea00]: (4, 'raw') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:27:44 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-ee446520-a01d-43cc-8c84-b9631e67fd95 tempest-VolumeImageDependencyTests-9500009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c058c115-3036-4b0a-935d-f027499758da_e8tv01wwdevstack@QuobyteHD {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:27:44 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-12af84e6-dd45-4e16-a154-43f71126f3f1 tempest-CreateVolumesFromSnapshotTest-198098050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-21da70b2-5db7-4690-aa08-c73d2272e3b8.info {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:27:44 devstack sudo[104450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-21da70b2-5db7-4690-aa08-c73d2272e3b8.info Aug 29 01:27:44 devstack sudo[104450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:27:44 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb4401f0-b241-4644-b041-570f85782ce6 tempest-VolumeAndVolumeTypeFromImageTest-1868126148 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:27:44 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-fb4401f0-b241-4644-b041-570f85782ce6 tempest-VolumeAndVolumeTypeFromImageTest-1868126148 None] Flow 'volume_create_manager' (aacbb242-4728-4b34-928b-5068779e1bcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:27:44 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-fb4401f0-b241-4644-b041-570f85782ce6 tempest-VolumeAndVolumeTypeFromImageTest-1868126148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b1882a7-9cb6-442f-8c3b-0aae18a37957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:27:44 devstack sudo[104449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c058c115-3036-4b0a-935d-f027499758da_e8tv01wwdevstack@QuobyteHD Aug 29 01:27:44 devstack sudo[104449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:27:44 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-fb4401f0-b241-4644-b041-570f85782ce6 tempest-VolumeAndVolumeTypeFromImageTest-1868126148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b1882a7-9cb6-442f-8c3b-0aae18a37957) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:27:45Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=665419a8-3e32-4250-8058-13481f8fe6b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78b5719689134718b1578eda92db9f07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:27:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:27:45Z,use_quota=True,user_id='1317bb7d00ba4697a5e2c9d37756be09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d50fea9-d022-460f-b9bb-734bb6cd517f),volume_type_id=1d50fea9-d022-460f-b9bb-734bb6cd517f)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:27:44 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-fb4401f0-b241-4644-b041-570f85782ce6 tempest-VolumeAndVolumeTypeFromImageTest-1868126148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (023c783d-98ea-4c13-91f1-87e6dbe6e275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:27:44 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-fb4401f0-b241-4644-b041-570f85782ce6 tempest-VolumeAndVolumeTypeFromImageTest-1868126148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (023c783d-98ea-4c13-91f1-87e6dbe6e275) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:27:44 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-fb4401f0-b241-4644-b041-570f85782ce6 tempest-VolumeAndVolumeTypeFromImageTest-1868126148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12aabdf1-4758-4ad0-a298-c2e4a976eaa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:27:44 devstack cinder-volume[86111]: DEBUG cinder.image.glance [None req-fb4401f0-b241-4644-b041-570f85782ce6 tempest-VolumeAndVolumeTypeFromImageTest-1868126148 None] Creating Keystone auth plugin from conf {{(pid=86111) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 29 01:27:45 devstack sudo[104450]: pam_unix(sudo:session): session closed for user root Aug 29 01:27:45 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-12af84e6-dd45-4e16-a154-43f71126f3f1 tempest-CreateVolumesFromSnapshotTest-198098050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-21da70b2-5db7-4690-aa08-c73d2272e3b8.info" returned: 0 in 0.270s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:27:45 devstack cinder-volume[86111]: WARNING cinder.volume.drivers.remotefs [None req-12af84e6-dd45-4e16-a154-43f71126f3f1 tempest-CreateVolumesFromSnapshotTest-198098050 None] /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-21da70b2-5db7-4690-aa08-c73d2272e3b8.info is being set with open permissions: ugo+rw Aug 29 01:27:45 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-12af84e6-dd45-4e16-a154-43f71126f3f1 tempest-CreateVolumesFromSnapshotTest-198098050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-21da70b2-5db7-4690-aa08-c73d2272e3b8.info {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:27:45 devstack sudo[104456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-21da70b2-5db7-4690-aa08-c73d2272e3b8.info Aug 29 01:27:45 devstack sudo[104456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:27:45 devstack sudo[104449]: pam_unix(sudo:session): session closed for user root Aug 29 01:27:45 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-ee446520-a01d-43cc-8c84-b9631e67fd95 tempest-VolumeImageDependencyTests-9500009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c058c115-3036-4b0a-935d-f027499758da_e8tv01wwdevstack@QuobyteHD" returned: 0 in 0.345s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:27:45 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-ee446520-a01d-43cc-8c84-b9631e67fd95 tempest-VolumeImageDependencyTests-9500009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c058c115-3036-4b0a-935d-f027499758da_e8tv01wwdevstack@QuobyteHD {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:27:45 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-fb4401f0-b241-4644-b041-570f85782ce6 tempest-VolumeAndVolumeTypeFromImageTest-1868126148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12aabdf1-4758-4ad0-a298-c2e4a976eaa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '665419a8-3e32-4250-8058-13481f8fe6b5', 'volume_name': 'volume-665419a8-3e32-4250-8058-13481f8fe6b5', 'volume_size': 1, 'image_id': 'be5478e7-0299-43e2-893a-fcf5ccd2370a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/be5478e7-0299-43e2-893a-fcf5ccd2370a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9c0e0aa595aadd6215e6f24b31b077f2', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '78b5719689134718b1578eda92db9f07', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4cf0d0751f9c1c2d92179a2cefc83511aff5e8515f57fa802fa54d0e186a1cd08e6f8e72cc5b5e6018496368a8627ced52192fd31655f950d9e7eaadb0cf6207', 'id': 'be5478e7-0299-43e2-893a-fcf5ccd2370a', 'created_at': datetime.datetime(2026, 8, 28, 23, 27, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 23, 27, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/be5478e7-0299-43e2-893a-fcf5ccd2370a/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:27:45 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-fb4401f0-b241-4644-b041-570f85782ce6 tempest-VolumeAndVolumeTypeFromImageTest-1868126148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1e16f17-ae7e-4e83-adae-54c0021e29d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:27:45 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-fb4401f0-b241-4644-b041-570f85782ce6 tempest-VolumeAndVolumeTypeFromImageTest-1868126148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1e16f17-ae7e-4e83-adae-54c0021e29d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:27:45 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-fb4401f0-b241-4644-b041-570f85782ce6 tempest-VolumeAndVolumeTypeFromImageTest-1868126148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5a119a0-9870-410c-b10f-37ed73f60660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:27:45 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-fb4401f0-b241-4644-b041-570f85782ce6 tempest-VolumeAndVolumeTypeFromImageTest-1868126148 None] Volume 665419a8-3e32-4250-8058-13481f8fe6b5: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-665419a8-3e32-4250-8058-13481f8fe6b5', 'volume_size': 1, 'image_id': 'be5478e7-0299-43e2-893a-fcf5ccd2370a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/be5478e7-0299-43e2-893a-fcf5ccd2370a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9c0e0aa595aadd6215e6f24b31b077f2', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '78b5719689134718b1578eda92db9f07', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4cf0d0751f9c1c2d92179a2cefc83511aff5e8515f57fa802fa54d0e186a1cd08e6f8e72cc5b5e6018496368a8627ced52192fd31655f950d9e7eaadb0cf6207', 'id': 'be5478e7-0299-43e2-893a-fcf5ccd2370a', 'created_at': datetime.datetime(2026, 8, 28, 23, 27, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 23, 27, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/be5478e7-0299-43e2-893a-fcf5ccd2370a/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Aug 29 01:27:45 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb4401f0-b241-4644-b041-570f85782ce6 tempest-VolumeAndVolumeTypeFromImageTest-1868126148 None] Trying to clone 665419a8-3e32-4250-8058-13481f8fe6b5 from image be5478e7-0299-43e2-893a-fcf5ccd2370a at location (None, [{'url': 'file:///opt/stack/data/glance/images/be5478e7-0299-43e2-893a-fcf5ccd2370a', 'metadata': {}}]). {{(pid=86111) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 29 01:27:45 devstack sudo[104458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c058c115-3036-4b0a-935d-f027499758da_e8tv01wwdevstack@QuobyteHD Aug 29 01:27:45 devstack sudo[104458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:27:45 devstack cinder-volume[86111]: DEBUG cinder.image.image_utils [None req-fb4401f0-b241-4644-b041-570f85782ce6 tempest-VolumeAndVolumeTypeFromImageTest-1868126148 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_be5478e7-0299-43e2-893a-fcf5ccd2370a_loyzxapgdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86111) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 29 01:27:45 devstack cinder-volume[86111]: INFO cinder.image.image_utils [None req-fb4401f0-b241-4644-b041-570f85782ce6 tempest-VolumeAndVolumeTypeFromImageTest-1868126148 None] Image download 0.00 MB at 0.00 MB/s Aug 29 01:27:45 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad4bc4cb-5194-446d-b328-48f22d0d4ed7]: (4, 'raw') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:27:45 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-fb4401f0-b241-4644-b041-570f85782ce6 tempest-VolumeAndVolumeTypeFromImageTest-1868126148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_be5478e7-0299-43e2-893a-fcf5ccd2370a_loyzxapgdevstack@QuobyteHD {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:27:45 devstack sudo[104456]: pam_unix(sudo:session): session closed for user root Aug 29 01:27:45 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-12af84e6-dd45-4e16-a154-43f71126f3f1 tempest-CreateVolumesFromSnapshotTest-198098050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-21da70b2-5db7-4690-aa08-c73d2272e3b8.info" returned: 0 in 0.313s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:27:45 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-12af84e6-dd45-4e16-a154-43f71126f3f1 tempest-CreateVolumesFromSnapshotTest-198098050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.299s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:27:45 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-ed67b900-280d-4493-abdf-7f72404cece8 tempest-VolumeDependencyTests-162034196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.982s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:27:45 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-ed67b900-280d-4493-abdf-7f72404cece8 tempest-VolumeDependencyTests-162034196 None] Creating offline snapshot 33072856-62cd-4e62-93a5-774a41b4b01d of volume fdac5d05-f835-43b4-ab10-91657b676a76 {{(pid=86111) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 29 01:27:45 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[b93c0ecb-3c24-45f8-9a25-287eb8ba1979]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:27:45 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-ed67b900-280d-4493-abdf-7f72404cece8 tempest-VolumeDependencyTests-162034196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-fdac5d05-f835-43b4-ab10-91657b676a76 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:27:45 devstack sudo[104461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_be5478e7-0299-43e2-893a-fcf5ccd2370a_loyzxapgdevstack@QuobyteHD Aug 29 01:27:45 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-12af84e6-dd45-4e16-a154-43f71126f3f1 tempest-CreateVolumesFromSnapshotTest-198098050 None] Create snapshot completed successfully Aug 29 01:27:45 devstack sudo[104461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:27:45 devstack sudo[104458]: pam_unix(sudo:session): session closed for user root Aug 29 01:27:45 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-ee446520-a01d-43cc-8c84-b9631e67fd95 tempest-VolumeImageDependencyTests-9500009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c058c115-3036-4b0a-935d-f027499758da_e8tv01wwdevstack@QuobyteHD" returned: 1 in 0.372s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:27:45 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-ee446520-a01d-43cc-8c84-b9631e67fd95 tempest-VolumeImageDependencyTests-9500009 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c058c115-3036-4b0a-935d-f027499758da_e8tv01wwdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 29 01:27:45 devstack cinder-volume[86111]: DEBUG cinder.image.image_utils [None req-ee446520-a01d-43cc-8c84-b9631e67fd95 tempest-VolumeImageDependencyTests-9500009 None] Temporary image c058c115-3036-4b0a-935d-f027499758da is fetched for user 0e0ac9f294c947068111b6c2bf04a544. {{(pid=86111) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 29 01:27:45 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[dec8f8b4-df3b-4895-a81b-d4c11d52a2f8]: (4, 'raw') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:27:45 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-ee446520-a01d-43cc-8c84-b9631e67fd95 tempest-VolumeImageDependencyTests-9500009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c058c115-3036-4b0a-935d-f027499758da_e8tv01wwdevstack@QuobyteHD {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:27:45 devstack sudo[104465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-fdac5d05-f835-43b4-ab10-91657b676a76 Aug 29 01:27:45 devstack sudo[104465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:27:45 devstack sudo[104467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c058c115-3036-4b0a-935d-f027499758da_e8tv01wwdevstack@QuobyteHD Aug 29 01:27:45 devstack sudo[104467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:27:45 devstack sudo[104461]: pam_unix(sudo:session): session closed for user root Aug 29 01:27:45 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-fb4401f0-b241-4644-b041-570f85782ce6 tempest-VolumeAndVolumeTypeFromImageTest-1868126148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_be5478e7-0299-43e2-893a-fcf5ccd2370a_loyzxapgdevstack@QuobyteHD" returned: 0 in 0.386s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:27:45 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-fb4401f0-b241-4644-b041-570f85782ce6 tempest-VolumeAndVolumeTypeFromImageTest-1868126148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_be5478e7-0299-43e2-893a-fcf5ccd2370a_loyzxapgdevstack@QuobyteHD {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:27:45 devstack sudo[104472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_be5478e7-0299-43e2-893a-fcf5ccd2370a_loyzxapgdevstack@QuobyteHD Aug 29 01:27:45 devstack sudo[104472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:27:45 devstack sudo[104465]: pam_unix(sudo:session): session closed for user root Aug 29 01:27:45 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-ed67b900-280d-4493-abdf-7f72404cece8 tempest-VolumeDependencyTests-162034196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-fdac5d05-f835-43b4-ab10-91657b676a76" returned: 0 in 0.392s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:27:45 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-ed67b900-280d-4493-abdf-7f72404cece8 tempest-VolumeDependencyTests-162034196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-fdac5d05-f835-43b4-ab10-91657b676a76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-fdac5d05-f835-43b4-ab10-91657b676a76.33072856-62cd-4e62-93a5-774a41b4b01d 1G {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:27:45 devstack sudo[104477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-fdac5d05-f835-43b4-ab10-91657b676a76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-fdac5d05-f835-43b4-ab10-91657b676a76.33072856-62cd-4e62-93a5-774a41b4b01d 1G Aug 29 01:27:45 devstack sudo[104477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:27:45 devstack sudo[104467]: pam_unix(sudo:session): session closed for user root Aug 29 01:27:45 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-ee446520-a01d-43cc-8c84-b9631e67fd95 tempest-VolumeImageDependencyTests-9500009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c058c115-3036-4b0a-935d-f027499758da_e8tv01wwdevstack@QuobyteHD" returned: 0 in 0.369s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:27:45 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-ee446520-a01d-43cc-8c84-b9631e67fd95 tempest-VolumeImageDependencyTests-9500009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c058c115-3036-4b0a-935d-f027499758da_e8tv01wwdevstack@QuobyteHD {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:27:46 devstack sudo[104481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c058c115-3036-4b0a-935d-f027499758da_e8tv01wwdevstack@QuobyteHD Aug 29 01:27:46 devstack sudo[104481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:27:46 devstack sudo[104472]: pam_unix(sudo:session): session closed for user root Aug 29 01:27:46 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-fb4401f0-b241-4644-b041-570f85782ce6 tempest-VolumeAndVolumeTypeFromImageTest-1868126148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_be5478e7-0299-43e2-893a-fcf5ccd2370a_loyzxapgdevstack@QuobyteHD" returned: 1 in 0.353s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:27:46 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-fb4401f0-b241-4644-b041-570f85782ce6 tempest-VolumeAndVolumeTypeFromImageTest-1868126148 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_be5478e7-0299-43e2-893a-fcf5ccd2370a_loyzxapgdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 29 01:27:46 devstack cinder-volume[86111]: DEBUG cinder.image.image_utils [None req-fb4401f0-b241-4644-b041-570f85782ce6 tempest-VolumeAndVolumeTypeFromImageTest-1868126148 None] Temporary image be5478e7-0299-43e2-893a-fcf5ccd2370a is fetched for user 1317bb7d00ba4697a5e2c9d37756be09. {{(pid=86111) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 29 01:27:46 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[14444357-d5a1-434c-b9e7-5e94fa572e6f]: (4, 'raw') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:27:46 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-fb4401f0-b241-4644-b041-570f85782ce6 tempest-VolumeAndVolumeTypeFromImageTest-1868126148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_be5478e7-0299-43e2-893a-fcf5ccd2370a_loyzxapgdevstack@QuobyteHD {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:27:46 devstack sudo[104489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_be5478e7-0299-43e2-893a-fcf5ccd2370a_loyzxapgdevstack@QuobyteHD Aug 29 01:27:46 devstack sudo[104489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:27:46 devstack sudo[104481]: pam_unix(sudo:session): session closed for user root Aug 29 01:27:46 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-ee446520-a01d-43cc-8c84-b9631e67fd95 tempest-VolumeImageDependencyTests-9500009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c058c115-3036-4b0a-935d-f027499758da_e8tv01wwdevstack@QuobyteHD" returned: 1 in 0.379s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:27:46 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-ee446520-a01d-43cc-8c84-b9631e67fd95 tempest-VolumeImageDependencyTests-9500009 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c058c115-3036-4b0a-935d-f027499758da_e8tv01wwdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 29 01:27:46 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-ee446520-a01d-43cc-8c84-b9631e67fd95 tempest-VolumeImageDependencyTests-9500009 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:27:46 devstack sudo[104477]: pam_unix(sudo:session): session closed for user root Aug 29 01:27:46 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-ed67b900-280d-4493-abdf-7f72404cece8 tempest-VolumeDependencyTests-162034196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-fdac5d05-f835-43b4-ab10-91657b676a76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-fdac5d05-f835-43b4-ab10-91657b676a76.33072856-62cd-4e62-93a5-774a41b4b01d 1G" returned: 0 in 0.472s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:27:46 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-ed67b900-280d-4493-abdf-7f72404cece8 tempest-VolumeDependencyTests-162034196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fdac5d05-f835-43b4-ab10-91657b676a76 -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-fdac5d05-f835-43b4-ab10-91657b676a76.33072856-62cd-4e62-93a5-774a41b4b01d {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:27:46 devstack sudo[104495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fdac5d05-f835-43b4-ab10-91657b676a76 -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-fdac5d05-f835-43b4-ab10-91657b676a76.33072856-62cd-4e62-93a5-774a41b4b01d Aug 29 01:27:46 devstack sudo[104495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:27:46 devstack sudo[104489]: pam_unix(sudo:session): session closed for user root Aug 29 01:27:46 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-fb4401f0-b241-4644-b041-570f85782ce6 tempest-VolumeAndVolumeTypeFromImageTest-1868126148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_be5478e7-0299-43e2-893a-fcf5ccd2370a_loyzxapgdevstack@QuobyteHD" returned: 0 in 0.423s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:27:46 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-fb4401f0-b241-4644-b041-570f85782ce6 tempest-VolumeAndVolumeTypeFromImageTest-1868126148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_be5478e7-0299-43e2-893a-fcf5ccd2370a_loyzxapgdevstack@QuobyteHD {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:27:46 devstack sudo[104495]: pam_unix(sudo:session): session closed for user root Aug 29 01:27:46 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-ed67b900-280d-4493-abdf-7f72404cece8 tempest-VolumeDependencyTests-162034196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fdac5d05-f835-43b4-ab10-91657b676a76 -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-fdac5d05-f835-43b4-ab10-91657b676a76.33072856-62cd-4e62-93a5-774a41b4b01d" returned: 0 in 0.360s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:27:46 devstack cinder-volume[86111]: WARNING cinder.volume.drivers.remotefs [None req-ed67b900-280d-4493-abdf-7f72404cece8 tempest-VolumeDependencyTests-162034196 None] /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-fdac5d05-f835-43b4-ab10-91657b676a76.33072856-62cd-4e62-93a5-774a41b4b01d is being set with open permissions: ugo+rw Aug 29 01:27:46 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-ed67b900-280d-4493-abdf-7f72404cece8 tempest-VolumeDependencyTests-162034196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-fdac5d05-f835-43b4-ab10-91657b676a76.33072856-62cd-4e62-93a5-774a41b4b01d {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:27:46 devstack sudo[104501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_be5478e7-0299-43e2-893a-fcf5ccd2370a_loyzxapgdevstack@QuobyteHD Aug 29 01:27:46 devstack sudo[104501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:27:46 devstack sudo[104503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-fdac5d05-f835-43b4-ab10-91657b676a76.33072856-62cd-4e62-93a5-774a41b4b01d Aug 29 01:27:46 devstack sudo[104503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:27:46 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-d19ee1d7-759f-4d50-a283-f8f4d3574416 tempest-CreateVolumesFromSnapshotTest-198098050 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:27:46 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-d19ee1d7-759f-4d50-a283-f8f4d3574416 tempest-CreateVolumesFromSnapshotTest-198098050 None] Flow 'volume_create_manager' (99acef32-b31c-402c-a434-363b35a4f565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:27:46 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-d19ee1d7-759f-4d50-a283-f8f4d3574416 tempest-CreateVolumesFromSnapshotTest-198098050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dba61ae2-4a53-40a8-a982-b43d6d6bd90e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:27:46 devstack sudo[104501]: pam_unix(sudo:session): session closed for user root Aug 29 01:27:47 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-fb4401f0-b241-4644-b041-570f85782ce6 tempest-VolumeAndVolumeTypeFromImageTest-1868126148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_be5478e7-0299-43e2-893a-fcf5ccd2370a_loyzxapgdevstack@QuobyteHD" returned: 1 in 0.422s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:27:47 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-fb4401f0-b241-4644-b041-570f85782ce6 tempest-VolumeAndVolumeTypeFromImageTest-1868126148 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_be5478e7-0299-43e2-893a-fcf5ccd2370a_loyzxapgdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 29 01:27:47 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-fb4401f0-b241-4644-b041-570f85782ce6 tempest-VolumeAndVolumeTypeFromImageTest-1868126148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:27:47 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-d19ee1d7-759f-4d50-a283-f8f4d3574416 tempest-CreateVolumesFromSnapshotTest-198098050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dba61ae2-4a53-40a8-a982-b43d6d6bd90e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:27:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2054444267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d1bd2bf-45fa-43a5-9fd4-a76f31ec256f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e17418253c84515a6bc38dad1914444',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:27:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:27:47Z,use_quota=True,user_id='c518dccf017f4ac7ab2b4fd47a97a42c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:27:47 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-d19ee1d7-759f-4d50-a283-f8f4d3574416 tempest-CreateVolumesFromSnapshotTest-198098050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2f27bd1-7ed0-42eb-b3da-28354f014f22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:27:47 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-d19ee1d7-759f-4d50-a283-f8f4d3574416 tempest-CreateVolumesFromSnapshotTest-198098050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2f27bd1-7ed0-42eb-b3da-28354f014f22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:27:47 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-d19ee1d7-759f-4d50-a283-f8f4d3574416 tempest-CreateVolumesFromSnapshotTest-198098050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e833fa4-06c8-468a-b487-7fb47be6579c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:27:47 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-d19ee1d7-759f-4d50-a283-f8f4d3574416 tempest-CreateVolumesFromSnapshotTest-198098050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e833fa4-06c8-468a-b487-7fb47be6579c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d1bd2bf-45fa-43a5-9fd4-a76f31ec256f', 'volume_name': 'volume-9d1bd2bf-45fa-43a5-9fd4-a76f31ec256f', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:27:47 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-d19ee1d7-759f-4d50-a283-f8f4d3574416 tempest-CreateVolumesFromSnapshotTest-198098050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (896095cc-a49c-458b-b3d4-5193660363e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:27:47 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-d19ee1d7-759f-4d50-a283-f8f4d3574416 tempest-CreateVolumesFromSnapshotTest-198098050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (896095cc-a49c-458b-b3d4-5193660363e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:27:47 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-d19ee1d7-759f-4d50-a283-f8f4d3574416 tempest-CreateVolumesFromSnapshotTest-198098050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f03ce3f-0ae7-434a-9378-96769347bdbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:27:47 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-d19ee1d7-759f-4d50-a283-f8f4d3574416 tempest-CreateVolumesFromSnapshotTest-198098050 None] Volume 9d1bd2bf-45fa-43a5-9fd4-a76f31ec256f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d1bd2bf-45fa-43a5-9fd4-a76f31ec256f', 'volume_size': 1} Aug 29 01:27:47 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-d19ee1d7-759f-4d50-a283-f8f4d3574416 tempest-CreateVolumesFromSnapshotTest-198098050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:27:47 devstack sudo[104503]: pam_unix(sudo:session): session closed for user root Aug 29 01:27:47 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-ed67b900-280d-4493-abdf-7f72404cece8 tempest-VolumeDependencyTests-162034196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-fdac5d05-f835-43b4-ab10-91657b676a76.33072856-62cd-4e62-93a5-774a41b4b01d" returned: 0 in 0.378s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:27:47 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-ed67b900-280d-4493-abdf-7f72404cece8 tempest-VolumeDependencyTests-162034196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-fdac5d05-f835-43b4-ab10-91657b676a76.info {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:27:47 devstack sudo[104510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-fdac5d05-f835-43b4-ab10-91657b676a76.info Aug 29 01:27:47 devstack sudo[104510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:27:47 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-17eb8b8c-8139-4a9b-85da-2cb1ec9817fc tempest-CreateVolumesFromSnapshotTest-198098050 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:27:47 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-17eb8b8c-8139-4a9b-85da-2cb1ec9817fc tempest-CreateVolumesFromSnapshotTest-198098050 None] Flow 'volume_create_manager' (43da9ba1-6765-494c-807a-dbbc935914cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:27:47 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-17eb8b8c-8139-4a9b-85da-2cb1ec9817fc tempest-CreateVolumesFromSnapshotTest-198098050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca08191d-04d2-4314-afee-c9e1f7ec2766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:27:47 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-17eb8b8c-8139-4a9b-85da-2cb1ec9817fc tempest-CreateVolumesFromSnapshotTest-198098050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca08191d-04d2-4314-afee-c9e1f7ec2766) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:27:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1740918545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48c7cd73-3eb9-41c9-9726-4e33673bc688,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e17418253c84515a6bc38dad1914444',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:27:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:27:47Z,use_quota=True,user_id='c518dccf017f4ac7ab2b4fd47a97a42c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:27:47 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-17eb8b8c-8139-4a9b-85da-2cb1ec9817fc tempest-CreateVolumesFromSnapshotTest-198098050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55d8d69b-8a1b-4abd-93d3-095183b76ab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:27:47 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-17eb8b8c-8139-4a9b-85da-2cb1ec9817fc tempest-CreateVolumesFromSnapshotTest-198098050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55d8d69b-8a1b-4abd-93d3-095183b76ab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:27:47 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-17eb8b8c-8139-4a9b-85da-2cb1ec9817fc tempest-CreateVolumesFromSnapshotTest-198098050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d83193b9-c32d-49eb-83ec-d907efb690ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:27:47 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-17eb8b8c-8139-4a9b-85da-2cb1ec9817fc tempest-CreateVolumesFromSnapshotTest-198098050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d83193b9-c32d-49eb-83ec-d907efb690ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48c7cd73-3eb9-41c9-9726-4e33673bc688', 'volume_name': 'volume-48c7cd73-3eb9-41c9-9726-4e33673bc688', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:27:47 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-17eb8b8c-8139-4a9b-85da-2cb1ec9817fc tempest-CreateVolumesFromSnapshotTest-198098050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63af9f4b-a9e1-4ce1-9f32-42b7a4e77a94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:27:47 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-17eb8b8c-8139-4a9b-85da-2cb1ec9817fc tempest-CreateVolumesFromSnapshotTest-198098050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63af9f4b-a9e1-4ce1-9f32-42b7a4e77a94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:27:47 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-17eb8b8c-8139-4a9b-85da-2cb1ec9817fc tempest-CreateVolumesFromSnapshotTest-198098050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d8b4dd1-ca21-46fa-868c-e31ec3f57578) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:27:47 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-17eb8b8c-8139-4a9b-85da-2cb1ec9817fc tempest-CreateVolumesFromSnapshotTest-198098050 None] Volume 48c7cd73-3eb9-41c9-9726-4e33673bc688: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48c7cd73-3eb9-41c9-9726-4e33673bc688', 'volume_size': 1} Aug 29 01:27:47 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-17eb8b8c-8139-4a9b-85da-2cb1ec9817fc tempest-CreateVolumesFromSnapshotTest-198098050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:27:47 devstack sudo[104510]: pam_unix(sudo:session): session closed for user root Aug 29 01:27:47 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-ed67b900-280d-4493-abdf-7f72404cece8 tempest-VolumeDependencyTests-162034196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-fdac5d05-f835-43b4-ab10-91657b676a76.info" returned: 0 in 0.302s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:27:47 devstack cinder-volume[86111]: WARNING cinder.volume.drivers.remotefs [None req-ed67b900-280d-4493-abdf-7f72404cece8 tempest-VolumeDependencyTests-162034196 None] /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-fdac5d05-f835-43b4-ab10-91657b676a76.info is being set with open permissions: ugo+rw Aug 29 01:27:47 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-ed67b900-280d-4493-abdf-7f72404cece8 tempest-VolumeDependencyTests-162034196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-fdac5d05-f835-43b4-ab10-91657b676a76.info {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:27:47 devstack sudo[104513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-fdac5d05-f835-43b4-ab10-91657b676a76.info Aug 29 01:27:47 devstack sudo[104513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:27:47 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b5ce2e9-bd9f-4c66-b70a-13e0665ef082 tempest-CreateVolumesFromSnapshotTest-198098050 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:27:47 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-1b5ce2e9-bd9f-4c66-b70a-13e0665ef082 tempest-CreateVolumesFromSnapshotTest-198098050 None] Flow 'volume_create_manager' (1fd421fb-0a92-42b6-8e60-35d3f82598cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:27:47 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-1b5ce2e9-bd9f-4c66-b70a-13e0665ef082 tempest-CreateVolumesFromSnapshotTest-198098050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (946c8204-e012-4319-92d3-99c43c1a5af4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:27:47 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-1b5ce2e9-bd9f-4c66-b70a-13e0665ef082 tempest-CreateVolumesFromSnapshotTest-198098050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (946c8204-e012-4319-92d3-99c43c1a5af4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:27:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1687665347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2883b684-1e43-4f62-9a37-7a8b7c3ca3ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e17418253c84515a6bc38dad1914444',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:27:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:27:48Z,use_quota=True,user_id='c518dccf017f4ac7ab2b4fd47a97a42c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:27:47 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-1b5ce2e9-bd9f-4c66-b70a-13e0665ef082 tempest-CreateVolumesFromSnapshotTest-198098050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c11ed6a-c315-4810-aadd-07747f3dcb89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:27:47 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-1b5ce2e9-bd9f-4c66-b70a-13e0665ef082 tempest-CreateVolumesFromSnapshotTest-198098050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c11ed6a-c315-4810-aadd-07747f3dcb89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:27:47 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-1b5ce2e9-bd9f-4c66-b70a-13e0665ef082 tempest-CreateVolumesFromSnapshotTest-198098050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c74b597-8b3b-427b-8245-0b65d7c9c5d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:27:47 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-1b5ce2e9-bd9f-4c66-b70a-13e0665ef082 tempest-CreateVolumesFromSnapshotTest-198098050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c74b597-8b3b-427b-8245-0b65d7c9c5d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2883b684-1e43-4f62-9a37-7a8b7c3ca3ad', 'volume_name': 'volume-2883b684-1e43-4f62-9a37-7a8b7c3ca3ad', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:27:47 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-1b5ce2e9-bd9f-4c66-b70a-13e0665ef082 tempest-CreateVolumesFromSnapshotTest-198098050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48ab1aea-f229-4d99-a18f-b6210c468eed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:27:47 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-1b5ce2e9-bd9f-4c66-b70a-13e0665ef082 tempest-CreateVolumesFromSnapshotTest-198098050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48ab1aea-f229-4d99-a18f-b6210c468eed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:27:47 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-1b5ce2e9-bd9f-4c66-b70a-13e0665ef082 tempest-CreateVolumesFromSnapshotTest-198098050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6b55710-9c12-4102-bb9e-a60ce5b683b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:27:47 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-1b5ce2e9-bd9f-4c66-b70a-13e0665ef082 tempest-CreateVolumesFromSnapshotTest-198098050 None] Volume 2883b684-1e43-4f62-9a37-7a8b7c3ca3ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2883b684-1e43-4f62-9a37-7a8b7c3ca3ad', 'volume_size': 1} Aug 29 01:27:47 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-1b5ce2e9-bd9f-4c66-b70a-13e0665ef082 tempest-CreateVolumesFromSnapshotTest-198098050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:27:47 devstack sudo[104513]: pam_unix(sudo:session): session closed for user root Aug 29 01:27:47 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-ed67b900-280d-4493-abdf-7f72404cece8 tempest-VolumeDependencyTests-162034196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-fdac5d05-f835-43b4-ab10-91657b676a76.info" returned: 0 in 0.269s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:27:47 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-ed67b900-280d-4493-abdf-7f72404cece8 tempest-VolumeDependencyTests-162034196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.272s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:27:47 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-ee446520-a01d-43cc-8c84-b9631e67fd95 tempest-VolumeImageDependencyTests-9500009 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.379s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:27:47 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-ee446520-a01d-43cc-8c84-b9631e67fd95 tempest-VolumeImageDependencyTests-9500009 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:27:44Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d169348-af19-443a-808c-eaa018e5553c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54e2c09b6c25415987bc4de2891f0259',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:27:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:27:44Z,use_quota=True,user_id='0e0ac9f294c947068111b6c2bf04a544',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:27:47 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-ee446520-a01d-43cc-8c84-b9631e67fd95 tempest-VolumeImageDependencyTests-9500009 None] Creating volume 7d169348-af19-443a-808c-eaa018e5553c {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:27:47 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-ee446520-a01d-43cc-8c84-b9631e67fd95 tempest-VolumeImageDependencyTests-9500009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:27:47 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-ee446520-a01d-43cc-8c84-b9631e67fd95 tempest-VolumeImageDependencyTests-9500009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:27:47 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-ee446520-a01d-43cc-8c84-b9631e67fd95 tempest-VolumeImageDependencyTests-9500009 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:27:47 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-ee446520-a01d-43cc-8c84-b9631e67fd95 tempest-VolumeImageDependencyTests-9500009 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:27:47 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-ee446520-a01d-43cc-8c84-b9631e67fd95 tempest-VolumeImageDependencyTests-9500009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:27:47 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-ee446520-a01d-43cc-8c84-b9631e67fd95 tempest-VolumeImageDependencyTests-9500009 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:27:47 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-ee446520-a01d-43cc-8c84-b9631e67fd95 tempest-VolumeImageDependencyTests-9500009 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:27:47 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-ee446520-a01d-43cc-8c84-b9631e67fd95 tempest-VolumeImageDependencyTests-9500009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-7d169348-af19-443a-808c-eaa018e5553c 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:27:47 devstack sudo[104516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-7d169348-af19-443a-808c-eaa018e5553c 1073741824 Aug 29 01:27:47 devstack sudo[104516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:27:47 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-ed67b900-280d-4493-abdf-7f72404cece8 tempest-VolumeDependencyTests-162034196 None] Create snapshot completed successfully Aug 29 01:27:47 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-361aadd3-4e05-4a28-b352-2663146a7465 tempest-CreateVolumesFromSnapshotTest-198098050 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:27:47 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-361aadd3-4e05-4a28-b352-2663146a7465 tempest-CreateVolumesFromSnapshotTest-198098050 None] Flow 'volume_create_manager' (72c0d13e-22d7-48a5-93a3-5755916d52d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:27:47 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-361aadd3-4e05-4a28-b352-2663146a7465 tempest-CreateVolumesFromSnapshotTest-198098050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdd0ee95-fc39-45d1-adfa-3c13e464a3be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:27:47 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-361aadd3-4e05-4a28-b352-2663146a7465 tempest-CreateVolumesFromSnapshotTest-198098050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdd0ee95-fc39-45d1-adfa-3c13e464a3be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:27:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-189539825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=981c6152-3e78-409d-8aaf-5c7d1e987354,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e17418253c84515a6bc38dad1914444',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:27:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:27:48Z,use_quota=True,user_id='c518dccf017f4ac7ab2b4fd47a97a42c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:27:47 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-361aadd3-4e05-4a28-b352-2663146a7465 tempest-CreateVolumesFromSnapshotTest-198098050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3321dbf-e343-4108-9f10-f5f0e9dec620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:27:47 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-361aadd3-4e05-4a28-b352-2663146a7465 tempest-CreateVolumesFromSnapshotTest-198098050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3321dbf-e343-4108-9f10-f5f0e9dec620) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:27:48 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-361aadd3-4e05-4a28-b352-2663146a7465 tempest-CreateVolumesFromSnapshotTest-198098050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ac7c5d1-e5b6-4301-b45b-5956b9a9b0ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:27:48 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-361aadd3-4e05-4a28-b352-2663146a7465 tempest-CreateVolumesFromSnapshotTest-198098050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ac7c5d1-e5b6-4301-b45b-5956b9a9b0ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '981c6152-3e78-409d-8aaf-5c7d1e987354', 'volume_name': 'volume-981c6152-3e78-409d-8aaf-5c7d1e987354', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:27:48 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-361aadd3-4e05-4a28-b352-2663146a7465 tempest-CreateVolumesFromSnapshotTest-198098050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49ee3df6-bba5-4030-b055-e00413699af1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:27:48 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-361aadd3-4e05-4a28-b352-2663146a7465 tempest-CreateVolumesFromSnapshotTest-198098050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49ee3df6-bba5-4030-b055-e00413699af1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:27:48 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-361aadd3-4e05-4a28-b352-2663146a7465 tempest-CreateVolumesFromSnapshotTest-198098050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (366c913b-2019-4fbf-be9e-1352573a10fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:27:48 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-361aadd3-4e05-4a28-b352-2663146a7465 tempest-CreateVolumesFromSnapshotTest-198098050 None] Volume 981c6152-3e78-409d-8aaf-5c7d1e987354: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-981c6152-3e78-409d-8aaf-5c7d1e987354', 'volume_size': 1} Aug 29 01:27:48 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-361aadd3-4e05-4a28-b352-2663146a7465 tempest-CreateVolumesFromSnapshotTest-198098050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:27:48 devstack sudo[104516]: pam_unix(sudo:session): session closed for user root Aug 29 01:27:48 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-ee446520-a01d-43cc-8c84-b9631e67fd95 tempest-VolumeImageDependencyTests-9500009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-7d169348-af19-443a-808c-eaa018e5553c 1073741824" returned: 0 in 0.515s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:27:48 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-ee446520-a01d-43cc-8c84-b9631e67fd95 tempest-VolumeImageDependencyTests-9500009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-7d169348-af19-443a-808c-eaa018e5553c {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:27:48 devstack sudo[104522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-7d169348-af19-443a-808c-eaa018e5553c Aug 29 01:27:48 devstack sudo[104522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:27:48 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-c75e9036-dbe7-465f-b593-3d92bbc462b9 tempest-CreateVolumesFromSnapshotTest-198098050 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:27:48 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-c75e9036-dbe7-465f-b593-3d92bbc462b9 tempest-CreateVolumesFromSnapshotTest-198098050 None] Flow 'volume_create_manager' (99446c33-f4a4-4d33-9e13-2658a30d5e2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:27:48 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-c75e9036-dbe7-465f-b593-3d92bbc462b9 tempest-CreateVolumesFromSnapshotTest-198098050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a450c8b-c1d3-4097-8db5-5ce22108ed25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:27:48 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-c75e9036-dbe7-465f-b593-3d92bbc462b9 tempest-CreateVolumesFromSnapshotTest-198098050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a450c8b-c1d3-4097-8db5-5ce22108ed25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:27:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1561349011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e02a165-2698-4789-b3ab-61ea5fe1f374,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e17418253c84515a6bc38dad1914444',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:27:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:27:48Z,use_quota=True,user_id='c518dccf017f4ac7ab2b4fd47a97a42c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:27:48 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-c75e9036-dbe7-465f-b593-3d92bbc462b9 tempest-CreateVolumesFromSnapshotTest-198098050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3585bf0-130f-458f-b513-9f31931c86e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:27:48 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-c75e9036-dbe7-465f-b593-3d92bbc462b9 tempest-CreateVolumesFromSnapshotTest-198098050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3585bf0-130f-458f-b513-9f31931c86e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:27:48 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-c75e9036-dbe7-465f-b593-3d92bbc462b9 tempest-CreateVolumesFromSnapshotTest-198098050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9e1ffa8-99de-44cc-9820-199299b7863d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:27:48 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-c75e9036-dbe7-465f-b593-3d92bbc462b9 tempest-CreateVolumesFromSnapshotTest-198098050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9e1ffa8-99de-44cc-9820-199299b7863d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e02a165-2698-4789-b3ab-61ea5fe1f374', 'volume_name': 'volume-0e02a165-2698-4789-b3ab-61ea5fe1f374', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:27:48 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-c75e9036-dbe7-465f-b593-3d92bbc462b9 tempest-CreateVolumesFromSnapshotTest-198098050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e137f8cd-2acc-4c0f-bd57-f9ef1ebcc970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:27:48 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-c75e9036-dbe7-465f-b593-3d92bbc462b9 tempest-CreateVolumesFromSnapshotTest-198098050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e137f8cd-2acc-4c0f-bd57-f9ef1ebcc970) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:27:48 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-c75e9036-dbe7-465f-b593-3d92bbc462b9 tempest-CreateVolumesFromSnapshotTest-198098050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05c1c606-7540-4f1b-bfd1-fd05671457a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:27:48 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-c75e9036-dbe7-465f-b593-3d92bbc462b9 tempest-CreateVolumesFromSnapshotTest-198098050 None] Volume 0e02a165-2698-4789-b3ab-61ea5fe1f374: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e02a165-2698-4789-b3ab-61ea5fe1f374', 'volume_size': 1} Aug 29 01:27:48 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-c75e9036-dbe7-465f-b593-3d92bbc462b9 tempest-CreateVolumesFromSnapshotTest-198098050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:27:48 devstack sudo[104522]: pam_unix(sudo:session): session closed for user root Aug 29 01:27:48 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-ee446520-a01d-43cc-8c84-b9631e67fd95 tempest-VolumeImageDependencyTests-9500009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-7d169348-af19-443a-808c-eaa018e5553c" returned: 0 in 0.263s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:27:48 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-ee446520-a01d-43cc-8c84-b9631e67fd95 tempest-VolumeImageDependencyTests-9500009 None] <== create_volume: return (820ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:27:48 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-ee446520-a01d-43cc-8c84-b9631e67fd95 tempest-VolumeImageDependencyTests-9500009 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.823s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:27:48 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-fb4401f0-b241-4644-b041-570f85782ce6 tempest-VolumeAndVolumeTypeFromImageTest-1868126148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.511s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:27:48 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-fb4401f0-b241-4644-b041-570f85782ce6 tempest-VolumeAndVolumeTypeFromImageTest-1868126148 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:27:45Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=665419a8-3e32-4250-8058-13481f8fe6b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78b5719689134718b1578eda92db9f07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:27:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:27:45Z,use_quota=True,user_id='1317bb7d00ba4697a5e2c9d37756be09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d50fea9-d022-460f-b9bb-734bb6cd517f),volume_type_id=1d50fea9-d022-460f-b9bb-734bb6cd517f)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:27:48 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-fb4401f0-b241-4644-b041-570f85782ce6 tempest-VolumeAndVolumeTypeFromImageTest-1868126148 None] Creating volume 665419a8-3e32-4250-8058-13481f8fe6b5 {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:27:48 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-fb4401f0-b241-4644-b041-570f85782ce6 tempest-VolumeAndVolumeTypeFromImageTest-1868126148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:27:48 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-fb4401f0-b241-4644-b041-570f85782ce6 tempest-VolumeAndVolumeTypeFromImageTest-1868126148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:27:48 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-fb4401f0-b241-4644-b041-570f85782ce6 tempest-VolumeAndVolumeTypeFromImageTest-1868126148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:27:48 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-fb4401f0-b241-4644-b041-570f85782ce6 tempest-VolumeAndVolumeTypeFromImageTest-1868126148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:27:48 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-fb4401f0-b241-4644-b041-570f85782ce6 tempest-VolumeAndVolumeTypeFromImageTest-1868126148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:27:48 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-fb4401f0-b241-4644-b041-570f85782ce6 tempest-VolumeAndVolumeTypeFromImageTest-1868126148 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:27:48 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-fb4401f0-b241-4644-b041-570f85782ce6 tempest-VolumeAndVolumeTypeFromImageTest-1868126148 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:27:48 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-fb4401f0-b241-4644-b041-570f85782ce6 tempest-VolumeAndVolumeTypeFromImageTest-1868126148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-665419a8-3e32-4250-8058-13481f8fe6b5 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:27:48 devstack sudo[104525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-665419a8-3e32-4250-8058-13481f8fe6b5 1073741824 Aug 29 01:27:48 devstack sudo[104525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:27:48 devstack cinder-volume[86111]: DEBUG cinder.volume.volume_utils [None req-ee446520-a01d-43cc-8c84-b9631e67fd95 tempest-VolumeImageDependencyTests-9500009 None] Attempting download of c058c115-3036-4b0a-935d-f027499758da ((None, [{'url': 'file:///opt/stack/data/glance/images/c058c115-3036-4b0a-935d-f027499758da', 'metadata': {}}])) to volume 7d169348-af19-443a-808c-eaa018e5553c. {{(pid=86111) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 29 01:27:48 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[eddf4b29-60aa-443f-b1f0-83c0f0029a9f]: (4, 'raw') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:27:48 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-ee446520-a01d-43cc-8c84-b9631e67fd95 tempest-VolumeImageDependencyTests-9500009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c058c115-3036-4b0a-935d-f027499758da_yspei4r9 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:27:48 devstack sudo[104527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c058c115-3036-4b0a-935d-f027499758da_yspei4r9 Aug 29 01:27:48 devstack sudo[104527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:27:48 devstack sudo[104527]: pam_unix(sudo:session): session closed for user root Aug 29 01:27:48 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-ee446520-a01d-43cc-8c84-b9631e67fd95 tempest-VolumeImageDependencyTests-9500009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c058c115-3036-4b0a-935d-f027499758da_yspei4r9" returned: 0 in 0.364s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:27:48 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-ee446520-a01d-43cc-8c84-b9631e67fd95 tempest-VolumeImageDependencyTests-9500009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c058c115-3036-4b0a-935d-f027499758da_yspei4r9 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:27:49 devstack sudo[104525]: pam_unix(sudo:session): session closed for user root Aug 29 01:27:49 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-fb4401f0-b241-4644-b041-570f85782ce6 tempest-VolumeAndVolumeTypeFromImageTest-1868126148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-665419a8-3e32-4250-8058-13481f8fe6b5 1073741824" returned: 0 in 0.468s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:27:49 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-fb4401f0-b241-4644-b041-570f85782ce6 tempest-VolumeAndVolumeTypeFromImageTest-1868126148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-665419a8-3e32-4250-8058-13481f8fe6b5 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:27:49 devstack sudo[104535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-665419a8-3e32-4250-8058-13481f8fe6b5 Aug 29 01:27:49 devstack sudo[104535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:27:49 devstack sudo[104534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c058c115-3036-4b0a-935d-f027499758da_yspei4r9 Aug 29 01:27:49 devstack sudo[104534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:27:49 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6e99bbd-0e39-4e8d-b7d3-43d6f7ccc4b9 tempest-VolumeDependencyTests-162034196 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:27:49 devstack sudo[104535]: pam_unix(sudo:session): session closed for user root Aug 29 01:27:49 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-fb4401f0-b241-4644-b041-570f85782ce6 tempest-VolumeAndVolumeTypeFromImageTest-1868126148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-665419a8-3e32-4250-8058-13481f8fe6b5" returned: 0 in 0.282s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:27:49 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-fb4401f0-b241-4644-b041-570f85782ce6 tempest-VolumeAndVolumeTypeFromImageTest-1868126148 None] <== create_volume: return (802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:27:49 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-fb4401f0-b241-4644-b041-570f85782ce6 tempest-VolumeAndVolumeTypeFromImageTest-1868126148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.805s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:27:49 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-d19ee1d7-759f-4d50-a283-f8f4d3574416 tempest-CreateVolumesFromSnapshotTest-198098050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.272s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:27:49 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-d19ee1d7-759f-4d50-a283-f8f4d3574416 tempest-CreateVolumesFromSnapshotTest-198098050 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:27:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2054444267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d1bd2bf-45fa-43a5-9fd4-a76f31ec256f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e17418253c84515a6bc38dad1914444',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:27:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:27:47Z,use_quota=True,user_id='c518dccf017f4ac7ab2b4fd47a97a42c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:27:49 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-d19ee1d7-759f-4d50-a283-f8f4d3574416 tempest-CreateVolumesFromSnapshotTest-198098050 None] Creating volume 9d1bd2bf-45fa-43a5-9fd4-a76f31ec256f {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:27:49 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-d19ee1d7-759f-4d50-a283-f8f4d3574416 tempest-CreateVolumesFromSnapshotTest-198098050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:27:49 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-d19ee1d7-759f-4d50-a283-f8f4d3574416 tempest-CreateVolumesFromSnapshotTest-198098050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:27:49 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-d19ee1d7-759f-4d50-a283-f8f4d3574416 tempest-CreateVolumesFromSnapshotTest-198098050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:27:49 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-d19ee1d7-759f-4d50-a283-f8f4d3574416 tempest-CreateVolumesFromSnapshotTest-198098050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:27:49 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-d19ee1d7-759f-4d50-a283-f8f4d3574416 tempest-CreateVolumesFromSnapshotTest-198098050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:27:49 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-d19ee1d7-759f-4d50-a283-f8f4d3574416 tempest-CreateVolumesFromSnapshotTest-198098050 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:27:49 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-d19ee1d7-759f-4d50-a283-f8f4d3574416 tempest-CreateVolumesFromSnapshotTest-198098050 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:27:49 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d19ee1d7-759f-4d50-a283-f8f4d3574416 tempest-CreateVolumesFromSnapshotTest-198098050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-9d1bd2bf-45fa-43a5-9fd4-a76f31ec256f 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:27:49 devstack sudo[104534]: pam_unix(sudo:session): session closed for user root Aug 29 01:27:49 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-ee446520-a01d-43cc-8c84-b9631e67fd95 tempest-VolumeImageDependencyTests-9500009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c058c115-3036-4b0a-935d-f027499758da_yspei4r9" returned: 1 in 0.389s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:27:49 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-ee446520-a01d-43cc-8c84-b9631e67fd95 tempest-VolumeImageDependencyTests-9500009 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c058c115-3036-4b0a-935d-f027499758da_yspei4r9' failed. Not Retrying. {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 29 01:27:49 devstack sudo[104542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-9d1bd2bf-45fa-43a5-9fd4-a76f31ec256f 1073741824 Aug 29 01:27:49 devstack sudo[104542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:27:49 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-b6e99bbd-0e39-4e8d-b7d3-43d6f7ccc4b9 tempest-VolumeDependencyTests-162034196 None] Flow 'volume_create_manager' (6bf8a2fe-6b75-46c7-a53d-775f05e766d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:27:49 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-b6e99bbd-0e39-4e8d-b7d3-43d6f7ccc4b9 tempest-VolumeDependencyTests-162034196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65d69619-b6e6-4079-a2a8-fa53c8554b09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:27:49 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[3db6c457-4fce-4345-83ba-bc5730236e98]: (4, 'raw') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:27:49 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-ee446520-a01d-43cc-8c84-b9631e67fd95 tempest-VolumeImageDependencyTests-9500009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c058c115-3036-4b0a-935d-f027499758da_e8tv01wwdevstack@QuobyteHD {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:27:49 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-b6e99bbd-0e39-4e8d-b7d3-43d6f7ccc4b9 tempest-VolumeDependencyTests-162034196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65d69619-b6e6-4079-a2a8-fa53c8554b09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:27:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-524465791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ecd0092-9706-4800-a369-084e9ca9071e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f17dfec0bd1c45ecb8ae3b35d4553242',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:27:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=33072856-62cd-4e62-93a5-774a41b4b01d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:27:49Z,use_quota=True,user_id='8144453e1c894f87871ade8f82718d0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:27:49 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-b6e99bbd-0e39-4e8d-b7d3-43d6f7ccc4b9 tempest-VolumeDependencyTests-162034196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75660fed-f5b4-4bfd-88c4-0aa8fe2584fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:27:49 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-b6e99bbd-0e39-4e8d-b7d3-43d6f7ccc4b9 tempest-VolumeDependencyTests-162034196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75660fed-f5b4-4bfd-88c4-0aa8fe2584fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:27:49 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-b6e99bbd-0e39-4e8d-b7d3-43d6f7ccc4b9 tempest-VolumeDependencyTests-162034196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56893cdf-8b18-43dd-86fd-dfe23583c762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:27:49 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-b6e99bbd-0e39-4e8d-b7d3-43d6f7ccc4b9 tempest-VolumeDependencyTests-162034196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56893cdf-8b18-43dd-86fd-dfe23583c762) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9ecd0092-9706-4800-a369-084e9ca9071e', 'volume_name': 'volume-9ecd0092-9706-4800-a369-084e9ca9071e', 'volume_size': 1, 'snapshot_id': '33072856-62cd-4e62-93a5-774a41b4b01d'}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:27:49 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-b6e99bbd-0e39-4e8d-b7d3-43d6f7ccc4b9 tempest-VolumeDependencyTests-162034196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9468f516-7dea-4f46-90b9-47a6fff65e3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:27:49 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-b6e99bbd-0e39-4e8d-b7d3-43d6f7ccc4b9 tempest-VolumeDependencyTests-162034196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9468f516-7dea-4f46-90b9-47a6fff65e3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:27:49 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-b6e99bbd-0e39-4e8d-b7d3-43d6f7ccc4b9 tempest-VolumeDependencyTests-162034196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92cd7836-fb68-4739-af80-ddba7b245703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:27:49 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-b6e99bbd-0e39-4e8d-b7d3-43d6f7ccc4b9 tempest-VolumeDependencyTests-162034196 None] Volume 9ecd0092-9706-4800-a369-084e9ca9071e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9ecd0092-9706-4800-a369-084e9ca9071e', 'volume_size': 1, 'snapshot_id': '33072856-62cd-4e62-93a5-774a41b4b01d'} Aug 29 01:27:49 devstack cinder-volume[86111]: DEBUG cinder.volume.volume_utils [None req-fb4401f0-b241-4644-b041-570f85782ce6 tempest-VolumeAndVolumeTypeFromImageTest-1868126148 None] Attempting download of be5478e7-0299-43e2-893a-fcf5ccd2370a ((None, [{'url': 'file:///opt/stack/data/glance/images/be5478e7-0299-43e2-893a-fcf5ccd2370a', 'metadata': {}}])) to volume 665419a8-3e32-4250-8058-13481f8fe6b5. {{(pid=86111) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 29 01:27:49 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-b6e99bbd-0e39-4e8d-b7d3-43d6f7ccc4b9 tempest-VolumeDependencyTests-162034196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:27:49 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[952d60c2-100d-4fb0-b9e2-e1b7754b5218]: (4, 'raw') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:27:49 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-fb4401f0-b241-4644-b041-570f85782ce6 tempest-VolumeAndVolumeTypeFromImageTest-1868126148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_be5478e7-0299-43e2-893a-fcf5ccd2370a__3n56lpw {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:27:49 devstack sudo[104544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c058c115-3036-4b0a-935d-f027499758da_e8tv01wwdevstack@QuobyteHD Aug 29 01:27:49 devstack sudo[104544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:27:49 devstack sudo[104546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_be5478e7-0299-43e2-893a-fcf5ccd2370a__3n56lpw Aug 29 01:27:49 devstack sudo[104546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:27:49 devstack sudo[104544]: pam_unix(sudo:session): session closed for user root Aug 29 01:27:49 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-ee446520-a01d-43cc-8c84-b9631e67fd95 tempest-VolumeImageDependencyTests-9500009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c058c115-3036-4b0a-935d-f027499758da_e8tv01wwdevstack@QuobyteHD" returned: 0 in 0.369s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:27:49 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-ee446520-a01d-43cc-8c84-b9631e67fd95 tempest-VolumeImageDependencyTests-9500009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c058c115-3036-4b0a-935d-f027499758da_e8tv01wwdevstack@QuobyteHD {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:27:49 devstack sudo[104542]: pam_unix(sudo:session): session closed for user root Aug 29 01:27:49 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d19ee1d7-759f-4d50-a283-f8f4d3574416 tempest-CreateVolumesFromSnapshotTest-198098050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-9d1bd2bf-45fa-43a5-9fd4-a76f31ec256f 1073741824" returned: 0 in 0.454s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:27:49 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d19ee1d7-759f-4d50-a283-f8f4d3574416 tempest-CreateVolumesFromSnapshotTest-198098050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-9d1bd2bf-45fa-43a5-9fd4-a76f31ec256f {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:27:49 devstack sudo[104555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-9d1bd2bf-45fa-43a5-9fd4-a76f31ec256f Aug 29 01:27:49 devstack sudo[104555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:27:49 devstack sudo[104554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c058c115-3036-4b0a-935d-f027499758da_e8tv01wwdevstack@QuobyteHD Aug 29 01:27:49 devstack sudo[104554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:27:49 devstack sudo[104546]: pam_unix(sudo:session): session closed for user root Aug 29 01:27:49 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-fb4401f0-b241-4644-b041-570f85782ce6 tempest-VolumeAndVolumeTypeFromImageTest-1868126148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_be5478e7-0299-43e2-893a-fcf5ccd2370a__3n56lpw" returned: 0 in 0.374s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:27:49 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-fb4401f0-b241-4644-b041-570f85782ce6 tempest-VolumeAndVolumeTypeFromImageTest-1868126148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_be5478e7-0299-43e2-893a-fcf5ccd2370a__3n56lpw {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:27:50 devstack sudo[104560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_be5478e7-0299-43e2-893a-fcf5ccd2370a__3n56lpw Aug 29 01:27:50 devstack sudo[104560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:27:50 devstack sudo[104554]: pam_unix(sudo:session): session closed for user root Aug 29 01:27:50 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-ee446520-a01d-43cc-8c84-b9631e67fd95 tempest-VolumeImageDependencyTests-9500009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c058c115-3036-4b0a-935d-f027499758da_e8tv01wwdevstack@QuobyteHD" returned: 1 in 0.345s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:27:50 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-ee446520-a01d-43cc-8c84-b9631e67fd95 tempest-VolumeImageDependencyTests-9500009 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c058c115-3036-4b0a-935d-f027499758da_e8tv01wwdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 29 01:27:50 devstack cinder-volume[86111]: DEBUG cinder.image.image_utils [None req-ee446520-a01d-43cc-8c84-b9631e67fd95 tempest-VolumeImageDependencyTests-9500009 None] c058c115-3036-4b0a-935d-f027499758da was raw, converting to qcow2 {{(pid=86111) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 29 01:27:50 devstack sudo[104555]: pam_unix(sudo:session): session closed for user root Aug 29 01:27:50 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-ee446520-a01d-43cc-8c84-b9631e67fd95 tempest-VolumeImageDependencyTests-9500009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c058c115-3036-4b0a-935d-f027499758da_e8tv01wwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-7d169348-af19-443a-808c-eaa018e5553c {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:27:50 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d19ee1d7-759f-4d50-a283-f8f4d3574416 tempest-CreateVolumesFromSnapshotTest-198098050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-9d1bd2bf-45fa-43a5-9fd4-a76f31ec256f" returned: 0 in 0.325s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:27:50 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-d19ee1d7-759f-4d50-a283-f8f4d3574416 tempest-CreateVolumesFromSnapshotTest-198098050 None] <== create_volume: return (833ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:27:50 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-d19ee1d7-759f-4d50-a283-f8f4d3574416 tempest-CreateVolumesFromSnapshotTest-198098050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.836s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:27:50 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-17eb8b8c-8139-4a9b-85da-2cb1ec9817fc tempest-CreateVolumesFromSnapshotTest-198098050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.894s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:27:50 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-17eb8b8c-8139-4a9b-85da-2cb1ec9817fc tempest-CreateVolumesFromSnapshotTest-198098050 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:27:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1740918545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48c7cd73-3eb9-41c9-9726-4e33673bc688,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e17418253c84515a6bc38dad1914444',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:27:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:27:47Z,use_quota=True,user_id='c518dccf017f4ac7ab2b4fd47a97a42c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:27:50 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-17eb8b8c-8139-4a9b-85da-2cb1ec9817fc tempest-CreateVolumesFromSnapshotTest-198098050 None] Creating volume 48c7cd73-3eb9-41c9-9726-4e33673bc688 {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:27:50 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-17eb8b8c-8139-4a9b-85da-2cb1ec9817fc tempest-CreateVolumesFromSnapshotTest-198098050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:27:50 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-17eb8b8c-8139-4a9b-85da-2cb1ec9817fc tempest-CreateVolumesFromSnapshotTest-198098050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:27:50 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-17eb8b8c-8139-4a9b-85da-2cb1ec9817fc tempest-CreateVolumesFromSnapshotTest-198098050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:27:50 devstack sudo[104566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c058c115-3036-4b0a-935d-f027499758da_e8tv01wwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-7d169348-af19-443a-808c-eaa018e5553c Aug 29 01:27:50 devstack sudo[104566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:27:50 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-17eb8b8c-8139-4a9b-85da-2cb1ec9817fc tempest-CreateVolumesFromSnapshotTest-198098050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:27:50 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-17eb8b8c-8139-4a9b-85da-2cb1ec9817fc tempest-CreateVolumesFromSnapshotTest-198098050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:27:50 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-17eb8b8c-8139-4a9b-85da-2cb1ec9817fc tempest-CreateVolumesFromSnapshotTest-198098050 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:27:50 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-17eb8b8c-8139-4a9b-85da-2cb1ec9817fc tempest-CreateVolumesFromSnapshotTest-198098050 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:27:50 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-17eb8b8c-8139-4a9b-85da-2cb1ec9817fc tempest-CreateVolumesFromSnapshotTest-198098050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-48c7cd73-3eb9-41c9-9726-4e33673bc688 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:27:50 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-d19ee1d7-759f-4d50-a283-f8f4d3574416 tempest-CreateVolumesFromSnapshotTest-198098050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f03ce3f-0ae7-434a-9378-96769347bdbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d1bd2bf-45fa-43a5-9fd4-a76f31ec256f', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:27:50 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-d19ee1d7-759f-4d50-a283-f8f4d3574416 tempest-CreateVolumesFromSnapshotTest-198098050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (baa4158c-4b4c-4a3e-8bd9-7eb5b0d47277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:27:50 devstack sudo[104568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-48c7cd73-3eb9-41c9-9726-4e33673bc688 1073741824 Aug 29 01:27:50 devstack sudo[104568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:27:50 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-d19ee1d7-759f-4d50-a283-f8f4d3574416 tempest-CreateVolumesFromSnapshotTest-198098050 None] Volume volume-9d1bd2bf-45fa-43a5-9fd4-a76f31ec256f (9d1bd2bf-45fa-43a5-9fd4-a76f31ec256f): created successfully Aug 29 01:27:50 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-d19ee1d7-759f-4d50-a283-f8f4d3574416 tempest-CreateVolumesFromSnapshotTest-198098050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (baa4158c-4b4c-4a3e-8bd9-7eb5b0d47277) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:27:50 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-d19ee1d7-759f-4d50-a283-f8f4d3574416 tempest-CreateVolumesFromSnapshotTest-198098050 None] Flow 'volume_create_manager' (99acef32-b31c-402c-a434-363b35a4f565) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:27:50 devstack sudo[104560]: pam_unix(sudo:session): session closed for user root Aug 29 01:27:50 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-fb4401f0-b241-4644-b041-570f85782ce6 tempest-VolumeAndVolumeTypeFromImageTest-1868126148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_be5478e7-0299-43e2-893a-fcf5ccd2370a__3n56lpw" returned: 1 in 0.427s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:27:50 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-fb4401f0-b241-4644-b041-570f85782ce6 tempest-VolumeAndVolumeTypeFromImageTest-1868126148 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_be5478e7-0299-43e2-893a-fcf5ccd2370a__3n56lpw' failed. Not Retrying. {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 29 01:27:50 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[c739004f-68a8-47e2-bb2f-22da38578243]: (4, 'raw') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:27:50 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-fb4401f0-b241-4644-b041-570f85782ce6 tempest-VolumeAndVolumeTypeFromImageTest-1868126148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_be5478e7-0299-43e2-893a-fcf5ccd2370a_loyzxapgdevstack@QuobyteHD {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:27:50 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-d19ee1d7-759f-4d50-a283-f8f4d3574416 tempest-CreateVolumesFromSnapshotTest-198098050 None] Created volume successfully. Aug 29 01:27:50 devstack sudo[104572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_be5478e7-0299-43e2-893a-fcf5ccd2370a_loyzxapgdevstack@QuobyteHD Aug 29 01:27:50 devstack sudo[104572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:27:50 devstack sudo[104566]: pam_unix(sudo:session): session closed for user root Aug 29 01:27:50 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-ee446520-a01d-43cc-8c84-b9631e67fd95 tempest-VolumeImageDependencyTests-9500009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c058c115-3036-4b0a-935d-f027499758da_e8tv01wwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-7d169348-af19-443a-808c-eaa018e5553c" returned: 0 in 0.519s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:27:50 devstack cinder-volume[86111]: DEBUG cinder.image.image_utils [None req-ee446520-a01d-43cc-8c84-b9631e67fd95 tempest-VolumeImageDependencyTests-9500009 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c058c115-3036-4b0a-935d-f027499758da_e8tv01wwdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-7d169348-af19-443a-808c-eaa018e5553c {{(pid=86111) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 29 01:27:50 devstack cinder-volume[86111]: INFO cinder.image.image_utils [None req-ee446520-a01d-43cc-8c84-b9631e67fd95 tempest-VolumeImageDependencyTests-9500009 None] Converted 0.00 MB image at 0.00 MB/s Aug 29 01:27:50 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-ee446520-a01d-43cc-8c84-b9631e67fd95 tempest-VolumeImageDependencyTests-9500009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-7d169348-af19-443a-808c-eaa018e5553c 1G {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:27:50 devstack sudo[104581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-7d169348-af19-443a-808c-eaa018e5553c 1G Aug 29 01:27:50 devstack sudo[104581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:27:50 devstack sudo[104568]: pam_unix(sudo:session): session closed for user root Aug 29 01:27:50 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-17eb8b8c-8139-4a9b-85da-2cb1ec9817fc tempest-CreateVolumesFromSnapshotTest-198098050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-48c7cd73-3eb9-41c9-9726-4e33673bc688 1073741824" returned: 0 in 0.518s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:27:50 devstack sudo[104572]: pam_unix(sudo:session): session closed for user root Aug 29 01:27:50 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-fb4401f0-b241-4644-b041-570f85782ce6 tempest-VolumeAndVolumeTypeFromImageTest-1868126148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_be5478e7-0299-43e2-893a-fcf5ccd2370a_loyzxapgdevstack@QuobyteHD" returned: 0 in 0.409s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:27:50 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-fb4401f0-b241-4644-b041-570f85782ce6 tempest-VolumeAndVolumeTypeFromImageTest-1868126148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_be5478e7-0299-43e2-893a-fcf5ccd2370a_loyzxapgdevstack@QuobyteHD {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:27:50 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-17eb8b8c-8139-4a9b-85da-2cb1ec9817fc tempest-CreateVolumesFromSnapshotTest-198098050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-48c7cd73-3eb9-41c9-9726-4e33673bc688 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:27:50 devstack sudo[104586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-48c7cd73-3eb9-41c9-9726-4e33673bc688 Aug 29 01:27:50 devstack sudo[104586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:27:50 devstack sudo[104585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_be5478e7-0299-43e2-893a-fcf5ccd2370a_loyzxapgdevstack@QuobyteHD Aug 29 01:27:50 devstack sudo[104585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:27:50 devstack sudo[104581]: pam_unix(sudo:session): session closed for user root Aug 29 01:27:50 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-ee446520-a01d-43cc-8c84-b9631e67fd95 tempest-VolumeImageDependencyTests-9500009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-7d169348-af19-443a-808c-eaa018e5553c 1G" returned: 0 in 0.314s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:27:50 devstack cinder-volume[86111]: DEBUG cinder.volume.volume_utils [None req-ee446520-a01d-43cc-8c84-b9631e67fd95 tempest-VolumeImageDependencyTests-9500009 None] Downloaded image c058c115-3036-4b0a-935d-f027499758da ((None, [{'url': 'file:///opt/stack/data/glance/images/c058c115-3036-4b0a-935d-f027499758da', 'metadata': {}}])) to volume 7d169348-af19-443a-808c-eaa018e5553c successfully. {{(pid=86111) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 29 01:27:50 devstack cinder-volume[86111]: DEBUG cinder.image.image_utils [None req-ee446520-a01d-43cc-8c84-b9631e67fd95 tempest-VolumeImageDependencyTests-9500009 None] Temporary image c058c115-3036-4b0a-935d-f027499758da for user 0e0ac9f294c947068111b6c2bf04a544 is deleted. {{(pid=86111) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 29 01:27:50 devstack cinder-volume[86111]: DEBUG cinder.volume.volume_utils [None req-ee446520-a01d-43cc-8c84-b9631e67fd95 tempest-VolumeImageDependencyTests-9500009 None] Marking volume 7d169348-af19-443a-808c-eaa018e5553c as bootable. {{(pid=86111) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 29 01:27:51 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee446520-a01d-43cc-8c84-b9631e67fd95 tempest-VolumeImageDependencyTests-9500009 None] Copying metadata from image c058c115-3036-4b0a-935d-f027499758da to 7d169348-af19-443a-808c-eaa018e5553c. {{(pid=86111) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 29 01:27:51 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee446520-a01d-43cc-8c84-b9631e67fd95 tempest-VolumeImageDependencyTests-9500009 None] Creating volume glance metadata for volume 7d169348-af19-443a-808c-eaa018e5553c backed by image c058c115-3036-4b0a-935d-f027499758da with: {'image_id': 'c058c115-3036-4b0a-935d-f027499758da', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'f5ad6e597848168d6a35516c193034f2', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86111) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 29 01:27:51 devstack sudo[104586]: pam_unix(sudo:session): session closed for user root Aug 29 01:27:51 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-17eb8b8c-8139-4a9b-85da-2cb1ec9817fc tempest-CreateVolumesFromSnapshotTest-198098050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-48c7cd73-3eb9-41c9-9726-4e33673bc688" returned: 0 in 0.267s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:27:51 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-17eb8b8c-8139-4a9b-85da-2cb1ec9817fc tempest-CreateVolumesFromSnapshotTest-198098050 None] <== create_volume: return (848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:27:51 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-17eb8b8c-8139-4a9b-85da-2cb1ec9817fc tempest-CreateVolumesFromSnapshotTest-198098050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.854s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:27:51 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-1b5ce2e9-bd9f-4c66-b70a-13e0665ef082 tempest-CreateVolumesFromSnapshotTest-198098050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.387s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:27:51 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-1b5ce2e9-bd9f-4c66-b70a-13e0665ef082 tempest-CreateVolumesFromSnapshotTest-198098050 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:27:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1687665347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2883b684-1e43-4f62-9a37-7a8b7c3ca3ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e17418253c84515a6bc38dad1914444',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:27:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:27:48Z,use_quota=True,user_id='c518dccf017f4ac7ab2b4fd47a97a42c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:27:51 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-1b5ce2e9-bd9f-4c66-b70a-13e0665ef082 tempest-CreateVolumesFromSnapshotTest-198098050 None] Creating volume 2883b684-1e43-4f62-9a37-7a8b7c3ca3ad {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:27:51 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-1b5ce2e9-bd9f-4c66-b70a-13e0665ef082 tempest-CreateVolumesFromSnapshotTest-198098050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:27:51 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-1b5ce2e9-bd9f-4c66-b70a-13e0665ef082 tempest-CreateVolumesFromSnapshotTest-198098050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:27:51 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-1b5ce2e9-bd9f-4c66-b70a-13e0665ef082 tempest-CreateVolumesFromSnapshotTest-198098050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:27:51 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-1b5ce2e9-bd9f-4c66-b70a-13e0665ef082 tempest-CreateVolumesFromSnapshotTest-198098050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:27:51 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-1b5ce2e9-bd9f-4c66-b70a-13e0665ef082 tempest-CreateVolumesFromSnapshotTest-198098050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:27:51 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-1b5ce2e9-bd9f-4c66-b70a-13e0665ef082 tempest-CreateVolumesFromSnapshotTest-198098050 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:27:51 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-1b5ce2e9-bd9f-4c66-b70a-13e0665ef082 tempest-CreateVolumesFromSnapshotTest-198098050 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:27:51 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-1b5ce2e9-bd9f-4c66-b70a-13e0665ef082 tempest-CreateVolumesFromSnapshotTest-198098050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-2883b684-1e43-4f62-9a37-7a8b7c3ca3ad 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:27:51 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-17eb8b8c-8139-4a9b-85da-2cb1ec9817fc tempest-CreateVolumesFromSnapshotTest-198098050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d8b4dd1-ca21-46fa-868c-e31ec3f57578) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48c7cd73-3eb9-41c9-9726-4e33673bc688', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:27:51 devstack sudo[104593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-2883b684-1e43-4f62-9a37-7a8b7c3ca3ad 1073741824 Aug 29 01:27:51 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-17eb8b8c-8139-4a9b-85da-2cb1ec9817fc tempest-CreateVolumesFromSnapshotTest-198098050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71e6a0ee-84cc-4fea-bd09-df58a73f4e9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:27:51 devstack sudo[104593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:27:51 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-ee446520-a01d-43cc-8c84-b9631e67fd95 tempest-VolumeImageDependencyTests-9500009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7ffb9a2-9e29-4e87-9ff8-6f6b24b48451) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d169348-af19-443a-808c-eaa018e5553c', 'volume_size': 1, 'image_id': 'c058c115-3036-4b0a-935d-f027499758da', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c058c115-3036-4b0a-935d-f027499758da', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f5ad6e597848168d6a35516c193034f2', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '54e2c09b6c25415987bc4de2891f0259', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '71bac90079bc67a676c93613934bcd3c25c7ff8f03968744700ddd79b68eb903d6c2515ac200cbdb846176d48085008987cdcdc194f046e81c23407a6024ba6e', 'id': 'c058c115-3036-4b0a-935d-f027499758da', 'created_at': datetime.datetime(2026, 8, 28, 23, 27, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 23, 27, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c058c115-3036-4b0a-935d-f027499758da/file', 'properties': {}}, 'image_service': }' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:27:51 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-ee446520-a01d-43cc-8c84-b9631e67fd95 tempest-VolumeImageDependencyTests-9500009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79461b92-bdb2-45cc-b214-2322a4406ff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:27:51 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-17eb8b8c-8139-4a9b-85da-2cb1ec9817fc tempest-CreateVolumesFromSnapshotTest-198098050 None] Volume volume-48c7cd73-3eb9-41c9-9726-4e33673bc688 (48c7cd73-3eb9-41c9-9726-4e33673bc688): created successfully Aug 29 01:27:51 devstack sudo[104585]: pam_unix(sudo:session): session closed for user root Aug 29 01:27:51 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-17eb8b8c-8139-4a9b-85da-2cb1ec9817fc tempest-CreateVolumesFromSnapshotTest-198098050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71e6a0ee-84cc-4fea-bd09-df58a73f4e9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:27:51 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-17eb8b8c-8139-4a9b-85da-2cb1ec9817fc tempest-CreateVolumesFromSnapshotTest-198098050 None] Flow 'volume_create_manager' (43da9ba1-6765-494c-807a-dbbc935914cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:27:51 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-fb4401f0-b241-4644-b041-570f85782ce6 tempest-VolumeAndVolumeTypeFromImageTest-1868126148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_be5478e7-0299-43e2-893a-fcf5ccd2370a_loyzxapgdevstack@QuobyteHD" returned: 1 in 0.368s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:27:51 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-fb4401f0-b241-4644-b041-570f85782ce6 tempest-VolumeAndVolumeTypeFromImageTest-1868126148 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_be5478e7-0299-43e2-893a-fcf5ccd2370a_loyzxapgdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 29 01:27:51 devstack cinder-volume[86111]: DEBUG cinder.image.image_utils [None req-fb4401f0-b241-4644-b041-570f85782ce6 tempest-VolumeAndVolumeTypeFromImageTest-1868126148 None] be5478e7-0299-43e2-893a-fcf5ccd2370a was raw, converting to qcow2 {{(pid=86111) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 29 01:27:51 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-fb4401f0-b241-4644-b041-570f85782ce6 tempest-VolumeAndVolumeTypeFromImageTest-1868126148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_be5478e7-0299-43e2-893a-fcf5ccd2370a_loyzxapgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-665419a8-3e32-4250-8058-13481f8fe6b5 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:27:51 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-17eb8b8c-8139-4a9b-85da-2cb1ec9817fc tempest-CreateVolumesFromSnapshotTest-198098050 None] Created volume successfully. Aug 29 01:27:51 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-ee446520-a01d-43cc-8c84-b9631e67fd95 tempest-VolumeImageDependencyTests-9500009 None] Volume volume-7d169348-af19-443a-808c-eaa018e5553c (7d169348-af19-443a-808c-eaa018e5553c): created successfully Aug 29 01:27:51 devstack sudo[104598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_be5478e7-0299-43e2-893a-fcf5ccd2370a_loyzxapgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-665419a8-3e32-4250-8058-13481f8fe6b5 Aug 29 01:27:51 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-ee446520-a01d-43cc-8c84-b9631e67fd95 tempest-VolumeImageDependencyTests-9500009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79461b92-bdb2-45cc-b214-2322a4406ff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:27:51 devstack sudo[104598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:27:51 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-ee446520-a01d-43cc-8c84-b9631e67fd95 tempest-VolumeImageDependencyTests-9500009 None] Flow 'volume_create_manager' (dc2f599c-97dc-4aba-9332-09491ee4e163) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:27:51 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-ee446520-a01d-43cc-8c84-b9631e67fd95 tempest-VolumeImageDependencyTests-9500009 None] Created volume successfully. Aug 29 01:27:51 devstack sudo[104593]: pam_unix(sudo:session): session closed for user root Aug 29 01:27:51 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-1b5ce2e9-bd9f-4c66-b70a-13e0665ef082 tempest-CreateVolumesFromSnapshotTest-198098050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-2883b684-1e43-4f62-9a37-7a8b7c3ca3ad 1073741824" returned: 0 in 0.490s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:27:51 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-1b5ce2e9-bd9f-4c66-b70a-13e0665ef082 tempest-CreateVolumesFromSnapshotTest-198098050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-2883b684-1e43-4f62-9a37-7a8b7c3ca3ad {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:27:51 devstack sudo[104608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-2883b684-1e43-4f62-9a37-7a8b7c3ca3ad Aug 29 01:27:51 devstack sudo[104608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:27:51 devstack sudo[104598]: pam_unix(sudo:session): session closed for user root Aug 29 01:27:51 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-fb4401f0-b241-4644-b041-570f85782ce6 tempest-VolumeAndVolumeTypeFromImageTest-1868126148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_be5478e7-0299-43e2-893a-fcf5ccd2370a_loyzxapgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-665419a8-3e32-4250-8058-13481f8fe6b5" returned: 0 in 0.502s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:27:51 devstack cinder-volume[86111]: DEBUG cinder.image.image_utils [None req-fb4401f0-b241-4644-b041-570f85782ce6 tempest-VolumeAndVolumeTypeFromImageTest-1868126148 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_be5478e7-0299-43e2-893a-fcf5ccd2370a_loyzxapgdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-665419a8-3e32-4250-8058-13481f8fe6b5 {{(pid=86111) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 29 01:27:51 devstack cinder-volume[86111]: INFO cinder.image.image_utils [None req-fb4401f0-b241-4644-b041-570f85782ce6 tempest-VolumeAndVolumeTypeFromImageTest-1868126148 None] Converted 0.00 MB image at 0.00 MB/s Aug 29 01:27:51 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-fb4401f0-b241-4644-b041-570f85782ce6 tempest-VolumeAndVolumeTypeFromImageTest-1868126148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-665419a8-3e32-4250-8058-13481f8fe6b5 1G {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:27:51 devstack sudo[104610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-665419a8-3e32-4250-8058-13481f8fe6b5 1G Aug 29 01:27:51 devstack sudo[104610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:27:51 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-8c8ca922-75ee-477e-8006-377d155a498d tempest-VolumeImageDependencyTests-9500009 None] Acquiring lock "cinder-7d169348-af19-443a-808c-eaa018e5553c-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:27:51 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-8c8ca922-75ee-477e-8006-377d155a498d tempest-VolumeImageDependencyTests-9500009 None] Lock "cinder-7d169348-af19-443a-808c-eaa018e5553c-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:27:51 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-8c8ca922-75ee-477e-8006-377d155a498d tempest-VolumeImageDependencyTests-9500009 None] Acquiring lock "cinder-quobyte-7d169348-af19-443a-808c-eaa018e5553c" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:27:51 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-8c8ca922-75ee-477e-8006-377d155a498d tempest-VolumeImageDependencyTests-9500009 None] Lock "cinder-quobyte-7d169348-af19-443a-808c-eaa018e5553c" acquired by "delete_volume" :: waited 0.033s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:27:51 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[3065bde1-843d-405f-86d4-51c93379d7b1]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:27:51 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8c8ca922-75ee-477e-8006-377d155a498d tempest-VolumeImageDependencyTests-9500009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-7d169348-af19-443a-808c-eaa018e5553c {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:27:51 devstack sudo[104608]: pam_unix(sudo:session): session closed for user root Aug 29 01:27:51 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-1b5ce2e9-bd9f-4c66-b70a-13e0665ef082 tempest-CreateVolumesFromSnapshotTest-198098050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-2883b684-1e43-4f62-9a37-7a8b7c3ca3ad" returned: 0 in 0.327s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:27:51 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-1b5ce2e9-bd9f-4c66-b70a-13e0665ef082 tempest-CreateVolumesFromSnapshotTest-198098050 None] <== create_volume: return (859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:27:51 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-1b5ce2e9-bd9f-4c66-b70a-13e0665ef082 tempest-CreateVolumesFromSnapshotTest-198098050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.862s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:27:51 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-361aadd3-4e05-4a28-b352-2663146a7465 tempest-CreateVolumesFromSnapshotTest-198098050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.891s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:27:51 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-361aadd3-4e05-4a28-b352-2663146a7465 tempest-CreateVolumesFromSnapshotTest-198098050 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:27:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-189539825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=981c6152-3e78-409d-8aaf-5c7d1e987354,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e17418253c84515a6bc38dad1914444',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:27:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:27:48Z,use_quota=True,user_id='c518dccf017f4ac7ab2b4fd47a97a42c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:27:51 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-361aadd3-4e05-4a28-b352-2663146a7465 tempest-CreateVolumesFromSnapshotTest-198098050 None] Creating volume 981c6152-3e78-409d-8aaf-5c7d1e987354 {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:27:51 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-361aadd3-4e05-4a28-b352-2663146a7465 tempest-CreateVolumesFromSnapshotTest-198098050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:27:51 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-361aadd3-4e05-4a28-b352-2663146a7465 tempest-CreateVolumesFromSnapshotTest-198098050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:27:51 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-361aadd3-4e05-4a28-b352-2663146a7465 tempest-CreateVolumesFromSnapshotTest-198098050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:27:51 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-361aadd3-4e05-4a28-b352-2663146a7465 tempest-CreateVolumesFromSnapshotTest-198098050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:27:51 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-361aadd3-4e05-4a28-b352-2663146a7465 tempest-CreateVolumesFromSnapshotTest-198098050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:27:51 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-361aadd3-4e05-4a28-b352-2663146a7465 tempest-CreateVolumesFromSnapshotTest-198098050 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:27:51 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-361aadd3-4e05-4a28-b352-2663146a7465 tempest-CreateVolumesFromSnapshotTest-198098050 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:27:51 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-361aadd3-4e05-4a28-b352-2663146a7465 tempest-CreateVolumesFromSnapshotTest-198098050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-981c6152-3e78-409d-8aaf-5c7d1e987354 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:27:51 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-1b5ce2e9-bd9f-4c66-b70a-13e0665ef082 tempest-CreateVolumesFromSnapshotTest-198098050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6b55710-9c12-4102-bb9e-a60ce5b683b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2883b684-1e43-4f62-9a37-7a8b7c3ca3ad', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:27:51 devstack sudo[104617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-981c6152-3e78-409d-8aaf-5c7d1e987354 1073741824 Aug 29 01:27:51 devstack sudo[104617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:27:51 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-1b5ce2e9-bd9f-4c66-b70a-13e0665ef082 tempest-CreateVolumesFromSnapshotTest-198098050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93829b0f-6c8c-47f8-8808-14d7af088b56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:27:51 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-1b5ce2e9-bd9f-4c66-b70a-13e0665ef082 tempest-CreateVolumesFromSnapshotTest-198098050 None] Volume volume-2883b684-1e43-4f62-9a37-7a8b7c3ca3ad (2883b684-1e43-4f62-9a37-7a8b7c3ca3ad): created successfully Aug 29 01:27:51 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-1b5ce2e9-bd9f-4c66-b70a-13e0665ef082 tempest-CreateVolumesFromSnapshotTest-198098050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93829b0f-6c8c-47f8-8808-14d7af088b56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:27:51 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-1b5ce2e9-bd9f-4c66-b70a-13e0665ef082 tempest-CreateVolumesFromSnapshotTest-198098050 None] Flow 'volume_create_manager' (1fd421fb-0a92-42b6-8e60-35d3f82598cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:27:51 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-1b5ce2e9-bd9f-4c66-b70a-13e0665ef082 tempest-CreateVolumesFromSnapshotTest-198098050 None] Created volume successfully. Aug 29 01:27:52 devstack sudo[104615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-7d169348-af19-443a-808c-eaa018e5553c Aug 29 01:27:52 devstack sudo[104615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:27:52 devstack sudo[104610]: pam_unix(sudo:session): session closed for user root Aug 29 01:27:52 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-fb4401f0-b241-4644-b041-570f85782ce6 tempest-VolumeAndVolumeTypeFromImageTest-1868126148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-665419a8-3e32-4250-8058-13481f8fe6b5 1G" returned: 0 in 0.386s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:27:52 devstack cinder-volume[86111]: DEBUG cinder.volume.volume_utils [None req-fb4401f0-b241-4644-b041-570f85782ce6 tempest-VolumeAndVolumeTypeFromImageTest-1868126148 None] Downloaded image be5478e7-0299-43e2-893a-fcf5ccd2370a ((None, [{'url': 'file:///opt/stack/data/glance/images/be5478e7-0299-43e2-893a-fcf5ccd2370a', 'metadata': {}}])) to volume 665419a8-3e32-4250-8058-13481f8fe6b5 successfully. {{(pid=86111) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 29 01:27:52 devstack cinder-volume[86111]: DEBUG cinder.image.image_utils [None req-fb4401f0-b241-4644-b041-570f85782ce6 tempest-VolumeAndVolumeTypeFromImageTest-1868126148 None] Temporary image be5478e7-0299-43e2-893a-fcf5ccd2370a for user 1317bb7d00ba4697a5e2c9d37756be09 is deleted. {{(pid=86111) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 29 01:27:52 devstack cinder-volume[86111]: DEBUG cinder.volume.volume_utils [None req-fb4401f0-b241-4644-b041-570f85782ce6 tempest-VolumeAndVolumeTypeFromImageTest-1868126148 None] Marking volume 665419a8-3e32-4250-8058-13481f8fe6b5 as bootable. {{(pid=86111) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 29 01:27:52 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb4401f0-b241-4644-b041-570f85782ce6 tempest-VolumeAndVolumeTypeFromImageTest-1868126148 None] Copying metadata from image be5478e7-0299-43e2-893a-fcf5ccd2370a to 665419a8-3e32-4250-8058-13481f8fe6b5. {{(pid=86111) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 29 01:27:52 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb4401f0-b241-4644-b041-570f85782ce6 tempest-VolumeAndVolumeTypeFromImageTest-1868126148 None] Creating volume glance metadata for volume 665419a8-3e32-4250-8058-13481f8fe6b5 backed by image be5478e7-0299-43e2-893a-fcf5ccd2370a with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'be5478e7-0299-43e2-893a-fcf5ccd2370a', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '9c0e0aa595aadd6215e6f24b31b077f2', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86111) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 29 01:27:52 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-fb4401f0-b241-4644-b041-570f85782ce6 tempest-VolumeAndVolumeTypeFromImageTest-1868126148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5a119a0-9870-410c-b10f-37ed73f60660) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-665419a8-3e32-4250-8058-13481f8fe6b5', 'volume_size': 1, 'image_id': 'be5478e7-0299-43e2-893a-fcf5ccd2370a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/be5478e7-0299-43e2-893a-fcf5ccd2370a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9c0e0aa595aadd6215e6f24b31b077f2', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '78b5719689134718b1578eda92db9f07', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4cf0d0751f9c1c2d92179a2cefc83511aff5e8515f57fa802fa54d0e186a1cd08e6f8e72cc5b5e6018496368a8627ced52192fd31655f950d9e7eaadb0cf6207', 'id': 'be5478e7-0299-43e2-893a-fcf5ccd2370a', 'created_at': datetime.datetime(2026, 8, 28, 23, 27, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 28, 23, 27, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/be5478e7-0299-43e2-893a-fcf5ccd2370a/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:27:52 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-fb4401f0-b241-4644-b041-570f85782ce6 tempest-VolumeAndVolumeTypeFromImageTest-1868126148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68ff83a7-f0ac-4757-870b-aee9a3572e98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:27:52 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-fb4401f0-b241-4644-b041-570f85782ce6 tempest-VolumeAndVolumeTypeFromImageTest-1868126148 None] Volume volume-665419a8-3e32-4250-8058-13481f8fe6b5 (665419a8-3e32-4250-8058-13481f8fe6b5): created successfully Aug 29 01:27:52 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-fb4401f0-b241-4644-b041-570f85782ce6 tempest-VolumeAndVolumeTypeFromImageTest-1868126148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68ff83a7-f0ac-4757-870b-aee9a3572e98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:27:52 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-fb4401f0-b241-4644-b041-570f85782ce6 tempest-VolumeAndVolumeTypeFromImageTest-1868126148 None] Flow 'volume_create_manager' (aacbb242-4728-4b34-928b-5068779e1bcc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:27:52 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-fb4401f0-b241-4644-b041-570f85782ce6 tempest-VolumeAndVolumeTypeFromImageTest-1868126148 None] Created volume successfully. Aug 29 01:27:52 devstack sudo[104615]: pam_unix(sudo:session): session closed for user root Aug 29 01:27:52 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8c8ca922-75ee-477e-8006-377d155a498d tempest-VolumeImageDependencyTests-9500009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-7d169348-af19-443a-808c-eaa018e5553c" returned: 0 in 0.385s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:27:52 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8c8ca922-75ee-477e-8006-377d155a498d tempest-VolumeImageDependencyTests-9500009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-7d169348-af19-443a-808c-eaa018e5553c {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:27:52 devstack sudo[104626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-7d169348-af19-443a-808c-eaa018e5553c Aug 29 01:27:52 devstack sudo[104626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:27:52 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-240d12eb-c451-46ae-87f1-da2acbb22cb1 tempest-VolumeAndVolumeTypeFromImageTest-1868126148 None] Acquiring lock "cinder-665419a8-3e32-4250-8058-13481f8fe6b5-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:27:52 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-240d12eb-c451-46ae-87f1-da2acbb22cb1 tempest-VolumeAndVolumeTypeFromImageTest-1868126148 None] Lock "cinder-665419a8-3e32-4250-8058-13481f8fe6b5-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:27:52 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-240d12eb-c451-46ae-87f1-da2acbb22cb1 tempest-VolumeAndVolumeTypeFromImageTest-1868126148 None] Acquiring lock "cinder-quobyte-665419a8-3e32-4250-8058-13481f8fe6b5" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:27:52 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-240d12eb-c451-46ae-87f1-da2acbb22cb1 tempest-VolumeAndVolumeTypeFromImageTest-1868126148 None] Lock "cinder-quobyte-665419a8-3e32-4250-8058-13481f8fe6b5" acquired by "delete_volume" :: waited 0.019s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:27:52 devstack sudo[104617]: pam_unix(sudo:session): session closed for user root Aug 29 01:27:52 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-361aadd3-4e05-4a28-b352-2663146a7465 tempest-CreateVolumesFromSnapshotTest-198098050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-981c6152-3e78-409d-8aaf-5c7d1e987354 1073741824" returned: 0 in 0.572s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:27:52 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[83400801-bee7-450c-ac71-9c3fbab373a3]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:27:52 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-240d12eb-c451-46ae-87f1-da2acbb22cb1 tempest-VolumeAndVolumeTypeFromImageTest-1868126148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-665419a8-3e32-4250-8058-13481f8fe6b5 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:27:52 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-361aadd3-4e05-4a28-b352-2663146a7465 tempest-CreateVolumesFromSnapshotTest-198098050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-981c6152-3e78-409d-8aaf-5c7d1e987354 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:27:52 devstack sudo[104630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-981c6152-3e78-409d-8aaf-5c7d1e987354 Aug 29 01:27:52 devstack sudo[104630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:27:52 devstack sudo[104626]: pam_unix(sudo:session): session closed for user root Aug 29 01:27:52 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8c8ca922-75ee-477e-8006-377d155a498d tempest-VolumeImageDependencyTests-9500009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-7d169348-af19-443a-808c-eaa018e5553c" returned: 0 in 0.338s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:27:52 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-8c8ca922-75ee-477e-8006-377d155a498d tempest-VolumeImageDependencyTests-9500009 None] Lock "cinder-quobyte-7d169348-af19-443a-808c-eaa018e5553c" released by "delete_volume" :: held 0.785s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:27:52 devstack sudo[104628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-665419a8-3e32-4250-8058-13481f8fe6b5 Aug 29 01:27:52 devstack sudo[104628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:27:52 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-8c8ca922-75ee-477e-8006-377d155a498d tempest-VolumeImageDependencyTests-9500009 None] Created reservations ['96f37999-8f56-4f5b-adb5-db2488f427cf', '58d25898-bfe8-4c64-99d5-7c7081735784', 'cc5953d7-261f-42e8-b99e-4dc4f3d22333', '071cf0dc-6463-423a-9b80-bd23b6a2858f'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:27:52 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-8c8ca922-75ee-477e-8006-377d155a498d tempest-VolumeImageDependencyTests-9500009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:27:52 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-8c8ca922-75ee-477e-8006-377d155a498d tempest-VolumeImageDependencyTests-9500009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:27:52 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-8c8ca922-75ee-477e-8006-377d155a498d tempest-VolumeImageDependencyTests-9500009 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:27:52 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-8c8ca922-75ee-477e-8006-377d155a498d tempest-VolumeImageDependencyTests-9500009 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:27:52 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-8c8ca922-75ee-477e-8006-377d155a498d tempest-VolumeImageDependencyTests-9500009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:27:52 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8c8ca922-75ee-477e-8006-377d155a498d tempest-VolumeImageDependencyTests-9500009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:27:52 devstack sudo[104633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:27:52 devstack sudo[104633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:27:52 devstack sudo[104630]: pam_unix(sudo:session): session closed for user root Aug 29 01:27:52 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-361aadd3-4e05-4a28-b352-2663146a7465 tempest-CreateVolumesFromSnapshotTest-198098050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-981c6152-3e78-409d-8aaf-5c7d1e987354" returned: 0 in 0.294s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:27:52 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-361aadd3-4e05-4a28-b352-2663146a7465 tempest-CreateVolumesFromSnapshotTest-198098050 None] <== create_volume: return (936ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:27:52 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-361aadd3-4e05-4a28-b352-2663146a7465 tempest-CreateVolumesFromSnapshotTest-198098050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.939s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:27:52 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-c75e9036-dbe7-465f-b593-3d92bbc462b9 tempest-CreateVolumesFromSnapshotTest-198098050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.462s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:27:52 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-c75e9036-dbe7-465f-b593-3d92bbc462b9 tempest-CreateVolumesFromSnapshotTest-198098050 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:27:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1561349011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e02a165-2698-4789-b3ab-61ea5fe1f374,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e17418253c84515a6bc38dad1914444',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:27:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:27:48Z,use_quota=True,user_id='c518dccf017f4ac7ab2b4fd47a97a42c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:27:52 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-c75e9036-dbe7-465f-b593-3d92bbc462b9 tempest-CreateVolumesFromSnapshotTest-198098050 None] Creating volume 0e02a165-2698-4789-b3ab-61ea5fe1f374 {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:27:52 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-c75e9036-dbe7-465f-b593-3d92bbc462b9 tempest-CreateVolumesFromSnapshotTest-198098050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:27:52 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-c75e9036-dbe7-465f-b593-3d92bbc462b9 tempest-CreateVolumesFromSnapshotTest-198098050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:27:52 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-c75e9036-dbe7-465f-b593-3d92bbc462b9 tempest-CreateVolumesFromSnapshotTest-198098050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:27:52 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-c75e9036-dbe7-465f-b593-3d92bbc462b9 tempest-CreateVolumesFromSnapshotTest-198098050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:27:52 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-c75e9036-dbe7-465f-b593-3d92bbc462b9 tempest-CreateVolumesFromSnapshotTest-198098050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:27:52 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-c75e9036-dbe7-465f-b593-3d92bbc462b9 tempest-CreateVolumesFromSnapshotTest-198098050 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:27:52 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-c75e9036-dbe7-465f-b593-3d92bbc462b9 tempest-CreateVolumesFromSnapshotTest-198098050 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:27:52 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c75e9036-dbe7-465f-b593-3d92bbc462b9 tempest-CreateVolumesFromSnapshotTest-198098050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-0e02a165-2698-4789-b3ab-61ea5fe1f374 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:27:52 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-361aadd3-4e05-4a28-b352-2663146a7465 tempest-CreateVolumesFromSnapshotTest-198098050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (366c913b-2019-4fbf-be9e-1352573a10fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-981c6152-3e78-409d-8aaf-5c7d1e987354', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:27:52 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-361aadd3-4e05-4a28-b352-2663146a7465 tempest-CreateVolumesFromSnapshotTest-198098050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89790bb9-f2a2-405f-833e-3b954c4a691d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:27:52 devstack sudo[104637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-0e02a165-2698-4789-b3ab-61ea5fe1f374 1073741824 Aug 29 01:27:52 devstack sudo[104637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:27:52 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-361aadd3-4e05-4a28-b352-2663146a7465 tempest-CreateVolumesFromSnapshotTest-198098050 None] Volume volume-981c6152-3e78-409d-8aaf-5c7d1e987354 (981c6152-3e78-409d-8aaf-5c7d1e987354): created successfully Aug 29 01:27:52 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-361aadd3-4e05-4a28-b352-2663146a7465 tempest-CreateVolumesFromSnapshotTest-198098050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89790bb9-f2a2-405f-833e-3b954c4a691d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:27:52 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-361aadd3-4e05-4a28-b352-2663146a7465 tempest-CreateVolumesFromSnapshotTest-198098050 None] Flow 'volume_create_manager' (72c0d13e-22d7-48a5-93a3-5755916d52d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:27:52 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-361aadd3-4e05-4a28-b352-2663146a7465 tempest-CreateVolumesFromSnapshotTest-198098050 None] Created volume successfully. Aug 29 01:27:52 devstack sudo[104628]: pam_unix(sudo:session): session closed for user root Aug 29 01:27:52 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-240d12eb-c451-46ae-87f1-da2acbb22cb1 tempest-VolumeAndVolumeTypeFromImageTest-1868126148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-665419a8-3e32-4250-8058-13481f8fe6b5" returned: 0 in 0.475s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:27:52 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-240d12eb-c451-46ae-87f1-da2acbb22cb1 tempest-VolumeAndVolumeTypeFromImageTest-1868126148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-665419a8-3e32-4250-8058-13481f8fe6b5 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:27:53 devstack sudo[104641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-665419a8-3e32-4250-8058-13481f8fe6b5 Aug 29 01:27:53 devstack sudo[104641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:27:53 devstack sudo[104633]: pam_unix(sudo:session): session closed for user root Aug 29 01:27:53 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8c8ca922-75ee-477e-8006-377d155a498d tempest-VolumeImageDependencyTests-9500009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.332s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:27:53 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-8c8ca922-75ee-477e-8006-377d155a498d tempest-VolumeImageDependencyTests-9500009 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:27:53 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-8c8ca922-75ee-477e-8006-377d155a498d tempest-VolumeImageDependencyTests-9500009 None] Deleted volume successfully. Aug 29 01:27:53 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-8c8ca922-75ee-477e-8006-377d155a498d tempest-VolumeImageDependencyTests-9500009 None] Lock "cinder-7d169348-af19-443a-808c-eaa018e5553c-delete_volume" released by "delete_volume" :: held 1.367s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:27:53 devstack sudo[104641]: pam_unix(sudo:session): session closed for user root Aug 29 01:27:53 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-240d12eb-c451-46ae-87f1-da2acbb22cb1 tempest-VolumeAndVolumeTypeFromImageTest-1868126148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-665419a8-3e32-4250-8058-13481f8fe6b5" returned: 0 in 0.302s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:27:53 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-240d12eb-c451-46ae-87f1-da2acbb22cb1 tempest-VolumeAndVolumeTypeFromImageTest-1868126148 None] Lock "cinder-quobyte-665419a8-3e32-4250-8058-13481f8fe6b5" released by "delete_volume" :: held 0.819s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:27:53 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-240d12eb-c451-46ae-87f1-da2acbb22cb1 tempest-VolumeAndVolumeTypeFromImageTest-1868126148 None] Created reservations ['a2024c54-123e-49b4-a318-77f5e6ce52cf', 'ad88b112-9c6e-4eb6-a556-c4aafdb7a088', '9609edd3-f8cf-4459-b3cd-536669041fe7', '0b053ded-9725-4097-9f24-a527bf2192ee'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:27:53 devstack sudo[104637]: pam_unix(sudo:session): session closed for user root Aug 29 01:27:53 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c75e9036-dbe7-465f-b593-3d92bbc462b9 tempest-CreateVolumesFromSnapshotTest-198098050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-0e02a165-2698-4789-b3ab-61ea5fe1f374 1073741824" returned: 0 in 0.543s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:27:53 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-240d12eb-c451-46ae-87f1-da2acbb22cb1 tempest-VolumeAndVolumeTypeFromImageTest-1868126148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:27:53 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-240d12eb-c451-46ae-87f1-da2acbb22cb1 tempest-VolumeAndVolumeTypeFromImageTest-1868126148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:27:53 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-240d12eb-c451-46ae-87f1-da2acbb22cb1 tempest-VolumeAndVolumeTypeFromImageTest-1868126148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:27:53 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-240d12eb-c451-46ae-87f1-da2acbb22cb1 tempest-VolumeAndVolumeTypeFromImageTest-1868126148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:27:53 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-240d12eb-c451-46ae-87f1-da2acbb22cb1 tempest-VolumeAndVolumeTypeFromImageTest-1868126148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:27:53 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-240d12eb-c451-46ae-87f1-da2acbb22cb1 tempest-VolumeAndVolumeTypeFromImageTest-1868126148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:27:53 devstack sudo[104649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:27:53 devstack sudo[104649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:27:53 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c75e9036-dbe7-465f-b593-3d92bbc462b9 tempest-CreateVolumesFromSnapshotTest-198098050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-0e02a165-2698-4789-b3ab-61ea5fe1f374 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:27:53 devstack sudo[104651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-0e02a165-2698-4789-b3ab-61ea5fe1f374 Aug 29 01:27:53 devstack sudo[104651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:27:53 devstack sudo[104649]: pam_unix(sudo:session): session closed for user root Aug 29 01:27:53 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-240d12eb-c451-46ae-87f1-da2acbb22cb1 tempest-VolumeAndVolumeTypeFromImageTest-1868126148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.317s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:27:53 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-240d12eb-c451-46ae-87f1-da2acbb22cb1 tempest-VolumeAndVolumeTypeFromImageTest-1868126148 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:27:53 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-240d12eb-c451-46ae-87f1-da2acbb22cb1 tempest-VolumeAndVolumeTypeFromImageTest-1868126148 None] Deleted volume successfully. Aug 29 01:27:53 devstack sudo[104651]: pam_unix(sudo:session): session closed for user root Aug 29 01:27:53 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-240d12eb-c451-46ae-87f1-da2acbb22cb1 tempest-VolumeAndVolumeTypeFromImageTest-1868126148 None] Lock "cinder-665419a8-3e32-4250-8058-13481f8fe6b5-delete_volume" released by "delete_volume" :: held 1.377s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:27:53 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c75e9036-dbe7-465f-b593-3d92bbc462b9 tempest-CreateVolumesFromSnapshotTest-198098050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-0e02a165-2698-4789-b3ab-61ea5fe1f374" returned: 0 in 0.320s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:27:53 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-c75e9036-dbe7-465f-b593-3d92bbc462b9 tempest-CreateVolumesFromSnapshotTest-198098050 None] <== create_volume: return (945ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:27:53 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-c75e9036-dbe7-465f-b593-3d92bbc462b9 tempest-CreateVolumesFromSnapshotTest-198098050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.949s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:27:53 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-b6e99bbd-0e39-4e8d-b7d3-43d6f7ccc4b9 tempest-VolumeDependencyTests-162034196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 4.311s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:27:53 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-b6e99bbd-0e39-4e8d-b7d3-43d6f7ccc4b9 tempest-VolumeDependencyTests-162034196 None] Acquiring lock "cinder-quobyte-33072856-62cd-4e62-93a5-774a41b4b01d-9ecd0092-9706-4800-a369-084e9ca9071e" by "_create_volume_from_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:27:53 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-c75e9036-dbe7-465f-b593-3d92bbc462b9 tempest-CreateVolumesFromSnapshotTest-198098050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05c1c606-7540-4f1b-bfd1-fd05671457a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e02a165-2698-4789-b3ab-61ea5fe1f374', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:27:53 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-c75e9036-dbe7-465f-b593-3d92bbc462b9 tempest-CreateVolumesFromSnapshotTest-198098050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ef61591-aa16-485b-8a20-e03e9a4944fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:27:53 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-b6e99bbd-0e39-4e8d-b7d3-43d6f7ccc4b9 tempest-VolumeDependencyTests-162034196 None] Lock "cinder-quobyte-33072856-62cd-4e62-93a5-774a41b4b01d-9ecd0092-9706-4800-a369-084e9ca9071e" acquired by "_create_volume_from_snapshot" :: waited 0.058s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:27:53 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-b6e99bbd-0e39-4e8d-b7d3-43d6f7ccc4b9 tempest-VolumeDependencyTests-162034196 None] Creating volume 9ecd0092-9706-4800-a369-084e9ca9071e from snapshot 33072856-62cd-4e62-93a5-774a41b4b01d {{(pid=86111) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Aug 29 01:27:53 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-b6e99bbd-0e39-4e8d-b7d3-43d6f7ccc4b9 tempest-VolumeDependencyTests-162034196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:27:53 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-b6e99bbd-0e39-4e8d-b7d3-43d6f7ccc4b9 tempest-VolumeDependencyTests-162034196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:27:53 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-b6e99bbd-0e39-4e8d-b7d3-43d6f7ccc4b9 tempest-VolumeDependencyTests-162034196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:27:53 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-b6e99bbd-0e39-4e8d-b7d3-43d6f7ccc4b9 tempest-VolumeDependencyTests-162034196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:27:53 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-b6e99bbd-0e39-4e8d-b7d3-43d6f7ccc4b9 tempest-VolumeDependencyTests-162034196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:27:53 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-b6e99bbd-0e39-4e8d-b7d3-43d6f7ccc4b9 tempest-VolumeDependencyTests-162034196 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:27:53 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-b6e99bbd-0e39-4e8d-b7d3-43d6f7ccc4b9 tempest-VolumeDependencyTests-162034196 None] Acquiring lock "cinder-quobyte-9ecd0092-9706-4800-a369-084e9ca9071e" by "_copy_volume_from_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:27:53 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-c75e9036-dbe7-465f-b593-3d92bbc462b9 tempest-CreateVolumesFromSnapshotTest-198098050 None] Volume volume-0e02a165-2698-4789-b3ab-61ea5fe1f374 (0e02a165-2698-4789-b3ab-61ea5fe1f374): created successfully Aug 29 01:27:53 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-c75e9036-dbe7-465f-b593-3d92bbc462b9 tempest-CreateVolumesFromSnapshotTest-198098050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ef61591-aa16-485b-8a20-e03e9a4944fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:27:53 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-c75e9036-dbe7-465f-b593-3d92bbc462b9 tempest-CreateVolumesFromSnapshotTest-198098050 None] Flow 'volume_create_manager' (99446c33-f4a4-4d33-9e13-2658a30d5e2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:27:53 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-b6e99bbd-0e39-4e8d-b7d3-43d6f7ccc4b9 tempest-VolumeDependencyTests-162034196 None] Lock "cinder-quobyte-9ecd0092-9706-4800-a369-084e9ca9071e" acquired by "_copy_volume_from_snapshot" :: waited 0.030s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:27:53 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-b6e99bbd-0e39-4e8d-b7d3-43d6f7ccc4b9 tempest-VolumeDependencyTests-162034196 None] snapshot: 33072856-62cd-4e62-93a5-774a41b4b01d, volume: 9ecd0092-9706-4800-a369-084e9ca9071e, {{(pid=86111) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 29 01:27:53 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-c75e9036-dbe7-465f-b593-3d92bbc462b9 tempest-CreateVolumesFromSnapshotTest-198098050 None] Created volume successfully. Aug 29 01:27:53 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-b6e99bbd-0e39-4e8d-b7d3-43d6f7ccc4b9 tempest-VolumeDependencyTests-162034196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:27:53 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-b6e99bbd-0e39-4e8d-b7d3-43d6f7ccc4b9 tempest-VolumeDependencyTests-162034196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:27:53 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-b6e99bbd-0e39-4e8d-b7d3-43d6f7ccc4b9 tempest-VolumeDependencyTests-162034196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:27:53 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-b6e99bbd-0e39-4e8d-b7d3-43d6f7ccc4b9 tempest-VolumeDependencyTests-162034196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:27:53 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-b6e99bbd-0e39-4e8d-b7d3-43d6f7ccc4b9 tempest-VolumeDependencyTests-162034196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:27:53 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[b52172b1-22dd-4ff3-9a61-2cac5e23c305]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:27:53 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-b6e99bbd-0e39-4e8d-b7d3-43d6f7ccc4b9 tempest-VolumeDependencyTests-162034196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-fdac5d05-f835-43b4-ab10-91657b676a76.33072856-62cd-4e62-93a5-774a41b4b01d {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:27:54 devstack sudo[104655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-fdac5d05-f835-43b4-ab10-91657b676a76.33072856-62cd-4e62-93a5-774a41b4b01d Aug 29 01:27:54 devstack sudo[104655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:27:54 devstack sudo[104655]: pam_unix(sudo:session): session closed for user root Aug 29 01:27:54 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-b6e99bbd-0e39-4e8d-b7d3-43d6f7ccc4b9 tempest-VolumeDependencyTests-162034196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-fdac5d05-f835-43b4-ab10-91657b676a76.33072856-62cd-4e62-93a5-774a41b4b01d" returned: 0 in 0.404s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:27:54 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-b6e99bbd-0e39-4e8d-b7d3-43d6f7ccc4b9 tempest-VolumeDependencyTests-162034196 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fdac5d05-f835-43b4-ab10-91657b676a76(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 29 01:27:54 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d97cb27-ea2b-4222-81ac-95d6a1bdf801]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:27:54 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-b6e99bbd-0e39-4e8d-b7d3-43d6f7ccc4b9 tempest-VolumeDependencyTests-162034196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-fdac5d05-f835-43b4-ab10-91657b676a76 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:27:54 devstack sudo[104661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-fdac5d05-f835-43b4-ab10-91657b676a76 Aug 29 01:27:54 devstack sudo[104661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:27:54 devstack sudo[104661]: pam_unix(sudo:session): session closed for user root Aug 29 01:27:54 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-b6e99bbd-0e39-4e8d-b7d3-43d6f7ccc4b9 tempest-VolumeDependencyTests-162034196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-fdac5d05-f835-43b4-ab10-91657b676a76" returned: 0 in 0.458s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:27:54 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-b6e99bbd-0e39-4e8d-b7d3-43d6f7ccc4b9 tempest-VolumeDependencyTests-162034196 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-fdac5d05-f835-43b4-ab10-91657b676a76 {{(pid=86111) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 29 01:27:54 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-b6e99bbd-0e39-4e8d-b7d3-43d6f7ccc4b9 tempest-VolumeDependencyTests-162034196 None] Creating direct copy from snapshot {{(pid=86111) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 29 01:27:54 devstack cinder-volume[86111]: DEBUG cinder.utils [None req-b6e99bbd-0e39-4e8d-b7d3-43d6f7ccc4b9 tempest-VolumeDependencyTests-162034196 None] Path /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-9ecd0092-9706-4800-a369-084e9ca9071e not found in is_blk_device check {{(pid=86111) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 29 01:27:54 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-b6e99bbd-0e39-4e8d-b7d3-43d6f7ccc4b9 tempest-VolumeDependencyTests-162034196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-fdac5d05-f835-43b4-ab10-91657b676a76 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-9ecd0092-9706-4800-a369-084e9ca9071e {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:27:54 devstack sudo[104666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-fdac5d05-f835-43b4-ab10-91657b676a76 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-9ecd0092-9706-4800-a369-084e9ca9071e Aug 29 01:27:54 devstack sudo[104666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:27:55 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-7b1c89e2-43df-4ce7-8698-25391fb02d68 tempest-CreateVolumesFromSnapshotTest-198098050 None] Acquiring lock "cinder-0e02a165-2698-4789-b3ab-61ea5fe1f374-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:27:55 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-7b1c89e2-43df-4ce7-8698-25391fb02d68 tempest-CreateVolumesFromSnapshotTest-198098050 None] Lock "cinder-0e02a165-2698-4789-b3ab-61ea5fe1f374-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:27:55 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-7b1c89e2-43df-4ce7-8698-25391fb02d68 tempest-CreateVolumesFromSnapshotTest-198098050 None] Acquiring lock "cinder-quobyte-0e02a165-2698-4789-b3ab-61ea5fe1f374" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:27:55 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-7b1c89e2-43df-4ce7-8698-25391fb02d68 tempest-CreateVolumesFromSnapshotTest-198098050 None] Lock "cinder-quobyte-0e02a165-2698-4789-b3ab-61ea5fe1f374" acquired by "delete_volume" :: waited 0.021s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:27:55 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[30f2f55c-0eec-4742-9f12-980d2c736780]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:27:55 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-7b1c89e2-43df-4ce7-8698-25391fb02d68 tempest-CreateVolumesFromSnapshotTest-198098050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-0e02a165-2698-4789-b3ab-61ea5fe1f374 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:27:55 devstack sudo[104671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-0e02a165-2698-4789-b3ab-61ea5fe1f374 Aug 29 01:27:55 devstack sudo[104671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:27:55 devstack sudo[104671]: pam_unix(sudo:session): session closed for user root Aug 29 01:27:55 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-7b1c89e2-43df-4ce7-8698-25391fb02d68 tempest-CreateVolumesFromSnapshotTest-198098050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-0e02a165-2698-4789-b3ab-61ea5fe1f374" returned: 0 in 0.694s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:27:55 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-7b1c89e2-43df-4ce7-8698-25391fb02d68 tempest-CreateVolumesFromSnapshotTest-198098050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-0e02a165-2698-4789-b3ab-61ea5fe1f374 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:27:56 devstack sudo[104683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-0e02a165-2698-4789-b3ab-61ea5fe1f374 Aug 29 01:27:56 devstack sudo[104683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:27:56 devstack sudo[104683]: pam_unix(sudo:session): session closed for user root Aug 29 01:27:56 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-7b1c89e2-43df-4ce7-8698-25391fb02d68 tempest-CreateVolumesFromSnapshotTest-198098050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-0e02a165-2698-4789-b3ab-61ea5fe1f374" returned: 0 in 0.743s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:27:56 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-7b1c89e2-43df-4ce7-8698-25391fb02d68 tempest-CreateVolumesFromSnapshotTest-198098050 None] Lock "cinder-quobyte-0e02a165-2698-4789-b3ab-61ea5fe1f374" released by "delete_volume" :: held 1.535s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:27:56 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-7b1c89e2-43df-4ce7-8698-25391fb02d68 tempest-CreateVolumesFromSnapshotTest-198098050 None] Created reservations ['8cacc06c-4c7b-4272-8a36-44640e0fe113', '48aa0c18-16e1-490e-8e3a-75fcbf507bc1', 'c83f690f-529d-4d5b-b39b-455069ed5878', 'ab0afa12-1e56-496d-84a6-c7501910108e'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:27:57 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-7b1c89e2-43df-4ce7-8698-25391fb02d68 tempest-CreateVolumesFromSnapshotTest-198098050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:27:57 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-7b1c89e2-43df-4ce7-8698-25391fb02d68 tempest-CreateVolumesFromSnapshotTest-198098050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:27:57 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-7b1c89e2-43df-4ce7-8698-25391fb02d68 tempest-CreateVolumesFromSnapshotTest-198098050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:27:57 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-7b1c89e2-43df-4ce7-8698-25391fb02d68 tempest-CreateVolumesFromSnapshotTest-198098050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:27:57 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-7b1c89e2-43df-4ce7-8698-25391fb02d68 tempest-CreateVolumesFromSnapshotTest-198098050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:27:57 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-7b1c89e2-43df-4ce7-8698-25391fb02d68 tempest-CreateVolumesFromSnapshotTest-198098050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:27:57 devstack sudo[104687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:27:57 devstack sudo[104687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:27:57 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-9f5d29f9-45cc-4159-9f83-13123da59c63 tempest-CreateVolumesFromSnapshotTest-198098050 None] Acquiring lock "cinder-981c6152-3e78-409d-8aaf-5c7d1e987354-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:27:57 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-9f5d29f9-45cc-4159-9f83-13123da59c63 tempest-CreateVolumesFromSnapshotTest-198098050 None] Lock "cinder-981c6152-3e78-409d-8aaf-5c7d1e987354-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:27:58 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-9f5d29f9-45cc-4159-9f83-13123da59c63 tempest-CreateVolumesFromSnapshotTest-198098050 None] Acquiring lock "cinder-quobyte-981c6152-3e78-409d-8aaf-5c7d1e987354" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:27:58 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-9f5d29f9-45cc-4159-9f83-13123da59c63 tempest-CreateVolumesFromSnapshotTest-198098050 None] Lock "cinder-quobyte-981c6152-3e78-409d-8aaf-5c7d1e987354" acquired by "delete_volume" :: waited 0.048s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:27:58 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[91100b2e-cb9c-44bb-b54a-87efef00f0ce]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:27:58 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-9f5d29f9-45cc-4159-9f83-13123da59c63 tempest-CreateVolumesFromSnapshotTest-198098050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-981c6152-3e78-409d-8aaf-5c7d1e987354 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:27:58 devstack sudo[104687]: pam_unix(sudo:session): session closed for user root Aug 29 01:27:58 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-7b1c89e2-43df-4ce7-8698-25391fb02d68 tempest-CreateVolumesFromSnapshotTest-198098050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.840s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:27:58 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-7b1c89e2-43df-4ce7-8698-25391fb02d68 tempest-CreateVolumesFromSnapshotTest-198098050 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:27:58 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-7b1c89e2-43df-4ce7-8698-25391fb02d68 tempest-CreateVolumesFromSnapshotTest-198098050 None] Deleted volume successfully. Aug 29 01:27:58 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-7b1c89e2-43df-4ce7-8698-25391fb02d68 tempest-CreateVolumesFromSnapshotTest-198098050 None] Lock "cinder-0e02a165-2698-4789-b3ab-61ea5fe1f374-delete_volume" released by "delete_volume" :: held 3.246s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:27:58 devstack sudo[104690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-981c6152-3e78-409d-8aaf-5c7d1e987354 Aug 29 01:27:58 devstack sudo[104690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:27:58 devstack sudo[104690]: pam_unix(sudo:session): session closed for user root Aug 29 01:27:58 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-9f5d29f9-45cc-4159-9f83-13123da59c63 tempest-CreateVolumesFromSnapshotTest-198098050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-981c6152-3e78-409d-8aaf-5c7d1e987354" returned: 0 in 0.845s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:27:58 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-9f5d29f9-45cc-4159-9f83-13123da59c63 tempest-CreateVolumesFromSnapshotTest-198098050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-981c6152-3e78-409d-8aaf-5c7d1e987354 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:27:59 devstack sudo[104696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-981c6152-3e78-409d-8aaf-5c7d1e987354 Aug 29 01:27:59 devstack sudo[104696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:27:59 devstack sudo[104696]: pam_unix(sudo:session): session closed for user root Aug 29 01:27:59 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-9f5d29f9-45cc-4159-9f83-13123da59c63 tempest-CreateVolumesFromSnapshotTest-198098050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-981c6152-3e78-409d-8aaf-5c7d1e987354" returned: 0 in 0.615s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:27:59 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-9f5d29f9-45cc-4159-9f83-13123da59c63 tempest-CreateVolumesFromSnapshotTest-198098050 None] Lock "cinder-quobyte-981c6152-3e78-409d-8aaf-5c7d1e987354" released by "delete_volume" :: held 1.564s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:27:59 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-9f5d29f9-45cc-4159-9f83-13123da59c63 tempest-CreateVolumesFromSnapshotTest-198098050 None] Created reservations ['ce7e5911-a84b-4bb7-965c-8ff715681035', '46b325a0-ab49-405f-bf3d-4ffacf69473c', '4211a1c0-b699-4d6d-8f5c-dff867d42e9a', '0183ec9f-582b-49ef-af25-a053eaafc80d'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:27:59 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-9f5d29f9-45cc-4159-9f83-13123da59c63 tempest-CreateVolumesFromSnapshotTest-198098050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:27:59 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-9f5d29f9-45cc-4159-9f83-13123da59c63 tempest-CreateVolumesFromSnapshotTest-198098050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:27:59 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-9f5d29f9-45cc-4159-9f83-13123da59c63 tempest-CreateVolumesFromSnapshotTest-198098050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:27:59 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-9f5d29f9-45cc-4159-9f83-13123da59c63 tempest-CreateVolumesFromSnapshotTest-198098050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:27:59 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-9f5d29f9-45cc-4159-9f83-13123da59c63 tempest-CreateVolumesFromSnapshotTest-198098050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:27:59 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-9f5d29f9-45cc-4159-9f83-13123da59c63 tempest-CreateVolumesFromSnapshotTest-198098050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:00 devstack sudo[104700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:28:00 devstack sudo[104700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:00 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-68ec6d18-fbae-45eb-825e-787a1f59a5d1 tempest-CreateVolumesFromSnapshotTest-198098050 None] Acquiring lock "cinder-2883b684-1e43-4f62-9a37-7a8b7c3ca3ad-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:28:00 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-68ec6d18-fbae-45eb-825e-787a1f59a5d1 tempest-CreateVolumesFromSnapshotTest-198098050 None] Lock "cinder-2883b684-1e43-4f62-9a37-7a8b7c3ca3ad-delete_volume" acquired by "delete_volume" :: waited 0.084s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:28:00 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-68ec6d18-fbae-45eb-825e-787a1f59a5d1 tempest-CreateVolumesFromSnapshotTest-198098050 None] Acquiring lock "cinder-quobyte-2883b684-1e43-4f62-9a37-7a8b7c3ca3ad" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:28:00 devstack sudo[104700]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:00 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-9f5d29f9-45cc-4159-9f83-13123da59c63 tempest-CreateVolumesFromSnapshotTest-198098050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.736s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:00 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-9f5d29f9-45cc-4159-9f83-13123da59c63 tempest-CreateVolumesFromSnapshotTest-198098050 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:28:00 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-68ec6d18-fbae-45eb-825e-787a1f59a5d1 tempest-CreateVolumesFromSnapshotTest-198098050 None] Lock "cinder-quobyte-2883b684-1e43-4f62-9a37-7a8b7c3ca3ad" acquired by "delete_volume" :: waited 0.037s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:28:00 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-9f5d29f9-45cc-4159-9f83-13123da59c63 tempest-CreateVolumesFromSnapshotTest-198098050 None] Deleted volume successfully. Aug 29 01:28:00 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2001341-2ceb-412b-ba9c-55649a9acc56]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:28:00 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-68ec6d18-fbae-45eb-825e-787a1f59a5d1 tempest-CreateVolumesFromSnapshotTest-198098050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-2883b684-1e43-4f62-9a37-7a8b7c3ca3ad {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:00 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-9f5d29f9-45cc-4159-9f83-13123da59c63 tempest-CreateVolumesFromSnapshotTest-198098050 None] Lock "cinder-981c6152-3e78-409d-8aaf-5c7d1e987354-delete_volume" released by "delete_volume" :: held 2.963s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:28:00 devstack sudo[104703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-2883b684-1e43-4f62-9a37-7a8b7c3ca3ad Aug 29 01:28:00 devstack sudo[104703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:01 devstack sudo[104666]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:01 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-b6e99bbd-0e39-4e8d-b7d3-43d6f7ccc4b9 tempest-VolumeDependencyTests-162034196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-fdac5d05-f835-43b4-ab10-91657b676a76 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-9ecd0092-9706-4800-a369-084e9ca9071e" returned: 0 in 6.565s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:01 devstack cinder-volume[86111]: DEBUG cinder.image.image_utils [None req-b6e99bbd-0e39-4e8d-b7d3-43d6f7ccc4b9 tempest-VolumeDependencyTests-162034196 None] Image conversion details: src /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-fdac5d05-f835-43b4-ab10-91657b676a76, size 1024.00 MB, duration 6.57 sec, destination /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-9ecd0092-9706-4800-a369-084e9ca9071e {{(pid=86111) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 29 01:28:01 devstack cinder-volume[86111]: INFO cinder.image.image_utils [None req-b6e99bbd-0e39-4e8d-b7d3-43d6f7ccc4b9 tempest-VolumeDependencyTests-162034196 None] Converted 1024.00 MB image at 155.96 MB/s Aug 29 01:28:01 devstack cinder-volume[86111]: WARNING cinder.volume.drivers.remotefs [None req-b6e99bbd-0e39-4e8d-b7d3-43d6f7ccc4b9 tempest-VolumeDependencyTests-162034196 None] /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-9ecd0092-9706-4800-a369-084e9ca9071e is being set with open permissions: ugo+rw Aug 29 01:28:01 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-b6e99bbd-0e39-4e8d-b7d3-43d6f7ccc4b9 tempest-VolumeDependencyTests-162034196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-9ecd0092-9706-4800-a369-084e9ca9071e {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:01 devstack sudo[104709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-9ecd0092-9706-4800-a369-084e9ca9071e Aug 29 01:28:01 devstack sudo[104709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:01 devstack sudo[104703]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:01 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-68ec6d18-fbae-45eb-825e-787a1f59a5d1 tempest-CreateVolumesFromSnapshotTest-198098050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-2883b684-1e43-4f62-9a37-7a8b7c3ca3ad" returned: 0 in 0.710s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:01 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-68ec6d18-fbae-45eb-825e-787a1f59a5d1 tempest-CreateVolumesFromSnapshotTest-198098050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-2883b684-1e43-4f62-9a37-7a8b7c3ca3ad {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:01 devstack sudo[104711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-2883b684-1e43-4f62-9a37-7a8b7c3ca3ad Aug 29 01:28:01 devstack sudo[104711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:01 devstack sudo[104709]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:01 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-b6e99bbd-0e39-4e8d-b7d3-43d6f7ccc4b9 tempest-VolumeDependencyTests-162034196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-9ecd0092-9706-4800-a369-084e9ca9071e" returned: 0 in 0.294s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:01 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-b6e99bbd-0e39-4e8d-b7d3-43d6f7ccc4b9 tempest-VolumeDependencyTests-162034196 None] Lock "cinder-quobyte-9ecd0092-9706-4800-a369-084e9ca9071e" released by "_copy_volume_from_snapshot" :: held 7.830s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:28:01 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-b6e99bbd-0e39-4e8d-b7d3-43d6f7ccc4b9 tempest-VolumeDependencyTests-162034196 None] Lock "cinder-quobyte-33072856-62cd-4e62-93a5-774a41b4b01d-9ecd0092-9706-4800-a369-084e9ca9071e" released by "_create_volume_from_snapshot" :: held 7.926s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:28:01 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-b6e99bbd-0e39-4e8d-b7d3-43d6f7ccc4b9 tempest-VolumeDependencyTests-162034196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.986s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:28:01 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-b6e99bbd-0e39-4e8d-b7d3-43d6f7ccc4b9 tempest-VolumeDependencyTests-162034196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92cd7836-fb68-4739-af80-ddba7b245703) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ecd0092-9706-4800-a369-084e9ca9071e', 'volume_size': 1, 'snapshot_id': '33072856-62cd-4e62-93a5-774a41b4b01d'}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:28:01 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-b6e99bbd-0e39-4e8d-b7d3-43d6f7ccc4b9 tempest-VolumeDependencyTests-162034196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25741e8c-9d4b-4270-bf4e-eb200857a874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:28:01 devstack sudo[104711]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:01 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-b6e99bbd-0e39-4e8d-b7d3-43d6f7ccc4b9 tempest-VolumeDependencyTests-162034196 None] Volume volume-9ecd0092-9706-4800-a369-084e9ca9071e (9ecd0092-9706-4800-a369-084e9ca9071e): created successfully Aug 29 01:28:01 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-b6e99bbd-0e39-4e8d-b7d3-43d6f7ccc4b9 tempest-VolumeDependencyTests-162034196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25741e8c-9d4b-4270-bf4e-eb200857a874) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:28:01 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-b6e99bbd-0e39-4e8d-b7d3-43d6f7ccc4b9 tempest-VolumeDependencyTests-162034196 None] Flow 'volume_create_manager' (6bf8a2fe-6b75-46c7-a53d-775f05e766d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:28:01 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-68ec6d18-fbae-45eb-825e-787a1f59a5d1 tempest-CreateVolumesFromSnapshotTest-198098050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-2883b684-1e43-4f62-9a37-7a8b7c3ca3ad" returned: 0 in 0.369s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:01 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-68ec6d18-fbae-45eb-825e-787a1f59a5d1 tempest-CreateVolumesFromSnapshotTest-198098050 None] Lock "cinder-quobyte-2883b684-1e43-4f62-9a37-7a8b7c3ca3ad" released by "delete_volume" :: held 1.177s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:28:01 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-b6e99bbd-0e39-4e8d-b7d3-43d6f7ccc4b9 tempest-VolumeDependencyTests-162034196 None] Created volume successfully. Aug 29 01:28:01 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-68ec6d18-fbae-45eb-825e-787a1f59a5d1 tempest-CreateVolumesFromSnapshotTest-198098050 None] Created reservations ['5768ca97-4ec6-45f6-8911-9d4bd6b89784', '29ab8112-a24a-4d41-82bb-7327d42519f6', '51b9f56c-236a-4793-aa36-dc88c32230dc', 'f6248ae6-2d72-4cb6-99b5-0460538e14bb'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:28:02 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-68ec6d18-fbae-45eb-825e-787a1f59a5d1 tempest-CreateVolumesFromSnapshotTest-198098050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:28:02 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-68ec6d18-fbae-45eb-825e-787a1f59a5d1 tempest-CreateVolumesFromSnapshotTest-198098050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:28:02 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-68ec6d18-fbae-45eb-825e-787a1f59a5d1 tempest-CreateVolumesFromSnapshotTest-198098050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:28:02 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-68ec6d18-fbae-45eb-825e-787a1f59a5d1 tempest-CreateVolumesFromSnapshotTest-198098050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:28:02 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-68ec6d18-fbae-45eb-825e-787a1f59a5d1 tempest-CreateVolumesFromSnapshotTest-198098050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:28:02 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-68ec6d18-fbae-45eb-825e-787a1f59a5d1 tempest-CreateVolumesFromSnapshotTest-198098050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:02 devstack sudo[104715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:28:02 devstack sudo[104715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:02 devstack sudo[104715]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:02 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-68ec6d18-fbae-45eb-825e-787a1f59a5d1 tempest-CreateVolumesFromSnapshotTest-198098050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.253s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:02 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-68ec6d18-fbae-45eb-825e-787a1f59a5d1 tempest-CreateVolumesFromSnapshotTest-198098050 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:28:02 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-68ec6d18-fbae-45eb-825e-787a1f59a5d1 tempest-CreateVolumesFromSnapshotTest-198098050 None] Deleted volume successfully. Aug 29 01:28:02 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-68ec6d18-fbae-45eb-825e-787a1f59a5d1 tempest-CreateVolumesFromSnapshotTest-198098050 None] Lock "cinder-2883b684-1e43-4f62-9a37-7a8b7c3ca3ad-delete_volume" released by "delete_volume" :: held 1.785s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:28:02 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-1bd483a3-c9d0-4e74-8b5b-1c91e7ecf9ea tempest-CreateVolumesFromImageTest-1798281502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:28:02 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-1bd483a3-c9d0-4e74-8b5b-1c91e7ecf9ea tempest-CreateVolumesFromImageTest-1798281502 None] Flow 'volume_create_manager' (f9bda797-c7fa-421d-b15c-ac484f2b2719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:28:02 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-1bd483a3-c9d0-4e74-8b5b-1c91e7ecf9ea tempest-CreateVolumesFromImageTest-1798281502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62828f02-f9a8-464d-8590-28fd1abd952a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:28:02 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-1bd483a3-c9d0-4e74-8b5b-1c91e7ecf9ea tempest-CreateVolumesFromImageTest-1798281502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62828f02-f9a8-464d-8590-28fd1abd952a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:28:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-563677581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f486edac-6ea8-409f-854a-37aec731e5ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad99a6f732b64fe0a9e82257c656a980',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:28:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:28:02Z,use_quota=True,user_id='d6e3bbb4c12e431a9bfecec1b69e1794',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:28:02 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-1bd483a3-c9d0-4e74-8b5b-1c91e7ecf9ea tempest-CreateVolumesFromImageTest-1798281502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bac07a1-d4cf-4d9b-b4bf-2334ac71f152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:28:02 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-1bd483a3-c9d0-4e74-8b5b-1c91e7ecf9ea tempest-CreateVolumesFromImageTest-1798281502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bac07a1-d4cf-4d9b-b4bf-2334ac71f152) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:28:02 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-1bd483a3-c9d0-4e74-8b5b-1c91e7ecf9ea tempest-CreateVolumesFromImageTest-1798281502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4478f39c-4f87-4739-958b-2292f9405c81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:28:02 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-1bd483a3-c9d0-4e74-8b5b-1c91e7ecf9ea tempest-CreateVolumesFromImageTest-1798281502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4478f39c-4f87-4739-958b-2292f9405c81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f486edac-6ea8-409f-854a-37aec731e5ac', 'volume_name': 'volume-f486edac-6ea8-409f-854a-37aec731e5ac', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:28:02 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-1bd483a3-c9d0-4e74-8b5b-1c91e7ecf9ea tempest-CreateVolumesFromImageTest-1798281502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb7dd563-9302-4c9f-a0eb-1a96e15bc14e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:28:02 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-1bd483a3-c9d0-4e74-8b5b-1c91e7ecf9ea tempest-CreateVolumesFromImageTest-1798281502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb7dd563-9302-4c9f-a0eb-1a96e15bc14e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:28:02 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-1bd483a3-c9d0-4e74-8b5b-1c91e7ecf9ea tempest-CreateVolumesFromImageTest-1798281502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d22e858c-a74b-4c57-b488-32b91c89f28d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:28:02 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-1bd483a3-c9d0-4e74-8b5b-1c91e7ecf9ea tempest-CreateVolumesFromImageTest-1798281502 None] Volume f486edac-6ea8-409f-854a-37aec731e5ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f486edac-6ea8-409f-854a-37aec731e5ac', 'volume_size': 1} Aug 29 01:28:02 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-1bd483a3-c9d0-4e74-8b5b-1c91e7ecf9ea tempest-CreateVolumesFromImageTest-1798281502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:28:02 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-1bd483a3-c9d0-4e74-8b5b-1c91e7ecf9ea tempest-CreateVolumesFromImageTest-1798281502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:28:02 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-1bd483a3-c9d0-4e74-8b5b-1c91e7ecf9ea tempest-CreateVolumesFromImageTest-1798281502 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:28:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-563677581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f486edac-6ea8-409f-854a-37aec731e5ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad99a6f732b64fe0a9e82257c656a980',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:28:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:28:02Z,use_quota=True,user_id='d6e3bbb4c12e431a9bfecec1b69e1794',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:28:02 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-1bd483a3-c9d0-4e74-8b5b-1c91e7ecf9ea tempest-CreateVolumesFromImageTest-1798281502 None] Creating volume f486edac-6ea8-409f-854a-37aec731e5ac {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:28:02 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-1bd483a3-c9d0-4e74-8b5b-1c91e7ecf9ea tempest-CreateVolumesFromImageTest-1798281502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:28:02 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-1bd483a3-c9d0-4e74-8b5b-1c91e7ecf9ea tempest-CreateVolumesFromImageTest-1798281502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:28:02 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-1bd483a3-c9d0-4e74-8b5b-1c91e7ecf9ea tempest-CreateVolumesFromImageTest-1798281502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:28:02 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-1bd483a3-c9d0-4e74-8b5b-1c91e7ecf9ea tempest-CreateVolumesFromImageTest-1798281502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:28:02 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-1bd483a3-c9d0-4e74-8b5b-1c91e7ecf9ea tempest-CreateVolumesFromImageTest-1798281502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:28:02 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-1bd483a3-c9d0-4e74-8b5b-1c91e7ecf9ea tempest-CreateVolumesFromImageTest-1798281502 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:28:02 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-1bd483a3-c9d0-4e74-8b5b-1c91e7ecf9ea tempest-CreateVolumesFromImageTest-1798281502 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:28:02 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-1bd483a3-c9d0-4e74-8b5b-1c91e7ecf9ea tempest-CreateVolumesFromImageTest-1798281502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-f486edac-6ea8-409f-854a-37aec731e5ac 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:02 devstack sudo[104718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-f486edac-6ea8-409f-854a-37aec731e5ac 1073741824 Aug 29 01:28:02 devstack sudo[104718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:02 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-6d8ec528-216f-4ac1-b258-0b9780c1fa42 tempest-VolumeDependencyTests-162034196 None] Acquiring lock "cinder-33072856-62cd-4e62-93a5-774a41b4b01d-delete_snapshot" by "delete_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:28:02 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-6d8ec528-216f-4ac1-b258-0b9780c1fa42 tempest-VolumeDependencyTests-162034196 None] Lock "cinder-33072856-62cd-4e62-93a5-774a41b4b01d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.049s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:28:02 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-6d8ec528-216f-4ac1-b258-0b9780c1fa42 tempest-VolumeDependencyTests-162034196 None] Acquiring lock "cinder-quobyte-fdac5d05-f835-43b4-ab10-91657b676a76" by "delete_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:28:02 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-6d8ec528-216f-4ac1-b258-0b9780c1fa42 tempest-VolumeDependencyTests-162034196 None] Lock "cinder-quobyte-fdac5d05-f835-43b4-ab10-91657b676a76" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:28:02 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-6d8ec528-216f-4ac1-b258-0b9780c1fa42 tempest-VolumeDependencyTests-162034196 None] Acquiring lock "cinder-quobyte-33072856-62cd-4e62-93a5-774a41b4b01d" by "_delete_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:28:02 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-bec4ac4a-d0b4-4d0c-a3cf-7b082650cabc tempest-CreateVolumesFromSnapshotTest-198098050 None] Acquiring lock "cinder-48c7cd73-3eb9-41c9-9726-4e33673bc688-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:28:03 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-6d8ec528-216f-4ac1-b258-0b9780c1fa42 tempest-VolumeDependencyTests-162034196 None] Lock "cinder-quobyte-33072856-62cd-4e62-93a5-774a41b4b01d" acquired by "_delete_snapshot" :: waited 0.048s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:28:03 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-6d8ec528-216f-4ac1-b258-0b9780c1fa42 tempest-VolumeDependencyTests-162034196 None] Deleting offline snapshot 33072856-62cd-4e62-93a5-774a41b4b01d of volume fdac5d05-f835-43b4-ab10-91657b676a76 {{(pid=86111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 29 01:28:03 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-6d8ec528-216f-4ac1-b258-0b9780c1fa42 tempest-VolumeDependencyTests-162034196 None] snapshot_file for this snap is: volume-fdac5d05-f835-43b4-ab10-91657b676a76.33072856-62cd-4e62-93a5-774a41b4b01d {{(pid=86111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 29 01:28:03 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-bec4ac4a-d0b4-4d0c-a3cf-7b082650cabc tempest-CreateVolumesFromSnapshotTest-198098050 None] Lock "cinder-48c7cd73-3eb9-41c9-9726-4e33673bc688-delete_volume" acquired by "delete_volume" :: waited 0.095s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:28:03 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[986e0f7f-e65a-44e6-9367-d5da15aa8ec4]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:28:03 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-6d8ec528-216f-4ac1-b258-0b9780c1fa42 tempest-VolumeDependencyTests-162034196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-fdac5d05-f835-43b4-ab10-91657b676a76.33072856-62cd-4e62-93a5-774a41b4b01d {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:03 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-70487789-59dc-4ad5-be8b-79762d76f0c2 tempest-CreateVolumesFromImageTest-1798281502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:28:03 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-70487789-59dc-4ad5-be8b-79762d76f0c2 tempest-CreateVolumesFromImageTest-1798281502 None] Flow 'volume_create_manager' (99d4b0f0-9749-405e-b0b1-40bebb3566d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:28:03 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-70487789-59dc-4ad5-be8b-79762d76f0c2 tempest-CreateVolumesFromImageTest-1798281502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6ccf814-4fc3-4d23-992e-54f36b309e71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:28:03 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-bec4ac4a-d0b4-4d0c-a3cf-7b082650cabc tempest-CreateVolumesFromSnapshotTest-198098050 None] Acquiring lock "cinder-quobyte-48c7cd73-3eb9-41c9-9726-4e33673bc688" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:28:03 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-70487789-59dc-4ad5-be8b-79762d76f0c2 tempest-CreateVolumesFromImageTest-1798281502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6ccf814-4fc3-4d23-992e-54f36b309e71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:28:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1440583575',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f4a41ce-b6ce-42bd-953e-1f4aa8ee6e79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad99a6f732b64fe0a9e82257c656a980',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:28:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:28:03Z,use_quota=True,user_id='d6e3bbb4c12e431a9bfecec1b69e1794',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:28:03 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-70487789-59dc-4ad5-be8b-79762d76f0c2 tempest-CreateVolumesFromImageTest-1798281502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9693c24-5396-4b4a-90e5-693287e840fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:28:03 devstack sudo[104723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-fdac5d05-f835-43b4-ab10-91657b676a76.33072856-62cd-4e62-93a5-774a41b4b01d Aug 29 01:28:03 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-70487789-59dc-4ad5-be8b-79762d76f0c2 tempest-CreateVolumesFromImageTest-1798281502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9693c24-5396-4b4a-90e5-693287e840fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:28:03 devstack sudo[104723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:03 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-70487789-59dc-4ad5-be8b-79762d76f0c2 tempest-CreateVolumesFromImageTest-1798281502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c580e0c-a389-498e-8c6b-4c23c88aa601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:28:03 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-70487789-59dc-4ad5-be8b-79762d76f0c2 tempest-CreateVolumesFromImageTest-1798281502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c580e0c-a389-498e-8c6b-4c23c88aa601) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f4a41ce-b6ce-42bd-953e-1f4aa8ee6e79', 'volume_name': 'volume-5f4a41ce-b6ce-42bd-953e-1f4aa8ee6e79', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:28:03 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-70487789-59dc-4ad5-be8b-79762d76f0c2 tempest-CreateVolumesFromImageTest-1798281502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (196af9da-5f2c-4ac7-b90b-d34194ea08cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:28:03 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-70487789-59dc-4ad5-be8b-79762d76f0c2 tempest-CreateVolumesFromImageTest-1798281502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (196af9da-5f2c-4ac7-b90b-d34194ea08cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:28:03 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-70487789-59dc-4ad5-be8b-79762d76f0c2 tempest-CreateVolumesFromImageTest-1798281502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0e448f4-7148-4dd8-ac2f-f2cc2c89d914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:28:03 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-70487789-59dc-4ad5-be8b-79762d76f0c2 tempest-CreateVolumesFromImageTest-1798281502 None] Volume 5f4a41ce-b6ce-42bd-953e-1f4aa8ee6e79: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f4a41ce-b6ce-42bd-953e-1f4aa8ee6e79', 'volume_size': 1} Aug 29 01:28:03 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-70487789-59dc-4ad5-be8b-79762d76f0c2 tempest-CreateVolumesFromImageTest-1798281502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:28:03 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-bec4ac4a-d0b4-4d0c-a3cf-7b082650cabc tempest-CreateVolumesFromSnapshotTest-198098050 None] Lock "cinder-quobyte-48c7cd73-3eb9-41c9-9726-4e33673bc688" acquired by "delete_volume" :: waited 0.128s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:28:03 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[f460253b-c108-46d4-9f5e-e0cde1b69e31]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:28:03 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-bec4ac4a-d0b4-4d0c-a3cf-7b082650cabc tempest-CreateVolumesFromSnapshotTest-198098050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-48c7cd73-3eb9-41c9-9726-4e33673bc688 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:03 devstack sudo[104718]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:03 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-1bd483a3-c9d0-4e74-8b5b-1c91e7ecf9ea tempest-CreateVolumesFromImageTest-1798281502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-f486edac-6ea8-409f-854a-37aec731e5ac 1073741824" returned: 0 in 0.823s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:03 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b64f7d2-4ada-4dba-9874-c261aeea7959 tempest-CreateVolumesFromImageTest-1798281502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:28:03 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-2b64f7d2-4ada-4dba-9874-c261aeea7959 tempest-CreateVolumesFromImageTest-1798281502 None] Flow 'volume_create_manager' (595868b6-ef13-46a4-8fee-f537aeef30a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:28:03 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-2b64f7d2-4ada-4dba-9874-c261aeea7959 tempest-CreateVolumesFromImageTest-1798281502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71ce689a-0825-4535-b2a9-e203dd0999b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:28:03 devstack sudo[104726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-48c7cd73-3eb9-41c9-9726-4e33673bc688 Aug 29 01:28:03 devstack sudo[104726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:03 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-2b64f7d2-4ada-4dba-9874-c261aeea7959 tempest-CreateVolumesFromImageTest-1798281502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71ce689a-0825-4535-b2a9-e203dd0999b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:28:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-934025735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=713a362b-338f-4f21-a61c-096746c27a43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad99a6f732b64fe0a9e82257c656a980',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:28:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:28:03Z,use_quota=True,user_id='d6e3bbb4c12e431a9bfecec1b69e1794',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:28:03 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-2b64f7d2-4ada-4dba-9874-c261aeea7959 tempest-CreateVolumesFromImageTest-1798281502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f864003d-a125-49cb-9933-e6eb6fde9410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:28:03 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-2b64f7d2-4ada-4dba-9874-c261aeea7959 tempest-CreateVolumesFromImageTest-1798281502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f864003d-a125-49cb-9933-e6eb6fde9410) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:28:03 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-2b64f7d2-4ada-4dba-9874-c261aeea7959 tempest-CreateVolumesFromImageTest-1798281502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c61061e6-8532-40de-8ed2-09e1669a3a35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:28:03 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-2b64f7d2-4ada-4dba-9874-c261aeea7959 tempest-CreateVolumesFromImageTest-1798281502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c61061e6-8532-40de-8ed2-09e1669a3a35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '713a362b-338f-4f21-a61c-096746c27a43', 'volume_name': 'volume-713a362b-338f-4f21-a61c-096746c27a43', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:28:03 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-2b64f7d2-4ada-4dba-9874-c261aeea7959 tempest-CreateVolumesFromImageTest-1798281502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35a6b2db-ae59-46f2-84f2-964ad394fcd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:28:03 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-2b64f7d2-4ada-4dba-9874-c261aeea7959 tempest-CreateVolumesFromImageTest-1798281502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35a6b2db-ae59-46f2-84f2-964ad394fcd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:28:03 devstack sudo[104723]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:03 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-2b64f7d2-4ada-4dba-9874-c261aeea7959 tempest-CreateVolumesFromImageTest-1798281502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72cf261e-9c60-42b2-879c-969bc2e610d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:28:03 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-2b64f7d2-4ada-4dba-9874-c261aeea7959 tempest-CreateVolumesFromImageTest-1798281502 None] Volume 713a362b-338f-4f21-a61c-096746c27a43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-713a362b-338f-4f21-a61c-096746c27a43', 'volume_size': 1} Aug 29 01:28:03 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-2b64f7d2-4ada-4dba-9874-c261aeea7959 tempest-CreateVolumesFromImageTest-1798281502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:28:03 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-1bd483a3-c9d0-4e74-8b5b-1c91e7ecf9ea tempest-CreateVolumesFromImageTest-1798281502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-f486edac-6ea8-409f-854a-37aec731e5ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:03 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-6d8ec528-216f-4ac1-b258-0b9780c1fa42 tempest-VolumeDependencyTests-162034196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-fdac5d05-f835-43b4-ab10-91657b676a76.33072856-62cd-4e62-93a5-774a41b4b01d" returned: 0 in 0.608s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:03 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-6d8ec528-216f-4ac1-b258-0b9780c1fa42 tempest-VolumeDependencyTests-162034196 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fdac5d05-f835-43b4-ab10-91657b676a76(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 29 01:28:03 devstack sudo[104732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-f486edac-6ea8-409f-854a-37aec731e5ac Aug 29 01:28:03 devstack sudo[104732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:03 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ae335b1-0649-4dc1-9015-f9844c49c7c6]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:28:03 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-6d8ec528-216f-4ac1-b258-0b9780c1fa42 tempest-VolumeDependencyTests-162034196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-fdac5d05-f835-43b4-ab10-91657b676a76 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:03 devstack sudo[104734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-fdac5d05-f835-43b4-ab10-91657b676a76 Aug 29 01:28:03 devstack sudo[104734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:03 devstack sudo[104726]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:03 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-bec4ac4a-d0b4-4d0c-a3cf-7b082650cabc tempest-CreateVolumesFromSnapshotTest-198098050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-48c7cd73-3eb9-41c9-9726-4e33673bc688" returned: 0 in 0.587s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:04 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-bec4ac4a-d0b4-4d0c-a3cf-7b082650cabc tempest-CreateVolumesFromSnapshotTest-198098050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-48c7cd73-3eb9-41c9-9726-4e33673bc688 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:04 devstack sudo[104739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-48c7cd73-3eb9-41c9-9726-4e33673bc688 Aug 29 01:28:04 devstack sudo[104739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:04 devstack sudo[104732]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:04 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-1bd483a3-c9d0-4e74-8b5b-1c91e7ecf9ea tempest-CreateVolumesFromImageTest-1798281502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-f486edac-6ea8-409f-854a-37aec731e5ac" returned: 0 in 0.456s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:04 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-1bd483a3-c9d0-4e74-8b5b-1c91e7ecf9ea tempest-CreateVolumesFromImageTest-1798281502 None] <== create_volume: return (1551ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:28:04 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-1bd483a3-c9d0-4e74-8b5b-1c91e7ecf9ea tempest-CreateVolumesFromImageTest-1798281502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.556s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:28:04 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-70487789-59dc-4ad5-be8b-79762d76f0c2 tempest-CreateVolumesFromImageTest-1798281502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.836s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:28:04 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-70487789-59dc-4ad5-be8b-79762d76f0c2 tempest-CreateVolumesFromImageTest-1798281502 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:28:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1440583575',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f4a41ce-b6ce-42bd-953e-1f4aa8ee6e79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad99a6f732b64fe0a9e82257c656a980',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:28:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:28:03Z,use_quota=True,user_id='d6e3bbb4c12e431a9bfecec1b69e1794',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:28:04 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-70487789-59dc-4ad5-be8b-79762d76f0c2 tempest-CreateVolumesFromImageTest-1798281502 None] Creating volume 5f4a41ce-b6ce-42bd-953e-1f4aa8ee6e79 {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:28:04 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-70487789-59dc-4ad5-be8b-79762d76f0c2 tempest-CreateVolumesFromImageTest-1798281502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:28:04 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-70487789-59dc-4ad5-be8b-79762d76f0c2 tempest-CreateVolumesFromImageTest-1798281502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:28:04 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-70487789-59dc-4ad5-be8b-79762d76f0c2 tempest-CreateVolumesFromImageTest-1798281502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:28:04 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-70487789-59dc-4ad5-be8b-79762d76f0c2 tempest-CreateVolumesFromImageTest-1798281502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:28:04 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-70487789-59dc-4ad5-be8b-79762d76f0c2 tempest-CreateVolumesFromImageTest-1798281502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:28:04 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-70487789-59dc-4ad5-be8b-79762d76f0c2 tempest-CreateVolumesFromImageTest-1798281502 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:28:04 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-70487789-59dc-4ad5-be8b-79762d76f0c2 tempest-CreateVolumesFromImageTest-1798281502 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:28:04 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-70487789-59dc-4ad5-be8b-79762d76f0c2 tempest-CreateVolumesFromImageTest-1798281502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-5f4a41ce-b6ce-42bd-953e-1f4aa8ee6e79 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:04 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ac28b59-f7d7-4543-991b-ffa03a381b24 tempest-CreateVolumesFromImageTest-1798281502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:28:04 devstack sudo[104742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-5f4a41ce-b6ce-42bd-953e-1f4aa8ee6e79 1073741824 Aug 29 01:28:04 devstack sudo[104742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:04 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-9ac28b59-f7d7-4543-991b-ffa03a381b24 tempest-CreateVolumesFromImageTest-1798281502 None] Flow 'volume_create_manager' (66556bd0-7fb1-4c16-92ad-3c3be0301660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:28:04 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-9ac28b59-f7d7-4543-991b-ffa03a381b24 tempest-CreateVolumesFromImageTest-1798281502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (181fc51d-42a7-47b4-8e43-4a776f34a7ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:28:04 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-1bd483a3-c9d0-4e74-8b5b-1c91e7ecf9ea tempest-CreateVolumesFromImageTest-1798281502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d22e858c-a74b-4c57-b488-32b91c89f28d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f486edac-6ea8-409f-854a-37aec731e5ac', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:28:04 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-1bd483a3-c9d0-4e74-8b5b-1c91e7ecf9ea tempest-CreateVolumesFromImageTest-1798281502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (935149b7-01f5-45c5-bcac-fe6422afa5f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:28:04 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-9ac28b59-f7d7-4543-991b-ffa03a381b24 tempest-CreateVolumesFromImageTest-1798281502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (181fc51d-42a7-47b4-8e43-4a776f34a7ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:28:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-922967416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ededb4d8-7a7d-4324-b068-7447771a6388,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad99a6f732b64fe0a9e82257c656a980',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:28:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:28:04Z,use_quota=True,user_id='d6e3bbb4c12e431a9bfecec1b69e1794',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:28:04 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-9ac28b59-f7d7-4543-991b-ffa03a381b24 tempest-CreateVolumesFromImageTest-1798281502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ed3c455-a529-4fb4-89c1-0588810cd0dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:28:04 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-9ac28b59-f7d7-4543-991b-ffa03a381b24 tempest-CreateVolumesFromImageTest-1798281502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ed3c455-a529-4fb4-89c1-0588810cd0dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:28:04 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-9ac28b59-f7d7-4543-991b-ffa03a381b24 tempest-CreateVolumesFromImageTest-1798281502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e14079b6-aeb1-4cc2-b782-ee2a6f3d05ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:28:04 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-9ac28b59-f7d7-4543-991b-ffa03a381b24 tempest-CreateVolumesFromImageTest-1798281502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e14079b6-aeb1-4cc2-b782-ee2a6f3d05ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ededb4d8-7a7d-4324-b068-7447771a6388', 'volume_name': 'volume-ededb4d8-7a7d-4324-b068-7447771a6388', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:28:04 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-9ac28b59-f7d7-4543-991b-ffa03a381b24 tempest-CreateVolumesFromImageTest-1798281502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf1d325a-404e-404f-9388-8f21ded97c79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:28:04 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-9ac28b59-f7d7-4543-991b-ffa03a381b24 tempest-CreateVolumesFromImageTest-1798281502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf1d325a-404e-404f-9388-8f21ded97c79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:28:04 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-9ac28b59-f7d7-4543-991b-ffa03a381b24 tempest-CreateVolumesFromImageTest-1798281502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15ea2e4f-a7a8-404c-9f0a-fe1b64affe0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:28:04 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-9ac28b59-f7d7-4543-991b-ffa03a381b24 tempest-CreateVolumesFromImageTest-1798281502 None] Volume ededb4d8-7a7d-4324-b068-7447771a6388: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ededb4d8-7a7d-4324-b068-7447771a6388', 'volume_size': 1} Aug 29 01:28:04 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-9ac28b59-f7d7-4543-991b-ffa03a381b24 tempest-CreateVolumesFromImageTest-1798281502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:28:04 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-1bd483a3-c9d0-4e74-8b5b-1c91e7ecf9ea tempest-CreateVolumesFromImageTest-1798281502 None] Volume volume-f486edac-6ea8-409f-854a-37aec731e5ac (f486edac-6ea8-409f-854a-37aec731e5ac): created successfully Aug 29 01:28:04 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-1bd483a3-c9d0-4e74-8b5b-1c91e7ecf9ea tempest-CreateVolumesFromImageTest-1798281502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (935149b7-01f5-45c5-bcac-fe6422afa5f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:28:04 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-1bd483a3-c9d0-4e74-8b5b-1c91e7ecf9ea tempest-CreateVolumesFromImageTest-1798281502 None] Flow 'volume_create_manager' (f9bda797-c7fa-421d-b15c-ac484f2b2719) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:28:04 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-1bd483a3-c9d0-4e74-8b5b-1c91e7ecf9ea tempest-CreateVolumesFromImageTest-1798281502 None] Created volume successfully. Aug 29 01:28:04 devstack sudo[104739]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:04 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-bec4ac4a-d0b4-4d0c-a3cf-7b082650cabc tempest-CreateVolumesFromSnapshotTest-198098050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-48c7cd73-3eb9-41c9-9726-4e33673bc688" returned: 0 in 0.553s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:04 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-bec4ac4a-d0b4-4d0c-a3cf-7b082650cabc tempest-CreateVolumesFromSnapshotTest-198098050 None] Lock "cinder-quobyte-48c7cd73-3eb9-41c9-9726-4e33673bc688" released by "delete_volume" :: held 1.215s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:28:04 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-261e4c7a-0e75-43bb-ab08-c61332740ee6 tempest-CreateVolumesFromImageTest-1798281502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:28:04 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-261e4c7a-0e75-43bb-ab08-c61332740ee6 tempest-CreateVolumesFromImageTest-1798281502 None] Flow 'volume_create_manager' (040f6a5e-c804-4bfe-853a-b53b955b30d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:28:04 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-261e4c7a-0e75-43bb-ab08-c61332740ee6 tempest-CreateVolumesFromImageTest-1798281502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9521c88-390a-4ace-bc28-d35fdd6914b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:28:04 devstack sudo[104734]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:04 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-261e4c7a-0e75-43bb-ab08-c61332740ee6 tempest-CreateVolumesFromImageTest-1798281502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9521c88-390a-4ace-bc28-d35fdd6914b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:28:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1139394913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f00c61a-f6c5-4c82-a2d6-1966a93fac41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad99a6f732b64fe0a9e82257c656a980',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:28:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:28:05Z,use_quota=True,user_id='d6e3bbb4c12e431a9bfecec1b69e1794',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:28:04 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-261e4c7a-0e75-43bb-ab08-c61332740ee6 tempest-CreateVolumesFromImageTest-1798281502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfd11d30-dfe6-4009-b6de-a1f700d7973b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:28:04 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-261e4c7a-0e75-43bb-ab08-c61332740ee6 tempest-CreateVolumesFromImageTest-1798281502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfd11d30-dfe6-4009-b6de-a1f700d7973b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:28:04 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-261e4c7a-0e75-43bb-ab08-c61332740ee6 tempest-CreateVolumesFromImageTest-1798281502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c544bd4e-cde7-43fb-a3f3-335ef6a46195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:28:04 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-261e4c7a-0e75-43bb-ab08-c61332740ee6 tempest-CreateVolumesFromImageTest-1798281502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c544bd4e-cde7-43fb-a3f3-335ef6a46195) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f00c61a-f6c5-4c82-a2d6-1966a93fac41', 'volume_name': 'volume-4f00c61a-f6c5-4c82-a2d6-1966a93fac41', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:28:04 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-261e4c7a-0e75-43bb-ab08-c61332740ee6 tempest-CreateVolumesFromImageTest-1798281502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (114f03e3-b4a6-438d-931a-98a17da7f955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:28:04 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-261e4c7a-0e75-43bb-ab08-c61332740ee6 tempest-CreateVolumesFromImageTest-1798281502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (114f03e3-b4a6-438d-931a-98a17da7f955) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:28:04 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-261e4c7a-0e75-43bb-ab08-c61332740ee6 tempest-CreateVolumesFromImageTest-1798281502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03f21da2-34e5-4570-89dd-07addd55e90c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:28:04 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-261e4c7a-0e75-43bb-ab08-c61332740ee6 tempest-CreateVolumesFromImageTest-1798281502 None] Volume 4f00c61a-f6c5-4c82-a2d6-1966a93fac41: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f00c61a-f6c5-4c82-a2d6-1966a93fac41', 'volume_size': 1} Aug 29 01:28:04 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-261e4c7a-0e75-43bb-ab08-c61332740ee6 tempest-CreateVolumesFromImageTest-1798281502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:28:04 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-bec4ac4a-d0b4-4d0c-a3cf-7b082650cabc tempest-CreateVolumesFromSnapshotTest-198098050 None] Created reservations ['9c4fd5a9-5c04-42ff-957e-778bb838ba5e', 'f8527466-c317-47f2-959c-1c63f3f8b816', '7fea1c94-2c03-411b-aefb-f10ab17c63de', '0abc86a7-40b6-4c9b-a059-0144cc1eabcf'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:28:04 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-6d8ec528-216f-4ac1-b258-0b9780c1fa42 tempest-VolumeDependencyTests-162034196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-fdac5d05-f835-43b4-ab10-91657b676a76" returned: 0 in 0.987s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:04 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-6d8ec528-216f-4ac1-b258-0b9780c1fa42 tempest-VolumeDependencyTests-162034196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-fdac5d05-f835-43b4-ab10-91657b676a76.33072856-62cd-4e62-93a5-774a41b4b01d {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:04 devstack sudo[104752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-fdac5d05-f835-43b4-ab10-91657b676a76.33072856-62cd-4e62-93a5-774a41b4b01d Aug 29 01:28:04 devstack sudo[104752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:04 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-bec4ac4a-d0b4-4d0c-a3cf-7b082650cabc tempest-CreateVolumesFromSnapshotTest-198098050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:28:04 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-bec4ac4a-d0b4-4d0c-a3cf-7b082650cabc tempest-CreateVolumesFromSnapshotTest-198098050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:28:04 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-bec4ac4a-d0b4-4d0c-a3cf-7b082650cabc tempest-CreateVolumesFromSnapshotTest-198098050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:28:04 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-bec4ac4a-d0b4-4d0c-a3cf-7b082650cabc tempest-CreateVolumesFromSnapshotTest-198098050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:28:04 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-bec4ac4a-d0b4-4d0c-a3cf-7b082650cabc tempest-CreateVolumesFromSnapshotTest-198098050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:28:04 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-bec4ac4a-d0b4-4d0c-a3cf-7b082650cabc tempest-CreateVolumesFromSnapshotTest-198098050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:04 devstack sudo[104742]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:04 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-70487789-59dc-4ad5-be8b-79762d76f0c2 tempest-CreateVolumesFromImageTest-1798281502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-5f4a41ce-b6ce-42bd-953e-1f4aa8ee6e79 1073741824" returned: 0 in 0.700s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:04 devstack sudo[104754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:28:04 devstack sudo[104754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:04 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-70487789-59dc-4ad5-be8b-79762d76f0c2 tempest-CreateVolumesFromImageTest-1798281502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-5f4a41ce-b6ce-42bd-953e-1f4aa8ee6e79 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:04 devstack sudo[104756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-5f4a41ce-b6ce-42bd-953e-1f4aa8ee6e79 Aug 29 01:28:04 devstack sudo[104756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:05 devstack sudo[104752]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:05 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-6d8ec528-216f-4ac1-b258-0b9780c1fa42 tempest-VolumeDependencyTests-162034196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-fdac5d05-f835-43b4-ab10-91657b676a76.33072856-62cd-4e62-93a5-774a41b4b01d" returned: 0 in 0.406s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:05 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-6d8ec528-216f-4ac1-b258-0b9780c1fa42 tempest-VolumeDependencyTests-162034196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-fdac5d05-f835-43b4-ab10-91657b676a76.33072856-62cd-4e62-93a5-774a41b4b01d {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:05 devstack sudo[104754]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:05 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-bec4ac4a-d0b4-4d0c-a3cf-7b082650cabc tempest-CreateVolumesFromSnapshotTest-198098050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.304s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:05 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-bec4ac4a-d0b4-4d0c-a3cf-7b082650cabc tempest-CreateVolumesFromSnapshotTest-198098050 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:28:05 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-bec4ac4a-d0b4-4d0c-a3cf-7b082650cabc tempest-CreateVolumesFromSnapshotTest-198098050 None] Deleted volume successfully. Aug 29 01:28:05 devstack sudo[104763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-fdac5d05-f835-43b4-ab10-91657b676a76.33072856-62cd-4e62-93a5-774a41b4b01d Aug 29 01:28:05 devstack sudo[104763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:05 devstack sudo[104756]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:05 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-bec4ac4a-d0b4-4d0c-a3cf-7b082650cabc tempest-CreateVolumesFromSnapshotTest-198098050 None] Lock "cinder-48c7cd73-3eb9-41c9-9726-4e33673bc688-delete_volume" released by "delete_volume" :: held 2.131s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:28:05 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-70487789-59dc-4ad5-be8b-79762d76f0c2 tempest-CreateVolumesFromImageTest-1798281502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-5f4a41ce-b6ce-42bd-953e-1f4aa8ee6e79" returned: 0 in 0.304s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:05 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-70487789-59dc-4ad5-be8b-79762d76f0c2 tempest-CreateVolumesFromImageTest-1798281502 None] <== create_volume: return (1061ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:28:05 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-70487789-59dc-4ad5-be8b-79762d76f0c2 tempest-CreateVolumesFromImageTest-1798281502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.064s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:28:05 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-2b64f7d2-4ada-4dba-9874-c261aeea7959 tempest-CreateVolumesFromImageTest-1798281502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.544s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:28:05 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-2b64f7d2-4ada-4dba-9874-c261aeea7959 tempest-CreateVolumesFromImageTest-1798281502 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:28:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-934025735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=713a362b-338f-4f21-a61c-096746c27a43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad99a6f732b64fe0a9e82257c656a980',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:28:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:28:03Z,use_quota=True,user_id='d6e3bbb4c12e431a9bfecec1b69e1794',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:28:05 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-2b64f7d2-4ada-4dba-9874-c261aeea7959 tempest-CreateVolumesFromImageTest-1798281502 None] Creating volume 713a362b-338f-4f21-a61c-096746c27a43 {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:28:05 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-2b64f7d2-4ada-4dba-9874-c261aeea7959 tempest-CreateVolumesFromImageTest-1798281502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:28:05 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-2b64f7d2-4ada-4dba-9874-c261aeea7959 tempest-CreateVolumesFromImageTest-1798281502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:28:05 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-2b64f7d2-4ada-4dba-9874-c261aeea7959 tempest-CreateVolumesFromImageTest-1798281502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:28:05 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-2b64f7d2-4ada-4dba-9874-c261aeea7959 tempest-CreateVolumesFromImageTest-1798281502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:28:05 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-2b64f7d2-4ada-4dba-9874-c261aeea7959 tempest-CreateVolumesFromImageTest-1798281502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:28:05 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-2b64f7d2-4ada-4dba-9874-c261aeea7959 tempest-CreateVolumesFromImageTest-1798281502 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:28:05 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-2b64f7d2-4ada-4dba-9874-c261aeea7959 tempest-CreateVolumesFromImageTest-1798281502 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:28:05 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-2b64f7d2-4ada-4dba-9874-c261aeea7959 tempest-CreateVolumesFromImageTest-1798281502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-713a362b-338f-4f21-a61c-096746c27a43 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:05 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-70487789-59dc-4ad5-be8b-79762d76f0c2 tempest-CreateVolumesFromImageTest-1798281502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0e448f4-7148-4dd8-ac2f-f2cc2c89d914) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f4a41ce-b6ce-42bd-953e-1f4aa8ee6e79', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:28:05 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-70487789-59dc-4ad5-be8b-79762d76f0c2 tempest-CreateVolumesFromImageTest-1798281502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4dc44a1e-9be3-4060-9ca3-30d28523ca68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:28:05 devstack sudo[104766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-713a362b-338f-4f21-a61c-096746c27a43 1073741824 Aug 29 01:28:05 devstack sudo[104766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:05 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-70487789-59dc-4ad5-be8b-79762d76f0c2 tempest-CreateVolumesFromImageTest-1798281502 None] Volume volume-5f4a41ce-b6ce-42bd-953e-1f4aa8ee6e79 (5f4a41ce-b6ce-42bd-953e-1f4aa8ee6e79): created successfully Aug 29 01:28:05 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-70487789-59dc-4ad5-be8b-79762d76f0c2 tempest-CreateVolumesFromImageTest-1798281502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4dc44a1e-9be3-4060-9ca3-30d28523ca68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:28:05 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-70487789-59dc-4ad5-be8b-79762d76f0c2 tempest-CreateVolumesFromImageTest-1798281502 None] Flow 'volume_create_manager' (99d4b0f0-9749-405e-b0b1-40bebb3566d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:28:05 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-70487789-59dc-4ad5-be8b-79762d76f0c2 tempest-CreateVolumesFromImageTest-1798281502 None] Created volume successfully. Aug 29 01:28:05 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-c7c4729b-b447-4bbf-850e-e53c079ace44 tempest-CreateVolumesFromSnapshotTest-198098050 None] Acquiring lock "cinder-9d1bd2bf-45fa-43a5-9fd4-a76f31ec256f-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:28:05 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-c7c4729b-b447-4bbf-850e-e53c079ace44 tempest-CreateVolumesFromSnapshotTest-198098050 None] Lock "cinder-9d1bd2bf-45fa-43a5-9fd4-a76f31ec256f-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:28:05 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-c7c4729b-b447-4bbf-850e-e53c079ace44 tempest-CreateVolumesFromSnapshotTest-198098050 None] Acquiring lock "cinder-quobyte-9d1bd2bf-45fa-43a5-9fd4-a76f31ec256f" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:28:05 devstack sudo[104763]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:05 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-c7c4729b-b447-4bbf-850e-e53c079ace44 tempest-CreateVolumesFromSnapshotTest-198098050 None] Lock "cinder-quobyte-9d1bd2bf-45fa-43a5-9fd4-a76f31ec256f" acquired by "delete_volume" :: waited 0.021s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:28:05 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-6d8ec528-216f-4ac1-b258-0b9780c1fa42 tempest-VolumeDependencyTests-162034196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-fdac5d05-f835-43b4-ab10-91657b676a76.33072856-62cd-4e62-93a5-774a41b4b01d" returned: 0 in 0.396s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:05 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[87cc2338-1bb1-411b-afc7-2205cde16bc4]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:28:05 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c7c4729b-b447-4bbf-850e-e53c079ace44 tempest-CreateVolumesFromSnapshotTest-198098050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-9d1bd2bf-45fa-43a5-9fd4-a76f31ec256f {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:05 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-6d8ec528-216f-4ac1-b258-0b9780c1fa42 tempest-VolumeDependencyTests-162034196 None] Lock "cinder-quobyte-33072856-62cd-4e62-93a5-774a41b4b01d" released by "_delete_snapshot" :: held 2.578s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:28:05 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-6d8ec528-216f-4ac1-b258-0b9780c1fa42 tempest-VolumeDependencyTests-162034196 None] Lock "cinder-quobyte-fdac5d05-f835-43b4-ab10-91657b676a76" released by "delete_snapshot" :: held 2.643s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:28:05 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-6d8ec528-216f-4ac1-b258-0b9780c1fa42 tempest-VolumeDependencyTests-162034196 None] Created reservations ['e7ad2231-4a16-4eeb-9914-7a7bf321fce3', 'bfeb8036-06c7-41a9-9bf6-14ccfd7dc756', 'd244b34f-21d1-4a86-acd9-dbcac6353c48', 'd83dd3bb-ad03-4b42-bcfd-54e67655daaa'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:28:05 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-6d8ec528-216f-4ac1-b258-0b9780c1fa42 tempest-VolumeDependencyTests-162034196 None] Delete snapshot completed successfully. Aug 29 01:28:05 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-6d8ec528-216f-4ac1-b258-0b9780c1fa42 tempest-VolumeDependencyTests-162034196 None] Lock "cinder-33072856-62cd-4e62-93a5-774a41b4b01d-delete_snapshot" released by "delete_snapshot" :: held 2.837s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:28:05 devstack sudo[104772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-9d1bd2bf-45fa-43a5-9fd4-a76f31ec256f Aug 29 01:28:05 devstack sudo[104772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:05 devstack sudo[104766]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:05 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-2b64f7d2-4ada-4dba-9874-c261aeea7959 tempest-CreateVolumesFromImageTest-1798281502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-713a362b-338f-4f21-a61c-096746c27a43 1073741824" returned: 0 in 0.632s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:05 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-2b64f7d2-4ada-4dba-9874-c261aeea7959 tempest-CreateVolumesFromImageTest-1798281502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-713a362b-338f-4f21-a61c-096746c27a43 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:05 devstack sudo[104775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-713a362b-338f-4f21-a61c-096746c27a43 Aug 29 01:28:05 devstack sudo[104775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:06 devstack sudo[104772]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:06 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c7c4729b-b447-4bbf-850e-e53c079ace44 tempest-CreateVolumesFromSnapshotTest-198098050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-9d1bd2bf-45fa-43a5-9fd4-a76f31ec256f" returned: 0 in 0.522s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:06 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c7c4729b-b447-4bbf-850e-e53c079ace44 tempest-CreateVolumesFromSnapshotTest-198098050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-9d1bd2bf-45fa-43a5-9fd4-a76f31ec256f {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:06 devstack sudo[104780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-9d1bd2bf-45fa-43a5-9fd4-a76f31ec256f Aug 29 01:28:06 devstack sudo[104780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:06 devstack sudo[104775]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:06 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-2b64f7d2-4ada-4dba-9874-c261aeea7959 tempest-CreateVolumesFromImageTest-1798281502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-713a362b-338f-4f21-a61c-096746c27a43" returned: 0 in 0.310s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:06 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-2b64f7d2-4ada-4dba-9874-c261aeea7959 tempest-CreateVolumesFromImageTest-1798281502 None] <== create_volume: return (986ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:28:06 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-2b64f7d2-4ada-4dba-9874-c261aeea7959 tempest-CreateVolumesFromImageTest-1798281502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.992s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:28:06 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-9ac28b59-f7d7-4543-991b-ffa03a381b24 tempest-CreateVolumesFromImageTest-1798281502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.797s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:28:06 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-9ac28b59-f7d7-4543-991b-ffa03a381b24 tempest-CreateVolumesFromImageTest-1798281502 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:28:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-922967416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ededb4d8-7a7d-4324-b068-7447771a6388,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad99a6f732b64fe0a9e82257c656a980',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:28:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:28:04Z,use_quota=True,user_id='d6e3bbb4c12e431a9bfecec1b69e1794',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:28:06 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-9ac28b59-f7d7-4543-991b-ffa03a381b24 tempest-CreateVolumesFromImageTest-1798281502 None] Creating volume ededb4d8-7a7d-4324-b068-7447771a6388 {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:28:06 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-9ac28b59-f7d7-4543-991b-ffa03a381b24 tempest-CreateVolumesFromImageTest-1798281502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:28:06 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-9ac28b59-f7d7-4543-991b-ffa03a381b24 tempest-CreateVolumesFromImageTest-1798281502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:28:06 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-9ac28b59-f7d7-4543-991b-ffa03a381b24 tempest-CreateVolumesFromImageTest-1798281502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:28:06 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-9ac28b59-f7d7-4543-991b-ffa03a381b24 tempest-CreateVolumesFromImageTest-1798281502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:28:06 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-9ac28b59-f7d7-4543-991b-ffa03a381b24 tempest-CreateVolumesFromImageTest-1798281502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:28:06 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-9ac28b59-f7d7-4543-991b-ffa03a381b24 tempest-CreateVolumesFromImageTest-1798281502 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:28:06 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-9ac28b59-f7d7-4543-991b-ffa03a381b24 tempest-CreateVolumesFromImageTest-1798281502 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:28:06 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-9ac28b59-f7d7-4543-991b-ffa03a381b24 tempest-CreateVolumesFromImageTest-1798281502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ededb4d8-7a7d-4324-b068-7447771a6388 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:06 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-86f35011-a735-441f-8c49-0b6174fbe56f tempest-VolumeDependencyTests-162034196 None] Acquiring lock "cinder-fdac5d05-f835-43b4-ab10-91657b676a76-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:28:06 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-2b64f7d2-4ada-4dba-9874-c261aeea7959 tempest-CreateVolumesFromImageTest-1798281502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72cf261e-9c60-42b2-879c-969bc2e610d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-713a362b-338f-4f21-a61c-096746c27a43', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:28:06 devstack sudo[104783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ededb4d8-7a7d-4324-b068-7447771a6388 1073741824 Aug 29 01:28:06 devstack sudo[104783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:06 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-2b64f7d2-4ada-4dba-9874-c261aeea7959 tempest-CreateVolumesFromImageTest-1798281502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afc33461-46b4-4bcc-9c3d-4314811137bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:28:06 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-86f35011-a735-441f-8c49-0b6174fbe56f tempest-VolumeDependencyTests-162034196 None] Lock "cinder-fdac5d05-f835-43b4-ab10-91657b676a76-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:28:06 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-2b64f7d2-4ada-4dba-9874-c261aeea7959 tempest-CreateVolumesFromImageTest-1798281502 None] Volume volume-713a362b-338f-4f21-a61c-096746c27a43 (713a362b-338f-4f21-a61c-096746c27a43): created successfully Aug 29 01:28:06 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-2b64f7d2-4ada-4dba-9874-c261aeea7959 tempest-CreateVolumesFromImageTest-1798281502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afc33461-46b4-4bcc-9c3d-4314811137bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:28:06 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-2b64f7d2-4ada-4dba-9874-c261aeea7959 tempest-CreateVolumesFromImageTest-1798281502 None] Flow 'volume_create_manager' (595868b6-ef13-46a4-8fee-f537aeef30a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:28:06 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-2b64f7d2-4ada-4dba-9874-c261aeea7959 tempest-CreateVolumesFromImageTest-1798281502 None] Created volume successfully. Aug 29 01:28:06 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-86f35011-a735-441f-8c49-0b6174fbe56f tempest-VolumeDependencyTests-162034196 None] Acquiring lock "cinder-quobyte-fdac5d05-f835-43b4-ab10-91657b676a76" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:28:06 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-86f35011-a735-441f-8c49-0b6174fbe56f tempest-VolumeDependencyTests-162034196 None] Lock "cinder-quobyte-fdac5d05-f835-43b4-ab10-91657b676a76" acquired by "delete_volume" :: waited 0.020s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:28:06 devstack sudo[104780]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:06 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c7c4729b-b447-4bbf-850e-e53c079ace44 tempest-CreateVolumesFromSnapshotTest-198098050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-9d1bd2bf-45fa-43a5-9fd4-a76f31ec256f" returned: 0 in 0.366s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:06 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[5678c04c-4d0e-4bdd-94ac-0f0d5e0d89c6]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:28:06 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-86f35011-a735-441f-8c49-0b6174fbe56f tempest-VolumeDependencyTests-162034196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-fdac5d05-f835-43b4-ab10-91657b676a76 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:06 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-c7c4729b-b447-4bbf-850e-e53c079ace44 tempest-CreateVolumesFromSnapshotTest-198098050 None] Lock "cinder-quobyte-9d1bd2bf-45fa-43a5-9fd4-a76f31ec256f" released by "delete_volume" :: held 0.989s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:28:06 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-c7c4729b-b447-4bbf-850e-e53c079ace44 tempest-CreateVolumesFromSnapshotTest-198098050 None] Created reservations ['63ed9eab-9927-435b-aa61-0cdf1f0520d5', '8e561f2a-b28f-4e60-bed4-7d1ce03042c3', '13ad6332-a317-4f83-8d71-1e9416f249c0', 'e02b03b0-e0c0-4078-b06b-2253d0a8ea33'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:28:06 devstack sudo[104786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-fdac5d05-f835-43b4-ab10-91657b676a76 Aug 29 01:28:06 devstack sudo[104786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:06 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-c7c4729b-b447-4bbf-850e-e53c079ace44 tempest-CreateVolumesFromSnapshotTest-198098050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:28:06 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-c7c4729b-b447-4bbf-850e-e53c079ace44 tempest-CreateVolumesFromSnapshotTest-198098050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:28:06 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-c7c4729b-b447-4bbf-850e-e53c079ace44 tempest-CreateVolumesFromSnapshotTest-198098050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:28:06 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-c7c4729b-b447-4bbf-850e-e53c079ace44 tempest-CreateVolumesFromSnapshotTest-198098050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:28:06 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-c7c4729b-b447-4bbf-850e-e53c079ace44 tempest-CreateVolumesFromSnapshotTest-198098050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:28:06 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c7c4729b-b447-4bbf-850e-e53c079ace44 tempest-CreateVolumesFromSnapshotTest-198098050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:06 devstack sudo[104791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:28:06 devstack sudo[104791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:06 devstack sudo[104783]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:06 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-9ac28b59-f7d7-4543-991b-ffa03a381b24 tempest-CreateVolumesFromImageTest-1798281502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ededb4d8-7a7d-4324-b068-7447771a6388 1073741824" returned: 0 in 0.646s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:06 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-9ac28b59-f7d7-4543-991b-ffa03a381b24 tempest-CreateVolumesFromImageTest-1798281502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ededb4d8-7a7d-4324-b068-7447771a6388 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:06 devstack sudo[104797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ededb4d8-7a7d-4324-b068-7447771a6388 Aug 29 01:28:06 devstack sudo[104797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:06 devstack sudo[104786]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:07 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-86f35011-a735-441f-8c49-0b6174fbe56f tempest-VolumeDependencyTests-162034196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-fdac5d05-f835-43b4-ab10-91657b676a76" returned: 0 in 0.509s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:07 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-86f35011-a735-441f-8c49-0b6174fbe56f tempest-VolumeDependencyTests-162034196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-fdac5d05-f835-43b4-ab10-91657b676a76 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:07 devstack sudo[104791]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:07 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c7c4729b-b447-4bbf-850e-e53c079ace44 tempest-CreateVolumesFromSnapshotTest-198098050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.341s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:07 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-c7c4729b-b447-4bbf-850e-e53c079ace44 tempest-CreateVolumesFromSnapshotTest-198098050 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:28:07 devstack sudo[104800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-fdac5d05-f835-43b4-ab10-91657b676a76 Aug 29 01:28:07 devstack sudo[104800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:07 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-c7c4729b-b447-4bbf-850e-e53c079ace44 tempest-CreateVolumesFromSnapshotTest-198098050 None] Deleted volume successfully. Aug 29 01:28:07 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-c7c4729b-b447-4bbf-850e-e53c079ace44 tempest-CreateVolumesFromSnapshotTest-198098050 None] Lock "cinder-9d1bd2bf-45fa-43a5-9fd4-a76f31ec256f-delete_volume" released by "delete_volume" :: held 1.650s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:28:07 devstack sudo[104797]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:07 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-9ac28b59-f7d7-4543-991b-ffa03a381b24 tempest-CreateVolumesFromImageTest-1798281502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ededb4d8-7a7d-4324-b068-7447771a6388" returned: 0 in 0.274s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:07 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-9ac28b59-f7d7-4543-991b-ffa03a381b24 tempest-CreateVolumesFromImageTest-1798281502 None] <== create_volume: return (984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:28:07 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-9ac28b59-f7d7-4543-991b-ffa03a381b24 tempest-CreateVolumesFromImageTest-1798281502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.988s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:28:07 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-261e4c7a-0e75-43bb-ab08-c61332740ee6 tempest-CreateVolumesFromImageTest-1798281502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.489s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:28:07 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-261e4c7a-0e75-43bb-ab08-c61332740ee6 tempest-CreateVolumesFromImageTest-1798281502 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:28:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1139394913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f00c61a-f6c5-4c82-a2d6-1966a93fac41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad99a6f732b64fe0a9e82257c656a980',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:28:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:28:05Z,use_quota=True,user_id='d6e3bbb4c12e431a9bfecec1b69e1794',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:28:07 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-261e4c7a-0e75-43bb-ab08-c61332740ee6 tempest-CreateVolumesFromImageTest-1798281502 None] Creating volume 4f00c61a-f6c5-4c82-a2d6-1966a93fac41 {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:28:07 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-261e4c7a-0e75-43bb-ab08-c61332740ee6 tempest-CreateVolumesFromImageTest-1798281502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:28:07 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-261e4c7a-0e75-43bb-ab08-c61332740ee6 tempest-CreateVolumesFromImageTest-1798281502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:28:07 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-261e4c7a-0e75-43bb-ab08-c61332740ee6 tempest-CreateVolumesFromImageTest-1798281502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:28:07 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-261e4c7a-0e75-43bb-ab08-c61332740ee6 tempest-CreateVolumesFromImageTest-1798281502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:28:07 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-261e4c7a-0e75-43bb-ab08-c61332740ee6 tempest-CreateVolumesFromImageTest-1798281502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:28:07 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-261e4c7a-0e75-43bb-ab08-c61332740ee6 tempest-CreateVolumesFromImageTest-1798281502 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:28:07 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-261e4c7a-0e75-43bb-ab08-c61332740ee6 tempest-CreateVolumesFromImageTest-1798281502 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:28:07 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-261e4c7a-0e75-43bb-ab08-c61332740ee6 tempest-CreateVolumesFromImageTest-1798281502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-4f00c61a-f6c5-4c82-a2d6-1966a93fac41 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:07 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-9ac28b59-f7d7-4543-991b-ffa03a381b24 tempest-CreateVolumesFromImageTest-1798281502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15ea2e4f-a7a8-404c-9f0a-fe1b64affe0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ededb4d8-7a7d-4324-b068-7447771a6388', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:28:07 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-9ac28b59-f7d7-4543-991b-ffa03a381b24 tempest-CreateVolumesFromImageTest-1798281502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f02e2e9-e0ef-4586-9217-7f4ac176cb5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:28:07 devstack sudo[104803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-4f00c61a-f6c5-4c82-a2d6-1966a93fac41 1073741824 Aug 29 01:28:07 devstack sudo[104803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:07 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-9ac28b59-f7d7-4543-991b-ffa03a381b24 tempest-CreateVolumesFromImageTest-1798281502 None] Volume volume-ededb4d8-7a7d-4324-b068-7447771a6388 (ededb4d8-7a7d-4324-b068-7447771a6388): created successfully Aug 29 01:28:07 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-9ac28b59-f7d7-4543-991b-ffa03a381b24 tempest-CreateVolumesFromImageTest-1798281502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f02e2e9-e0ef-4586-9217-7f4ac176cb5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:28:07 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-9ac28b59-f7d7-4543-991b-ffa03a381b24 tempest-CreateVolumesFromImageTest-1798281502 None] Flow 'volume_create_manager' (66556bd0-7fb1-4c16-92ad-3c3be0301660) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:28:07 devstack sudo[104800]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:07 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-86f35011-a735-441f-8c49-0b6174fbe56f tempest-VolumeDependencyTests-162034196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-fdac5d05-f835-43b4-ab10-91657b676a76" returned: 0 in 0.304s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:07 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-9ac28b59-f7d7-4543-991b-ffa03a381b24 tempest-CreateVolumesFromImageTest-1798281502 None] Created volume successfully. Aug 29 01:28:07 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-86f35011-a735-441f-8c49-0b6174fbe56f tempest-VolumeDependencyTests-162034196 None] Lock "cinder-quobyte-fdac5d05-f835-43b4-ab10-91657b676a76" released by "delete_volume" :: held 0.905s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:28:07 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-86f35011-a735-441f-8c49-0b6174fbe56f tempest-VolumeDependencyTests-162034196 None] Created reservations ['0f63679a-5219-4df1-b1f0-c86b2f29a983', '55f3f389-beba-4fce-8502-47d0dc98914f', '38e216d2-412e-45d0-a0a1-9f3c33baadec', 'd4394f14-4c81-44be-8ce4-6808ffe3bbdf'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:28:07 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-86f35011-a735-441f-8c49-0b6174fbe56f tempest-VolumeDependencyTests-162034196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:28:07 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-86f35011-a735-441f-8c49-0b6174fbe56f tempest-VolumeDependencyTests-162034196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:28:07 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-86f35011-a735-441f-8c49-0b6174fbe56f tempest-VolumeDependencyTests-162034196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:28:07 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-86f35011-a735-441f-8c49-0b6174fbe56f tempest-VolumeDependencyTests-162034196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:28:07 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-86f35011-a735-441f-8c49-0b6174fbe56f tempest-VolumeDependencyTests-162034196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:28:07 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-86f35011-a735-441f-8c49-0b6174fbe56f tempest-VolumeDependencyTests-162034196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:07 devstack sudo[104806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:28:07 devstack sudo[104806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:07 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-4ebac9bb-00f5-4334-9364-db1278ab9a75 tempest-CreateVolumesFromSnapshotTest-198098050 None] Acquiring lock "cinder-fd5541c7-a626-42a1-80a6-1d317bf6f530-delete_snapshot" by "delete_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:28:07 devstack sudo[104803]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:07 devstack sudo[104806]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:07 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-4ebac9bb-00f5-4334-9364-db1278ab9a75 tempest-CreateVolumesFromSnapshotTest-198098050 None] Lock "cinder-fd5541c7-a626-42a1-80a6-1d317bf6f530-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:28:07 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-4ebac9bb-00f5-4334-9364-db1278ab9a75 tempest-CreateVolumesFromSnapshotTest-198098050 None] Acquiring lock "cinder-quobyte-21da70b2-5db7-4690-aa08-c73d2272e3b8" by "delete_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:28:07 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-86f35011-a735-441f-8c49-0b6174fbe56f tempest-VolumeDependencyTests-162034196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.257s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:07 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-261e4c7a-0e75-43bb-ab08-c61332740ee6 tempest-CreateVolumesFromImageTest-1798281502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-4f00c61a-f6c5-4c82-a2d6-1966a93fac41 1073741824" returned: 0 in 0.475s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:07 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-86f35011-a735-441f-8c49-0b6174fbe56f tempest-VolumeDependencyTests-162034196 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:28:07 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-86f35011-a735-441f-8c49-0b6174fbe56f tempest-VolumeDependencyTests-162034196 None] Deleted volume successfully. Aug 29 01:28:07 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-4ebac9bb-00f5-4334-9364-db1278ab9a75 tempest-CreateVolumesFromSnapshotTest-198098050 None] Lock "cinder-quobyte-21da70b2-5db7-4690-aa08-c73d2272e3b8" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:28:07 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-4ebac9bb-00f5-4334-9364-db1278ab9a75 tempest-CreateVolumesFromSnapshotTest-198098050 None] Acquiring lock "cinder-quobyte-fd5541c7-a626-42a1-80a6-1d317bf6f530" by "_delete_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:28:07 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-4ebac9bb-00f5-4334-9364-db1278ab9a75 tempest-CreateVolumesFromSnapshotTest-198098050 None] Lock "cinder-quobyte-fd5541c7-a626-42a1-80a6-1d317bf6f530" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:28:07 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-4ebac9bb-00f5-4334-9364-db1278ab9a75 tempest-CreateVolumesFromSnapshotTest-198098050 None] Deleting offline snapshot fd5541c7-a626-42a1-80a6-1d317bf6f530 of volume 21da70b2-5db7-4690-aa08-c73d2272e3b8 {{(pid=86111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 29 01:28:07 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-4ebac9bb-00f5-4334-9364-db1278ab9a75 tempest-CreateVolumesFromSnapshotTest-198098050 None] snapshot_file for this snap is: volume-21da70b2-5db7-4690-aa08-c73d2272e3b8.fd5541c7-a626-42a1-80a6-1d317bf6f530 {{(pid=86111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 29 01:28:07 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-86f35011-a735-441f-8c49-0b6174fbe56f tempest-VolumeDependencyTests-162034196 None] Lock "cinder-fdac5d05-f835-43b4-ab10-91657b676a76-delete_volume" released by "delete_volume" :: held 1.443s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:28:07 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[30823097-9daf-4a59-bcec-b19c4004e3c4]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:28:07 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-4ebac9bb-00f5-4334-9364-db1278ab9a75 tempest-CreateVolumesFromSnapshotTest-198098050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-21da70b2-5db7-4690-aa08-c73d2272e3b8.fd5541c7-a626-42a1-80a6-1d317bf6f530 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:07 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-261e4c7a-0e75-43bb-ab08-c61332740ee6 tempest-CreateVolumesFromImageTest-1798281502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-4f00c61a-f6c5-4c82-a2d6-1966a93fac41 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:07 devstack sudo[104813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-4f00c61a-f6c5-4c82-a2d6-1966a93fac41 Aug 29 01:28:07 devstack sudo[104813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:07 devstack sudo[104812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-21da70b2-5db7-4690-aa08-c73d2272e3b8.fd5541c7-a626-42a1-80a6-1d317bf6f530 Aug 29 01:28:07 devstack sudo[104812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:08 devstack sudo[104813]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:08 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-261e4c7a-0e75-43bb-ab08-c61332740ee6 tempest-CreateVolumesFromImageTest-1798281502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-4f00c61a-f6c5-4c82-a2d6-1966a93fac41" returned: 0 in 0.253s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:08 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-261e4c7a-0e75-43bb-ab08-c61332740ee6 tempest-CreateVolumesFromImageTest-1798281502 None] <== create_volume: return (822ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:28:08 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-261e4c7a-0e75-43bb-ab08-c61332740ee6 tempest-CreateVolumesFromImageTest-1798281502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.825s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:28:08 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-261e4c7a-0e75-43bb-ab08-c61332740ee6 tempest-CreateVolumesFromImageTest-1798281502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03f21da2-34e5-4570-89dd-07addd55e90c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f00c61a-f6c5-4c82-a2d6-1966a93fac41', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:28:08 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-261e4c7a-0e75-43bb-ab08-c61332740ee6 tempest-CreateVolumesFromImageTest-1798281502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc06a4cc-1a5b-4826-9644-74315e43d872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:28:08 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-261e4c7a-0e75-43bb-ab08-c61332740ee6 tempest-CreateVolumesFromImageTest-1798281502 None] Volume volume-4f00c61a-f6c5-4c82-a2d6-1966a93fac41 (4f00c61a-f6c5-4c82-a2d6-1966a93fac41): created successfully Aug 29 01:28:08 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-261e4c7a-0e75-43bb-ab08-c61332740ee6 tempest-CreateVolumesFromImageTest-1798281502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc06a4cc-1a5b-4826-9644-74315e43d872) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:28:08 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-261e4c7a-0e75-43bb-ab08-c61332740ee6 tempest-CreateVolumesFromImageTest-1798281502 None] Flow 'volume_create_manager' (040f6a5e-c804-4bfe-853a-b53b955b30d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:28:08 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-261e4c7a-0e75-43bb-ab08-c61332740ee6 tempest-CreateVolumesFromImageTest-1798281502 None] Created volume successfully. Aug 29 01:28:08 devstack sudo[104812]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:08 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-4ebac9bb-00f5-4334-9364-db1278ab9a75 tempest-CreateVolumesFromSnapshotTest-198098050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-21da70b2-5db7-4690-aa08-c73d2272e3b8.fd5541c7-a626-42a1-80a6-1d317bf6f530" returned: 0 in 0.375s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:08 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-4ebac9bb-00f5-4334-9364-db1278ab9a75 tempest-CreateVolumesFromSnapshotTest-198098050 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-21da70b2-5db7-4690-aa08-c73d2272e3b8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 29 01:28:08 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[c03fd549-40dc-4139-93dc-1860e3458fca]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:28:08 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-4ebac9bb-00f5-4334-9364-db1278ab9a75 tempest-CreateVolumesFromSnapshotTest-198098050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-21da70b2-5db7-4690-aa08-c73d2272e3b8 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:08 devstack sudo[104820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-21da70b2-5db7-4690-aa08-c73d2272e3b8 Aug 29 01:28:08 devstack sudo[104820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:08 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-3de9ba9d-5e1f-4174-ae03-0954c485b1cb tempest-VolumeDependencyTests-162034196 None] Acquiring lock "cinder-9ecd0092-9706-4800-a369-084e9ca9071e-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:28:08 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-3de9ba9d-5e1f-4174-ae03-0954c485b1cb tempest-VolumeDependencyTests-162034196 None] Lock "cinder-9ecd0092-9706-4800-a369-084e9ca9071e-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:28:08 devstack sudo[104820]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:08 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-4ebac9bb-00f5-4334-9364-db1278ab9a75 tempest-CreateVolumesFromSnapshotTest-198098050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-21da70b2-5db7-4690-aa08-c73d2272e3b8" returned: 0 in 0.410s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:08 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-4ebac9bb-00f5-4334-9364-db1278ab9a75 tempest-CreateVolumesFromSnapshotTest-198098050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-21da70b2-5db7-4690-aa08-c73d2272e3b8.fd5541c7-a626-42a1-80a6-1d317bf6f530 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:08 devstack sudo[104825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-21da70b2-5db7-4690-aa08-c73d2272e3b8.fd5541c7-a626-42a1-80a6-1d317bf6f530 Aug 29 01:28:08 devstack sudo[104825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:08 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-3de9ba9d-5e1f-4174-ae03-0954c485b1cb tempest-VolumeDependencyTests-162034196 None] Acquiring lock "cinder-quobyte-9ecd0092-9706-4800-a369-084e9ca9071e" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:28:08 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-3de9ba9d-5e1f-4174-ae03-0954c485b1cb tempest-VolumeDependencyTests-162034196 None] Lock "cinder-quobyte-9ecd0092-9706-4800-a369-084e9ca9071e" acquired by "delete_volume" :: waited 0.021s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:28:08 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e59e7bd-508a-4452-b45c-0f334a7f0277]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:28:08 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-3de9ba9d-5e1f-4174-ae03-0954c485b1cb tempest-VolumeDependencyTests-162034196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-9ecd0092-9706-4800-a369-084e9ca9071e {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:08 devstack sudo[104827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-9ecd0092-9706-4800-a369-084e9ca9071e Aug 29 01:28:08 devstack sudo[104827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:08 devstack sudo[104825]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:08 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-4ebac9bb-00f5-4334-9364-db1278ab9a75 tempest-CreateVolumesFromSnapshotTest-198098050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-21da70b2-5db7-4690-aa08-c73d2272e3b8.fd5541c7-a626-42a1-80a6-1d317bf6f530" returned: 0 in 0.367s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:08 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-4ebac9bb-00f5-4334-9364-db1278ab9a75 tempest-CreateVolumesFromSnapshotTest-198098050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-21da70b2-5db7-4690-aa08-c73d2272e3b8.fd5541c7-a626-42a1-80a6-1d317bf6f530 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:08 devstack sudo[104833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-21da70b2-5db7-4690-aa08-c73d2272e3b8.fd5541c7-a626-42a1-80a6-1d317bf6f530 Aug 29 01:28:08 devstack sudo[104833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:09 devstack sudo[104827]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:09 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-3de9ba9d-5e1f-4174-ae03-0954c485b1cb tempest-VolumeDependencyTests-162034196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-9ecd0092-9706-4800-a369-084e9ca9071e" returned: 0 in 0.449s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:09 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-3de9ba9d-5e1f-4174-ae03-0954c485b1cb tempest-VolumeDependencyTests-162034196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-9ecd0092-9706-4800-a369-084e9ca9071e {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:09 devstack sudo[104838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-9ecd0092-9706-4800-a369-084e9ca9071e Aug 29 01:28:09 devstack sudo[104838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:09 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-c65ecd96-69f9-4abc-b23b-40e00c52e31e tempest-CreateVolumesFromImageTest-1798281502 None] Acquiring lock "cinder-4f00c61a-f6c5-4c82-a2d6-1966a93fac41-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:28:09 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-c65ecd96-69f9-4abc-b23b-40e00c52e31e tempest-CreateVolumesFromImageTest-1798281502 None] Lock "cinder-4f00c61a-f6c5-4c82-a2d6-1966a93fac41-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:28:09 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-c65ecd96-69f9-4abc-b23b-40e00c52e31e tempest-CreateVolumesFromImageTest-1798281502 None] Acquiring lock "cinder-quobyte-4f00c61a-f6c5-4c82-a2d6-1966a93fac41" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:28:09 devstack sudo[104833]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:09 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-4ebac9bb-00f5-4334-9364-db1278ab9a75 tempest-CreateVolumesFromSnapshotTest-198098050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-21da70b2-5db7-4690-aa08-c73d2272e3b8.fd5541c7-a626-42a1-80a6-1d317bf6f530" returned: 0 in 0.354s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:09 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-c65ecd96-69f9-4abc-b23b-40e00c52e31e tempest-CreateVolumesFromImageTest-1798281502 None] Lock "cinder-quobyte-4f00c61a-f6c5-4c82-a2d6-1966a93fac41" acquired by "delete_volume" :: waited 0.053s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:28:09 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-4ebac9bb-00f5-4334-9364-db1278ab9a75 tempest-CreateVolumesFromSnapshotTest-198098050 None] Lock "cinder-quobyte-fd5541c7-a626-42a1-80a6-1d317bf6f530" released by "_delete_snapshot" :: held 1.638s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:28:09 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-4ebac9bb-00f5-4334-9364-db1278ab9a75 tempest-CreateVolumesFromSnapshotTest-198098050 None] Lock "cinder-quobyte-21da70b2-5db7-4690-aa08-c73d2272e3b8" released by "delete_snapshot" :: held 1.666s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:28:09 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5d0115b-63f7-41f6-99e7-08627a5aa0fd]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:28:09 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c65ecd96-69f9-4abc-b23b-40e00c52e31e tempest-CreateVolumesFromImageTest-1798281502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-4f00c61a-f6c5-4c82-a2d6-1966a93fac41 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:09 devstack sudo[104838]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:09 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-3de9ba9d-5e1f-4174-ae03-0954c485b1cb tempest-VolumeDependencyTests-162034196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-9ecd0092-9706-4800-a369-084e9ca9071e" returned: 0 in 0.305s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:09 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-3de9ba9d-5e1f-4174-ae03-0954c485b1cb tempest-VolumeDependencyTests-162034196 None] Lock "cinder-quobyte-9ecd0092-9706-4800-a369-084e9ca9071e" released by "delete_volume" :: held 0.813s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:28:09 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-4ebac9bb-00f5-4334-9364-db1278ab9a75 tempest-CreateVolumesFromSnapshotTest-198098050 None] Created reservations ['53d7f9a1-ea9f-428f-b952-d4250b3836fc', '46e21d88-fee7-46d6-b3e7-6ea5760ef1b9', '7f0e4d27-0c5d-4533-b8ed-97594e3c3ab4', '77008b3a-ef32-47bc-9ecf-463c07097aab'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:28:09 devstack sudo[104842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-4f00c61a-f6c5-4c82-a2d6-1966a93fac41 Aug 29 01:28:09 devstack sudo[104842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:09 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-3de9ba9d-5e1f-4174-ae03-0954c485b1cb tempest-VolumeDependencyTests-162034196 None] Created reservations ['b678bf26-3552-4438-804c-17936bb91bd7', '4cc297c8-1602-4552-a725-30026eeb0d72', '8985ad47-175e-4492-8027-449f0be34777', '9a8ea773-c29e-4ffb-b099-f073c45b6921'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:28:09 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-4ebac9bb-00f5-4334-9364-db1278ab9a75 tempest-CreateVolumesFromSnapshotTest-198098050 None] Delete snapshot completed successfully. Aug 29 01:28:09 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-4ebac9bb-00f5-4334-9364-db1278ab9a75 tempest-CreateVolumesFromSnapshotTest-198098050 None] Lock "cinder-fd5541c7-a626-42a1-80a6-1d317bf6f530-delete_snapshot" released by "delete_snapshot" :: held 1.887s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:28:09 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-3de9ba9d-5e1f-4174-ae03-0954c485b1cb tempest-VolumeDependencyTests-162034196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:28:09 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-3de9ba9d-5e1f-4174-ae03-0954c485b1cb tempest-VolumeDependencyTests-162034196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:28:09 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-3de9ba9d-5e1f-4174-ae03-0954c485b1cb tempest-VolumeDependencyTests-162034196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:28:09 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-3de9ba9d-5e1f-4174-ae03-0954c485b1cb tempest-VolumeDependencyTests-162034196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:28:09 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-3de9ba9d-5e1f-4174-ae03-0954c485b1cb tempest-VolumeDependencyTests-162034196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:28:09 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-3de9ba9d-5e1f-4174-ae03-0954c485b1cb tempest-VolumeDependencyTests-162034196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:09 devstack sudo[104845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:28:09 devstack sudo[104845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:09 devstack sudo[104842]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:09 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c65ecd96-69f9-4abc-b23b-40e00c52e31e tempest-CreateVolumesFromImageTest-1798281502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-4f00c61a-f6c5-4c82-a2d6-1966a93fac41" returned: 0 in 0.412s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:09 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c65ecd96-69f9-4abc-b23b-40e00c52e31e tempest-CreateVolumesFromImageTest-1798281502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-4f00c61a-f6c5-4c82-a2d6-1966a93fac41 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:09 devstack sudo[104850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-4f00c61a-f6c5-4c82-a2d6-1966a93fac41 Aug 29 01:28:09 devstack sudo[104850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:09 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-51e71694-3eab-4528-bd3f-7f0187ec6401 tempest-CreateVolumesFromSnapshotTest-198098050 None] Acquiring lock "cinder-21da70b2-5db7-4690-aa08-c73d2272e3b8-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:28:09 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-51e71694-3eab-4528-bd3f-7f0187ec6401 tempest-CreateVolumesFromSnapshotTest-198098050 None] Lock "cinder-21da70b2-5db7-4690-aa08-c73d2272e3b8-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:28:09 devstack sudo[104845]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:09 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-3de9ba9d-5e1f-4174-ae03-0954c485b1cb tempest-VolumeDependencyTests-162034196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.334s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:09 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-3de9ba9d-5e1f-4174-ae03-0954c485b1cb tempest-VolumeDependencyTests-162034196 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:28:09 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-51e71694-3eab-4528-bd3f-7f0187ec6401 tempest-CreateVolumesFromSnapshotTest-198098050 None] Acquiring lock "cinder-quobyte-21da70b2-5db7-4690-aa08-c73d2272e3b8" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:28:09 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-3de9ba9d-5e1f-4174-ae03-0954c485b1cb tempest-VolumeDependencyTests-162034196 None] Deleted volume successfully. Aug 29 01:28:09 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-51e71694-3eab-4528-bd3f-7f0187ec6401 tempest-CreateVolumesFromSnapshotTest-198098050 None] Lock "cinder-quobyte-21da70b2-5db7-4690-aa08-c73d2272e3b8" acquired by "delete_volume" :: waited 0.032s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:28:10 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-3de9ba9d-5e1f-4174-ae03-0954c485b1cb tempest-VolumeDependencyTests-162034196 None] Lock "cinder-9ecd0092-9706-4800-a369-084e9ca9071e-delete_volume" released by "delete_volume" :: held 1.441s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:28:10 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e537a21-2476-4f26-8fad-9c08bc45cbb5]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:28:10 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-51e71694-3eab-4528-bd3f-7f0187ec6401 tempest-CreateVolumesFromSnapshotTest-198098050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-21da70b2-5db7-4690-aa08-c73d2272e3b8 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:10 devstack sudo[104850]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:10 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c65ecd96-69f9-4abc-b23b-40e00c52e31e tempest-CreateVolumesFromImageTest-1798281502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-4f00c61a-f6c5-4c82-a2d6-1966a93fac41" returned: 0 in 0.326s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:10 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-c65ecd96-69f9-4abc-b23b-40e00c52e31e tempest-CreateVolumesFromImageTest-1798281502 None] Lock "cinder-quobyte-4f00c61a-f6c5-4c82-a2d6-1966a93fac41" released by "delete_volume" :: held 0.791s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:28:10 devstack sudo[104853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-21da70b2-5db7-4690-aa08-c73d2272e3b8 Aug 29 01:28:10 devstack sudo[104853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:10 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-c65ecd96-69f9-4abc-b23b-40e00c52e31e tempest-CreateVolumesFromImageTest-1798281502 None] Created reservations ['05c49140-23b8-4170-a87c-0146576e2082', '25024e27-c476-4dd2-8638-ca22d56d034e', 'a3f95105-ae76-4442-bfc7-0167b87b8020', '28273180-460b-4c90-80ac-2c8501a1ad9a'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:28:10 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-c65ecd96-69f9-4abc-b23b-40e00c52e31e tempest-CreateVolumesFromImageTest-1798281502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:28:10 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-c65ecd96-69f9-4abc-b23b-40e00c52e31e tempest-CreateVolumesFromImageTest-1798281502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:28:10 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-c65ecd96-69f9-4abc-b23b-40e00c52e31e tempest-CreateVolumesFromImageTest-1798281502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:28:10 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-c65ecd96-69f9-4abc-b23b-40e00c52e31e tempest-CreateVolumesFromImageTest-1798281502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:28:10 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-c65ecd96-69f9-4abc-b23b-40e00c52e31e tempest-CreateVolumesFromImageTest-1798281502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:28:10 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c65ecd96-69f9-4abc-b23b-40e00c52e31e tempest-CreateVolumesFromImageTest-1798281502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:10 devstack sudo[104856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:28:10 devstack sudo[104856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:10 devstack sudo[104853]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:10 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-3d5eb4d0-9f43-4a62-b441-c432b25bd2ac tempest-CreateVolumesFromImageTest-1798281502 None] Acquiring lock "cinder-ededb4d8-7a7d-4324-b068-7447771a6388-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:28:10 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-51e71694-3eab-4528-bd3f-7f0187ec6401 tempest-CreateVolumesFromSnapshotTest-198098050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-21da70b2-5db7-4690-aa08-c73d2272e3b8" returned: 0 in 0.471s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:10 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-51e71694-3eab-4528-bd3f-7f0187ec6401 tempest-CreateVolumesFromSnapshotTest-198098050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-21da70b2-5db7-4690-aa08-c73d2272e3b8 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:10 devstack sudo[104861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-21da70b2-5db7-4690-aa08-c73d2272e3b8 Aug 29 01:28:10 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-3d5eb4d0-9f43-4a62-b441-c432b25bd2ac tempest-CreateVolumesFromImageTest-1798281502 None] Lock "cinder-ededb4d8-7a7d-4324-b068-7447771a6388-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:28:10 devstack sudo[104861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:10 devstack sudo[104856]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:10 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c65ecd96-69f9-4abc-b23b-40e00c52e31e tempest-CreateVolumesFromImageTest-1798281502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.305s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:10 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-c65ecd96-69f9-4abc-b23b-40e00c52e31e tempest-CreateVolumesFromImageTest-1798281502 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:28:10 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-3d5eb4d0-9f43-4a62-b441-c432b25bd2ac tempest-CreateVolumesFromImageTest-1798281502 None] Acquiring lock "cinder-quobyte-ededb4d8-7a7d-4324-b068-7447771a6388" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:28:10 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-c65ecd96-69f9-4abc-b23b-40e00c52e31e tempest-CreateVolumesFromImageTest-1798281502 None] Deleted volume successfully. Aug 29 01:28:10 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-3d5eb4d0-9f43-4a62-b441-c432b25bd2ac tempest-CreateVolumesFromImageTest-1798281502 None] Lock "cinder-quobyte-ededb4d8-7a7d-4324-b068-7447771a6388" acquired by "delete_volume" :: waited 0.034s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:28:10 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-c65ecd96-69f9-4abc-b23b-40e00c52e31e tempest-CreateVolumesFromImageTest-1798281502 None] Lock "cinder-4f00c61a-f6c5-4c82-a2d6-1966a93fac41-delete_volume" released by "delete_volume" :: held 1.431s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:28:10 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[b16c1609-1750-4d5e-8cd7-2d3dffd2000f]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:28:10 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-3d5eb4d0-9f43-4a62-b441-c432b25bd2ac tempest-CreateVolumesFromImageTest-1798281502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ededb4d8-7a7d-4324-b068-7447771a6388 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:10 devstack sudo[104861]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:10 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-51e71694-3eab-4528-bd3f-7f0187ec6401 tempest-CreateVolumesFromSnapshotTest-198098050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-21da70b2-5db7-4690-aa08-c73d2272e3b8" returned: 0 in 0.377s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:10 devstack sudo[104864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ededb4d8-7a7d-4324-b068-7447771a6388 Aug 29 01:28:10 devstack sudo[104864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:10 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-51e71694-3eab-4528-bd3f-7f0187ec6401 tempest-CreateVolumesFromSnapshotTest-198098050 None] Lock "cinder-quobyte-21da70b2-5db7-4690-aa08-c73d2272e3b8" released by "delete_volume" :: held 0.932s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:28:11 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-51e71694-3eab-4528-bd3f-7f0187ec6401 tempest-CreateVolumesFromSnapshotTest-198098050 None] Created reservations ['62065657-7ab4-4523-ac98-bee33e308018', '97c45935-5115-46bd-bc26-4a5ed0ae126f', '9e32c52c-cfee-4db4-a316-d0a5b47810b3', '1af9f926-be5a-4843-b8bc-6c7cf103218c'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:28:11 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-51e71694-3eab-4528-bd3f-7f0187ec6401 tempest-CreateVolumesFromSnapshotTest-198098050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:28:11 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-51e71694-3eab-4528-bd3f-7f0187ec6401 tempest-CreateVolumesFromSnapshotTest-198098050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:28:11 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-51e71694-3eab-4528-bd3f-7f0187ec6401 tempest-CreateVolumesFromSnapshotTest-198098050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:28:11 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-51e71694-3eab-4528-bd3f-7f0187ec6401 tempest-CreateVolumesFromSnapshotTest-198098050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:28:11 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-51e71694-3eab-4528-bd3f-7f0187ec6401 tempest-CreateVolumesFromSnapshotTest-198098050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:28:11 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-51e71694-3eab-4528-bd3f-7f0187ec6401 tempest-CreateVolumesFromSnapshotTest-198098050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:11 devstack sudo[104868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:28:11 devstack sudo[104868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:11 devstack sudo[104864]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:11 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-3d5eb4d0-9f43-4a62-b441-c432b25bd2ac tempest-CreateVolumesFromImageTest-1798281502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ededb4d8-7a7d-4324-b068-7447771a6388" returned: 0 in 0.508s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:11 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-3d5eb4d0-9f43-4a62-b441-c432b25bd2ac tempest-CreateVolumesFromImageTest-1798281502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ededb4d8-7a7d-4324-b068-7447771a6388 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:11 devstack sudo[104872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ededb4d8-7a7d-4324-b068-7447771a6388 Aug 29 01:28:11 devstack sudo[104872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:11 devstack sudo[104868]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:11 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-51e71694-3eab-4528-bd3f-7f0187ec6401 tempest-CreateVolumesFromSnapshotTest-198098050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.304s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:11 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-51e71694-3eab-4528-bd3f-7f0187ec6401 tempest-CreateVolumesFromSnapshotTest-198098050 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:28:11 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-51e71694-3eab-4528-bd3f-7f0187ec6401 tempest-CreateVolumesFromSnapshotTest-198098050 None] Deleted volume successfully. Aug 29 01:28:11 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-51e71694-3eab-4528-bd3f-7f0187ec6401 tempest-CreateVolumesFromSnapshotTest-198098050 None] Lock "cinder-21da70b2-5db7-4690-aa08-c73d2272e3b8-delete_volume" released by "delete_volume" :: held 1.590s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:28:11 devstack sudo[104872]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:11 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-3d5eb4d0-9f43-4a62-b441-c432b25bd2ac tempest-CreateVolumesFromImageTest-1798281502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ededb4d8-7a7d-4324-b068-7447771a6388" returned: 0 in 0.370s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:11 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-3d5eb4d0-9f43-4a62-b441-c432b25bd2ac tempest-CreateVolumesFromImageTest-1798281502 None] Lock "cinder-quobyte-ededb4d8-7a7d-4324-b068-7447771a6388" released by "delete_volume" :: held 0.943s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:28:11 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-3d5eb4d0-9f43-4a62-b441-c432b25bd2ac tempest-CreateVolumesFromImageTest-1798281502 None] Created reservations ['ead4431d-8513-4c28-a252-90b936d331fd', 'b0b077d1-4c3f-4e42-9e87-fd301d39887c', 'be5bf113-a602-4c43-adb3-bb2536cab691', 'fc041637-9c17-4b1f-9124-fd9bd4aa0d63'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:28:11 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-3d5eb4d0-9f43-4a62-b441-c432b25bd2ac tempest-CreateVolumesFromImageTest-1798281502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:28:11 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-3d5eb4d0-9f43-4a62-b441-c432b25bd2ac tempest-CreateVolumesFromImageTest-1798281502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:28:11 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-3d5eb4d0-9f43-4a62-b441-c432b25bd2ac tempest-CreateVolumesFromImageTest-1798281502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:28:11 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-3d5eb4d0-9f43-4a62-b441-c432b25bd2ac tempest-CreateVolumesFromImageTest-1798281502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:28:11 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-3d5eb4d0-9f43-4a62-b441-c432b25bd2ac tempest-CreateVolumesFromImageTest-1798281502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:28:11 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-3d5eb4d0-9f43-4a62-b441-c432b25bd2ac tempest-CreateVolumesFromImageTest-1798281502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:11 devstack sudo[104876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:28:11 devstack sudo[104876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:11 devstack sudo[104876]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:11 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-3d5eb4d0-9f43-4a62-b441-c432b25bd2ac tempest-CreateVolumesFromImageTest-1798281502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.265s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:11 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-3d5eb4d0-9f43-4a62-b441-c432b25bd2ac tempest-CreateVolumesFromImageTest-1798281502 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:28:12 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-3d5eb4d0-9f43-4a62-b441-c432b25bd2ac tempest-CreateVolumesFromImageTest-1798281502 None] Deleted volume successfully. Aug 29 01:28:12 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-3d5eb4d0-9f43-4a62-b441-c432b25bd2ac tempest-CreateVolumesFromImageTest-1798281502 None] Lock "cinder-ededb4d8-7a7d-4324-b068-7447771a6388-delete_volume" released by "delete_volume" :: held 1.461s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:28:12 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-edd1751c-d130-4bd2-baeb-e4aa6ca69fd0 tempest-CreateVolumesFromImageTest-1798281502 None] Acquiring lock "cinder-713a362b-338f-4f21-a61c-096746c27a43-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:28:12 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-edd1751c-d130-4bd2-baeb-e4aa6ca69fd0 tempest-CreateVolumesFromImageTest-1798281502 None] Lock "cinder-713a362b-338f-4f21-a61c-096746c27a43-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:28:12 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-edd1751c-d130-4bd2-baeb-e4aa6ca69fd0 tempest-CreateVolumesFromImageTest-1798281502 None] Acquiring lock "cinder-quobyte-713a362b-338f-4f21-a61c-096746c27a43" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:28:12 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-edd1751c-d130-4bd2-baeb-e4aa6ca69fd0 tempest-CreateVolumesFromImageTest-1798281502 None] Lock "cinder-quobyte-713a362b-338f-4f21-a61c-096746c27a43" acquired by "delete_volume" :: waited 0.023s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:28:12 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[257d9b39-072a-44da-9ea9-681ca657234f]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:28:12 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-edd1751c-d130-4bd2-baeb-e4aa6ca69fd0 tempest-CreateVolumesFromImageTest-1798281502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-713a362b-338f-4f21-a61c-096746c27a43 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:13 devstack sudo[104879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-713a362b-338f-4f21-a61c-096746c27a43 Aug 29 01:28:13 devstack sudo[104879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:13 devstack sudo[104879]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:13 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-edd1751c-d130-4bd2-baeb-e4aa6ca69fd0 tempest-CreateVolumesFromImageTest-1798281502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-713a362b-338f-4f21-a61c-096746c27a43" returned: 0 in 0.495s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:13 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-edd1751c-d130-4bd2-baeb-e4aa6ca69fd0 tempest-CreateVolumesFromImageTest-1798281502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-713a362b-338f-4f21-a61c-096746c27a43 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:13 devstack sudo[104884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-713a362b-338f-4f21-a61c-096746c27a43 Aug 29 01:28:13 devstack sudo[104884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:13 devstack sudo[104884]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:13 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-edd1751c-d130-4bd2-baeb-e4aa6ca69fd0 tempest-CreateVolumesFromImageTest-1798281502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-713a362b-338f-4f21-a61c-096746c27a43" returned: 0 in 0.308s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:13 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-edd1751c-d130-4bd2-baeb-e4aa6ca69fd0 tempest-CreateVolumesFromImageTest-1798281502 None] Lock "cinder-quobyte-713a362b-338f-4f21-a61c-096746c27a43" released by "delete_volume" :: held 0.865s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:28:13 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-edd1751c-d130-4bd2-baeb-e4aa6ca69fd0 tempest-CreateVolumesFromImageTest-1798281502 None] Created reservations ['383ad79b-15fa-4e83-a7d0-4c0f3c3546a1', '1e13216d-7e19-4f5d-88bd-d142f5b3f670', 'f946dd00-2c87-4e2c-a8aa-c541331a6a59', '86d627aa-d150-4c0c-a948-ec3a99eff021'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:28:14 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-8139f19c-2783-4d2d-a555-a055b400a18c tempest-CinderUnicodeTest-1577663243 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:28:14 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-8139f19c-2783-4d2d-a555-a055b400a18c tempest-CinderUnicodeTest-1577663243 None] Flow 'volume_create_manager' (eaff1719-8500-4be9-a81f-ae182821aeff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:28:14 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-8139f19c-2783-4d2d-a555-a055b400a18c tempest-CinderUnicodeTest-1577663243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (887501fe-4011-4056-9c29-7f4beac6a08a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:28:14 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-8139f19c-2783-4d2d-a555-a055b400a18c tempest-CinderUnicodeTest-1577663243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (887501fe-4011-4056-9c29-7f4beac6a08a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:28:13Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=218c03fa-26df-4b44-b2e9-47a36656524a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='170818735d7d456e8ef6b91d3d0e4457',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:28:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:28:14Z,use_quota=True,user_id='5470718acc944290a202fe8f13e77210',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:28:14 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-8139f19c-2783-4d2d-a555-a055b400a18c tempest-CinderUnicodeTest-1577663243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80a3a37c-e173-4d9d-aeef-f1f8ac1c4be4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:28:14 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-8139f19c-2783-4d2d-a555-a055b400a18c tempest-CinderUnicodeTest-1577663243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80a3a37c-e173-4d9d-aeef-f1f8ac1c4be4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:28:14 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-8139f19c-2783-4d2d-a555-a055b400a18c tempest-CinderUnicodeTest-1577663243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1aa0add1-237f-4bf9-985a-841bcf56b236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:28:14 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-8139f19c-2783-4d2d-a555-a055b400a18c tempest-CinderUnicodeTest-1577663243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1aa0add1-237f-4bf9-985a-841bcf56b236) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '218c03fa-26df-4b44-b2e9-47a36656524a', 'volume_name': 'volume-218c03fa-26df-4b44-b2e9-47a36656524a', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:28:14 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-8139f19c-2783-4d2d-a555-a055b400a18c tempest-CinderUnicodeTest-1577663243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dea1b30b-f914-4d3d-bc9f-b78b3be920fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:28:14 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-8139f19c-2783-4d2d-a555-a055b400a18c tempest-CinderUnicodeTest-1577663243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dea1b30b-f914-4d3d-bc9f-b78b3be920fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:28:14 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-8139f19c-2783-4d2d-a555-a055b400a18c tempest-CinderUnicodeTest-1577663243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cd7368f-8f51-48b6-87a9-b68171aefc79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:28:14 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-8139f19c-2783-4d2d-a555-a055b400a18c tempest-CinderUnicodeTest-1577663243 None] Volume 218c03fa-26df-4b44-b2e9-47a36656524a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-218c03fa-26df-4b44-b2e9-47a36656524a', 'volume_size': 1} Aug 29 01:28:14 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-8139f19c-2783-4d2d-a555-a055b400a18c tempest-CinderUnicodeTest-1577663243 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:28:14 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-8139f19c-2783-4d2d-a555-a055b400a18c tempest-CinderUnicodeTest-1577663243 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:28:14 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-8139f19c-2783-4d2d-a555-a055b400a18c tempest-CinderUnicodeTest-1577663243 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:28:13Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=218c03fa-26df-4b44-b2e9-47a36656524a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='170818735d7d456e8ef6b91d3d0e4457',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:28:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:28:14Z,use_quota=True,user_id='5470718acc944290a202fe8f13e77210',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:28:14 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-8139f19c-2783-4d2d-a555-a055b400a18c tempest-CinderUnicodeTest-1577663243 None] Creating volume 218c03fa-26df-4b44-b2e9-47a36656524a {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:28:14 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-8139f19c-2783-4d2d-a555-a055b400a18c tempest-CinderUnicodeTest-1577663243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:28:14 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-8139f19c-2783-4d2d-a555-a055b400a18c tempest-CinderUnicodeTest-1577663243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:28:14 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-8139f19c-2783-4d2d-a555-a055b400a18c tempest-CinderUnicodeTest-1577663243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:28:14 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-8139f19c-2783-4d2d-a555-a055b400a18c tempest-CinderUnicodeTest-1577663243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:28:14 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-8139f19c-2783-4d2d-a555-a055b400a18c tempest-CinderUnicodeTest-1577663243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:28:14 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-8139f19c-2783-4d2d-a555-a055b400a18c tempest-CinderUnicodeTest-1577663243 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:28:14 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-8139f19c-2783-4d2d-a555-a055b400a18c tempest-CinderUnicodeTest-1577663243 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:28:14 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8139f19c-2783-4d2d-a555-a055b400a18c tempest-CinderUnicodeTest-1577663243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-218c03fa-26df-4b44-b2e9-47a36656524a 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:14 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-d864a184-2cf1-4c17-8fe7-c566fc4a9539 tempest-CreateVolumesFromImageTest-1798281502 None] Acquiring lock "cinder-5f4a41ce-b6ce-42bd-953e-1f4aa8ee6e79-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:28:14 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-edd1751c-d130-4bd2-baeb-e4aa6ca69fd0 tempest-CreateVolumesFromImageTest-1798281502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:28:14 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-edd1751c-d130-4bd2-baeb-e4aa6ca69fd0 tempest-CreateVolumesFromImageTest-1798281502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:28:14 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-edd1751c-d130-4bd2-baeb-e4aa6ca69fd0 tempest-CreateVolumesFromImageTest-1798281502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:28:14 devstack sudo[104887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-218c03fa-26df-4b44-b2e9-47a36656524a 1073741824 Aug 29 01:28:14 devstack sudo[104887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:14 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-edd1751c-d130-4bd2-baeb-e4aa6ca69fd0 tempest-CreateVolumesFromImageTest-1798281502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:28:14 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-edd1751c-d130-4bd2-baeb-e4aa6ca69fd0 tempest-CreateVolumesFromImageTest-1798281502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:28:14 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-edd1751c-d130-4bd2-baeb-e4aa6ca69fd0 tempest-CreateVolumesFromImageTest-1798281502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:14 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-d864a184-2cf1-4c17-8fe7-c566fc4a9539 tempest-CreateVolumesFromImageTest-1798281502 None] Lock "cinder-5f4a41ce-b6ce-42bd-953e-1f4aa8ee6e79-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:28:14 devstack sudo[104889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:28:14 devstack sudo[104889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:14 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-d864a184-2cf1-4c17-8fe7-c566fc4a9539 tempest-CreateVolumesFromImageTest-1798281502 None] Acquiring lock "cinder-quobyte-5f4a41ce-b6ce-42bd-953e-1f4aa8ee6e79" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:28:14 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-d864a184-2cf1-4c17-8fe7-c566fc4a9539 tempest-CreateVolumesFromImageTest-1798281502 None] Lock "cinder-quobyte-5f4a41ce-b6ce-42bd-953e-1f4aa8ee6e79" acquired by "delete_volume" :: waited 0.025s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:28:14 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[38a4d655-4e54-486e-82f1-6e0ae7495fb9]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:28:14 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d864a184-2cf1-4c17-8fe7-c566fc4a9539 tempest-CreateVolumesFromImageTest-1798281502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-5f4a41ce-b6ce-42bd-953e-1f4aa8ee6e79 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:14 devstack sudo[104891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-5f4a41ce-b6ce-42bd-953e-1f4aa8ee6e79 Aug 29 01:28:14 devstack sudo[104891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:14 devstack sudo[104889]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:14 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-edd1751c-d130-4bd2-baeb-e4aa6ca69fd0 tempest-CreateVolumesFromImageTest-1798281502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.430s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:14 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-edd1751c-d130-4bd2-baeb-e4aa6ca69fd0 tempest-CreateVolumesFromImageTest-1798281502 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:28:14 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-edd1751c-d130-4bd2-baeb-e4aa6ca69fd0 tempest-CreateVolumesFromImageTest-1798281502 None] Deleted volume successfully. Aug 29 01:28:14 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-edd1751c-d130-4bd2-baeb-e4aa6ca69fd0 tempest-CreateVolumesFromImageTest-1798281502 None] Lock "cinder-713a362b-338f-4f21-a61c-096746c27a43-delete_volume" released by "delete_volume" :: held 1.834s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:28:14 devstack sudo[104887]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:14 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8139f19c-2783-4d2d-a555-a055b400a18c tempest-CinderUnicodeTest-1577663243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-218c03fa-26df-4b44-b2e9-47a36656524a 1073741824" returned: 0 in 0.632s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:14 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8139f19c-2783-4d2d-a555-a055b400a18c tempest-CinderUnicodeTest-1577663243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-218c03fa-26df-4b44-b2e9-47a36656524a {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:14 devstack sudo[104900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-218c03fa-26df-4b44-b2e9-47a36656524a Aug 29 01:28:14 devstack sudo[104900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:14 devstack sudo[104891]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:14 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d864a184-2cf1-4c17-8fe7-c566fc4a9539 tempest-CreateVolumesFromImageTest-1798281502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-5f4a41ce-b6ce-42bd-953e-1f4aa8ee6e79" returned: 0 in 0.524s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:14 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d864a184-2cf1-4c17-8fe7-c566fc4a9539 tempest-CreateVolumesFromImageTest-1798281502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-5f4a41ce-b6ce-42bd-953e-1f4aa8ee6e79 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:14 devstack sudo[104904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-5f4a41ce-b6ce-42bd-953e-1f4aa8ee6e79 Aug 29 01:28:14 devstack sudo[104904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:15 devstack sudo[104900]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:15 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8139f19c-2783-4d2d-a555-a055b400a18c tempest-CinderUnicodeTest-1577663243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-218c03fa-26df-4b44-b2e9-47a36656524a" returned: 0 in 0.296s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:15 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-8139f19c-2783-4d2d-a555-a055b400a18c tempest-CinderUnicodeTest-1577663243 None] <== create_volume: return (1014ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:28:15 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-8139f19c-2783-4d2d-a555-a055b400a18c tempest-CinderUnicodeTest-1577663243 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.018s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:28:15 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-8139f19c-2783-4d2d-a555-a055b400a18c tempest-CinderUnicodeTest-1577663243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cd7368f-8f51-48b6-87a9-b68171aefc79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-218c03fa-26df-4b44-b2e9-47a36656524a', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:28:15 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-8139f19c-2783-4d2d-a555-a055b400a18c tempest-CinderUnicodeTest-1577663243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47e64de9-3f95-40cf-931d-ea91f1292034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:28:15 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-8139f19c-2783-4d2d-a555-a055b400a18c tempest-CinderUnicodeTest-1577663243 None] Volume volume-218c03fa-26df-4b44-b2e9-47a36656524a (218c03fa-26df-4b44-b2e9-47a36656524a): created successfully Aug 29 01:28:15 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-8139f19c-2783-4d2d-a555-a055b400a18c tempest-CinderUnicodeTest-1577663243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47e64de9-3f95-40cf-931d-ea91f1292034) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:28:15 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-8139f19c-2783-4d2d-a555-a055b400a18c tempest-CinderUnicodeTest-1577663243 None] Flow 'volume_create_manager' (eaff1719-8500-4be9-a81f-ae182821aeff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:28:15 devstack sudo[104904]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:15 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d864a184-2cf1-4c17-8fe7-c566fc4a9539 tempest-CreateVolumesFromImageTest-1798281502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-5f4a41ce-b6ce-42bd-953e-1f4aa8ee6e79" returned: 0 in 0.290s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:15 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-d864a184-2cf1-4c17-8fe7-c566fc4a9539 tempest-CreateVolumesFromImageTest-1798281502 None] Lock "cinder-quobyte-5f4a41ce-b6ce-42bd-953e-1f4aa8ee6e79" released by "delete_volume" :: held 0.879s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:28:15 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-8139f19c-2783-4d2d-a555-a055b400a18c tempest-CinderUnicodeTest-1577663243 None] Created volume successfully. Aug 29 01:28:15 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-d864a184-2cf1-4c17-8fe7-c566fc4a9539 tempest-CreateVolumesFromImageTest-1798281502 None] Created reservations ['8601a161-b0ad-4bdf-acd7-4e1373450667', '51251bce-7b6c-4223-b947-691eee2666e0', '1b5f7634-28ec-4089-9fdd-8d554e5e7529', 'c13296a1-be3b-4348-b054-ed5876c14fc8'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:28:15 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-d864a184-2cf1-4c17-8fe7-c566fc4a9539 tempest-CreateVolumesFromImageTest-1798281502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:28:15 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-d864a184-2cf1-4c17-8fe7-c566fc4a9539 tempest-CreateVolumesFromImageTest-1798281502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:28:15 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-d864a184-2cf1-4c17-8fe7-c566fc4a9539 tempest-CreateVolumesFromImageTest-1798281502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:28:15 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-d864a184-2cf1-4c17-8fe7-c566fc4a9539 tempest-CreateVolumesFromImageTest-1798281502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:28:15 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-d864a184-2cf1-4c17-8fe7-c566fc4a9539 tempest-CreateVolumesFromImageTest-1798281502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:28:15 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d864a184-2cf1-4c17-8fe7-c566fc4a9539 tempest-CreateVolumesFromImageTest-1798281502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:15 devstack sudo[104908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:28:15 devstack sudo[104908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:15 devstack sudo[104908]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:15 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d864a184-2cf1-4c17-8fe7-c566fc4a9539 tempest-CreateVolumesFromImageTest-1798281502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.267s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:15 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-d864a184-2cf1-4c17-8fe7-c566fc4a9539 tempest-CreateVolumesFromImageTest-1798281502 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:28:15 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-d864a184-2cf1-4c17-8fe7-c566fc4a9539 tempest-CreateVolumesFromImageTest-1798281502 None] Deleted volume successfully. Aug 29 01:28:15 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-d864a184-2cf1-4c17-8fe7-c566fc4a9539 tempest-CreateVolumesFromImageTest-1798281502 None] Lock "cinder-5f4a41ce-b6ce-42bd-953e-1f4aa8ee6e79-delete_volume" released by "delete_volume" :: held 1.444s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:28:16 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-4ec848e5-db9c-4fc1-8905-e64fba4d3905 tempest-CreateVolumesFromImageTest-1798281502 None] Acquiring lock "cinder-f486edac-6ea8-409f-854a-37aec731e5ac-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:28:16 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-4ec848e5-db9c-4fc1-8905-e64fba4d3905 tempest-CreateVolumesFromImageTest-1798281502 None] Lock "cinder-f486edac-6ea8-409f-854a-37aec731e5ac-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:28:16 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-4ec848e5-db9c-4fc1-8905-e64fba4d3905 tempest-CreateVolumesFromImageTest-1798281502 None] Acquiring lock "cinder-quobyte-f486edac-6ea8-409f-854a-37aec731e5ac" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:28:16 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-4ec848e5-db9c-4fc1-8905-e64fba4d3905 tempest-CreateVolumesFromImageTest-1798281502 None] Lock "cinder-quobyte-f486edac-6ea8-409f-854a-37aec731e5ac" acquired by "delete_volume" :: waited 0.019s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:28:16 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-440d73f2-0795-478e-bb20-944d823af41e tempest-ProjectAdminTests-1075356915 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.433609008789, 'free_capacity_gb': 1774.433609008789, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86111) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Aug 29 01:28:16 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[832e12d4-8d2b-4bf2-afae-6c4635a5673f]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:28:16 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-4ec848e5-db9c-4fc1-8905-e64fba4d3905 tempest-CreateVolumesFromImageTest-1798281502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-f486edac-6ea8-409f-854a-37aec731e5ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:16 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab25b5cf-dad9-46bf-a136-0204721b3a30 tempest-CinderUnicodeTest-1577663243 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:28:16 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-ab25b5cf-dad9-46bf-a136-0204721b3a30 tempest-CinderUnicodeTest-1577663243 None] Flow 'volume_create_manager' (446742fe-d5b1-48a7-ab55-e7f86a2cc314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:28:16 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-ab25b5cf-dad9-46bf-a136-0204721b3a30 tempest-CinderUnicodeTest-1577663243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d36482d3-8c2b-42da-84a7-5e6cee227b52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:28:16 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-ab25b5cf-dad9-46bf-a136-0204721b3a30 tempest-CinderUnicodeTest-1577663243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d36482d3-8c2b-42da-84a7-5e6cee227b52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:28:16Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1839524077',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=146cda44-cf9a-4618-a6e7-8f3b6fae24c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='170818735d7d456e8ef6b91d3d0e4457',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:28:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:28:17Z,use_quota=True,user_id='5470718acc944290a202fe8f13e77210',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:28:16 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-ab25b5cf-dad9-46bf-a136-0204721b3a30 tempest-CinderUnicodeTest-1577663243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1631f69e-2877-48b8-8ea7-e31943cc31aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:28:16 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-ab25b5cf-dad9-46bf-a136-0204721b3a30 tempest-CinderUnicodeTest-1577663243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1631f69e-2877-48b8-8ea7-e31943cc31aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:28:16 devstack sudo[104911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-f486edac-6ea8-409f-854a-37aec731e5ac Aug 29 01:28:16 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-ab25b5cf-dad9-46bf-a136-0204721b3a30 tempest-CinderUnicodeTest-1577663243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1934fceb-3dab-4b35-8128-3fcb5ef799f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:28:16 devstack sudo[104911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:16 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-ab25b5cf-dad9-46bf-a136-0204721b3a30 tempest-CinderUnicodeTest-1577663243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1934fceb-3dab-4b35-8128-3fcb5ef799f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '146cda44-cf9a-4618-a6e7-8f3b6fae24c3', 'volume_name': 'volume-146cda44-cf9a-4618-a6e7-8f3b6fae24c3', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:28:16 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-ab25b5cf-dad9-46bf-a136-0204721b3a30 tempest-CinderUnicodeTest-1577663243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2855bf6-1fd5-4f39-ac96-1b26ccb83f08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:28:16 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-ab25b5cf-dad9-46bf-a136-0204721b3a30 tempest-CinderUnicodeTest-1577663243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2855bf6-1fd5-4f39-ac96-1b26ccb83f08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:28:16 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-ab25b5cf-dad9-46bf-a136-0204721b3a30 tempest-CinderUnicodeTest-1577663243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1acb4104-426a-49b8-a6fa-b2baa76d2d03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:28:16 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-ab25b5cf-dad9-46bf-a136-0204721b3a30 tempest-CinderUnicodeTest-1577663243 None] Volume 146cda44-cf9a-4618-a6e7-8f3b6fae24c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-146cda44-cf9a-4618-a6e7-8f3b6fae24c3', 'volume_size': 1} Aug 29 01:28:16 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-ab25b5cf-dad9-46bf-a136-0204721b3a30 tempest-CinderUnicodeTest-1577663243 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:28:16 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-ab25b5cf-dad9-46bf-a136-0204721b3a30 tempest-CinderUnicodeTest-1577663243 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:28:16 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-ab25b5cf-dad9-46bf-a136-0204721b3a30 tempest-CinderUnicodeTest-1577663243 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:28:16Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1839524077',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=146cda44-cf9a-4618-a6e7-8f3b6fae24c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='170818735d7d456e8ef6b91d3d0e4457',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:28:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:28:17Z,use_quota=True,user_id='5470718acc944290a202fe8f13e77210',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:28:16 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-ab25b5cf-dad9-46bf-a136-0204721b3a30 tempest-CinderUnicodeTest-1577663243 None] Creating volume 146cda44-cf9a-4618-a6e7-8f3b6fae24c3 {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:28:16 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-ab25b5cf-dad9-46bf-a136-0204721b3a30 tempest-CinderUnicodeTest-1577663243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:28:16 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-ab25b5cf-dad9-46bf-a136-0204721b3a30 tempest-CinderUnicodeTest-1577663243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:28:16 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-ab25b5cf-dad9-46bf-a136-0204721b3a30 tempest-CinderUnicodeTest-1577663243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:28:16 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-ab25b5cf-dad9-46bf-a136-0204721b3a30 tempest-CinderUnicodeTest-1577663243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:28:16 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-ab25b5cf-dad9-46bf-a136-0204721b3a30 tempest-CinderUnicodeTest-1577663243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:28:16 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-ab25b5cf-dad9-46bf-a136-0204721b3a30 tempest-CinderUnicodeTest-1577663243 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:28:16 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-ab25b5cf-dad9-46bf-a136-0204721b3a30 tempest-CinderUnicodeTest-1577663243 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:28:16 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-ab25b5cf-dad9-46bf-a136-0204721b3a30 tempest-CinderUnicodeTest-1577663243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-146cda44-cf9a-4618-a6e7-8f3b6fae24c3 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:16 devstack sudo[104913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-146cda44-cf9a-4618-a6e7-8f3b6fae24c3 1073741824 Aug 29 01:28:16 devstack sudo[104913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:17 devstack sudo[104911]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:17 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-4ec848e5-db9c-4fc1-8905-e64fba4d3905 tempest-CreateVolumesFromImageTest-1798281502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-f486edac-6ea8-409f-854a-37aec731e5ac" returned: 0 in 0.425s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:17 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-4ec848e5-db9c-4fc1-8905-e64fba4d3905 tempest-CreateVolumesFromImageTest-1798281502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-f486edac-6ea8-409f-854a-37aec731e5ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:17 devstack sudo[104920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-f486edac-6ea8-409f-854a-37aec731e5ac Aug 29 01:28:17 devstack sudo[104920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:17 devstack sudo[104913]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:17 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-ab25b5cf-dad9-46bf-a136-0204721b3a30 tempest-CinderUnicodeTest-1577663243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-146cda44-cf9a-4618-a6e7-8f3b6fae24c3 1073741824" returned: 0 in 0.525s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:17 devstack sudo[104920]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:17 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-4ec848e5-db9c-4fc1-8905-e64fba4d3905 tempest-CreateVolumesFromImageTest-1798281502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-f486edac-6ea8-409f-854a-37aec731e5ac" returned: 0 in 0.296s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:17 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-4ec848e5-db9c-4fc1-8905-e64fba4d3905 tempest-CreateVolumesFromImageTest-1798281502 None] Lock "cinder-quobyte-f486edac-6ea8-409f-854a-37aec731e5ac" released by "delete_volume" :: held 0.784s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:28:17 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-ab25b5cf-dad9-46bf-a136-0204721b3a30 tempest-CinderUnicodeTest-1577663243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-146cda44-cf9a-4618-a6e7-8f3b6fae24c3 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:17 devstack sudo[104925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-146cda44-cf9a-4618-a6e7-8f3b6fae24c3 Aug 29 01:28:17 devstack sudo[104925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:17 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-4ec848e5-db9c-4fc1-8905-e64fba4d3905 tempest-CreateVolumesFromImageTest-1798281502 None] Created reservations ['379941e7-3d49-4b29-b60e-ce5232f859d2', '4be6e39b-f7a0-4b50-83db-dcdb9e108da0', '2c0ffbcb-24c8-4f0b-89ed-bb64bdb481e0', '77793e4a-bc97-40de-9828-3605d04e9a6b'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:28:17 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-4ec848e5-db9c-4fc1-8905-e64fba4d3905 tempest-CreateVolumesFromImageTest-1798281502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:28:17 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-4ec848e5-db9c-4fc1-8905-e64fba4d3905 tempest-CreateVolumesFromImageTest-1798281502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:28:17 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-4ec848e5-db9c-4fc1-8905-e64fba4d3905 tempest-CreateVolumesFromImageTest-1798281502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:28:17 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-4ec848e5-db9c-4fc1-8905-e64fba4d3905 tempest-CreateVolumesFromImageTest-1798281502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:28:17 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-4ec848e5-db9c-4fc1-8905-e64fba4d3905 tempest-CreateVolumesFromImageTest-1798281502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:28:17 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-4ec848e5-db9c-4fc1-8905-e64fba4d3905 tempest-CreateVolumesFromImageTest-1798281502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:17 devstack sudo[104927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:28:17 devstack sudo[104927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:17 devstack sudo[104925]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:17 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-ab25b5cf-dad9-46bf-a136-0204721b3a30 tempest-CinderUnicodeTest-1577663243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-146cda44-cf9a-4618-a6e7-8f3b6fae24c3" returned: 0 in 0.420s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:17 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-ab25b5cf-dad9-46bf-a136-0204721b3a30 tempest-CinderUnicodeTest-1577663243 None] <== create_volume: return (1029ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:28:17 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-ab25b5cf-dad9-46bf-a136-0204721b3a30 tempest-CinderUnicodeTest-1577663243 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.032s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:28:17 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-ab25b5cf-dad9-46bf-a136-0204721b3a30 tempest-CinderUnicodeTest-1577663243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1acb4104-426a-49b8-a6fa-b2baa76d2d03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-146cda44-cf9a-4618-a6e7-8f3b6fae24c3', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:28:17 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-ab25b5cf-dad9-46bf-a136-0204721b3a30 tempest-CinderUnicodeTest-1577663243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10e43aa6-141d-4fb3-87f2-c1f2da532f50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:28:17 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-ab25b5cf-dad9-46bf-a136-0204721b3a30 tempest-CinderUnicodeTest-1577663243 None] Volume volume-146cda44-cf9a-4618-a6e7-8f3b6fae24c3 (146cda44-cf9a-4618-a6e7-8f3b6fae24c3): created successfully Aug 29 01:28:17 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-ab25b5cf-dad9-46bf-a136-0204721b3a30 tempest-CinderUnicodeTest-1577663243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10e43aa6-141d-4fb3-87f2-c1f2da532f50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:28:17 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-ab25b5cf-dad9-46bf-a136-0204721b3a30 tempest-CinderUnicodeTest-1577663243 None] Flow 'volume_create_manager' (446742fe-d5b1-48a7-ab55-e7f86a2cc314) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:28:17 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-ab25b5cf-dad9-46bf-a136-0204721b3a30 tempest-CinderUnicodeTest-1577663243 None] Created volume successfully. Aug 29 01:28:18 devstack sudo[104927]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:18 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-4ec848e5-db9c-4fc1-8905-e64fba4d3905 tempest-CreateVolumesFromImageTest-1798281502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.480s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:18 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-4ec848e5-db9c-4fc1-8905-e64fba4d3905 tempest-CreateVolumesFromImageTest-1798281502 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:28:18 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-4ec848e5-db9c-4fc1-8905-e64fba4d3905 tempest-CreateVolumesFromImageTest-1798281502 None] Deleted volume successfully. Aug 29 01:28:18 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-4ec848e5-db9c-4fc1-8905-e64fba4d3905 tempest-CreateVolumesFromImageTest-1798281502 None] Lock "cinder-f486edac-6ea8-409f-854a-37aec731e5ac-delete_volume" released by "delete_volume" :: held 1.564s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:28:19 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-5e4e2957-04f9-40bf-a454-9a90e1426de6 tempest-CinderUnicodeTest-1577663243 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:28:19 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-5e4e2957-04f9-40bf-a454-9a90e1426de6 tempest-CinderUnicodeTest-1577663243 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:28:19 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-5e4e2957-04f9-40bf-a454-9a90e1426de6 tempest-CinderUnicodeTest-1577663243 None] Creating offline snapshot a33dd968-fea3-48fb-9453-52f39d615700 of volume 146cda44-cf9a-4618-a6e7-8f3b6fae24c3 {{(pid=86111) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 29 01:28:19 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac6c5e49-5154-4643-ac17-7dce8edae516]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:28:19 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-5e4e2957-04f9-40bf-a454-9a90e1426de6 tempest-CinderUnicodeTest-1577663243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-146cda44-cf9a-4618-a6e7-8f3b6fae24c3 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:19 devstack sudo[104931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-146cda44-cf9a-4618-a6e7-8f3b6fae24c3 Aug 29 01:28:19 devstack sudo[104931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:19 devstack sudo[104931]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:19 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-5e4e2957-04f9-40bf-a454-9a90e1426de6 tempest-CinderUnicodeTest-1577663243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-146cda44-cf9a-4618-a6e7-8f3b6fae24c3" returned: 0 in 0.492s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:19 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-5e4e2957-04f9-40bf-a454-9a90e1426de6 tempest-CinderUnicodeTest-1577663243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-146cda44-cf9a-4618-a6e7-8f3b6fae24c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-146cda44-cf9a-4618-a6e7-8f3b6fae24c3.a33dd968-fea3-48fb-9453-52f39d615700 1G {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:19 devstack sudo[104937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-146cda44-cf9a-4618-a6e7-8f3b6fae24c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-146cda44-cf9a-4618-a6e7-8f3b6fae24c3.a33dd968-fea3-48fb-9453-52f39d615700 1G Aug 29 01:28:19 devstack sudo[104937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:20 devstack sudo[104937]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:20 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-5e4e2957-04f9-40bf-a454-9a90e1426de6 tempest-CinderUnicodeTest-1577663243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-146cda44-cf9a-4618-a6e7-8f3b6fae24c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-146cda44-cf9a-4618-a6e7-8f3b6fae24c3.a33dd968-fea3-48fb-9453-52f39d615700 1G" returned: 0 in 0.583s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:20 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-5e4e2957-04f9-40bf-a454-9a90e1426de6 tempest-CinderUnicodeTest-1577663243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-146cda44-cf9a-4618-a6e7-8f3b6fae24c3 -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-146cda44-cf9a-4618-a6e7-8f3b6fae24c3.a33dd968-fea3-48fb-9453-52f39d615700 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:20 devstack sudo[104943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-146cda44-cf9a-4618-a6e7-8f3b6fae24c3 -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-146cda44-cf9a-4618-a6e7-8f3b6fae24c3.a33dd968-fea3-48fb-9453-52f39d615700 Aug 29 01:28:20 devstack sudo[104943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:20 devstack sudo[104943]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:20 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-5e4e2957-04f9-40bf-a454-9a90e1426de6 tempest-CinderUnicodeTest-1577663243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-146cda44-cf9a-4618-a6e7-8f3b6fae24c3 -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-146cda44-cf9a-4618-a6e7-8f3b6fae24c3.a33dd968-fea3-48fb-9453-52f39d615700" returned: 0 in 0.364s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:20 devstack cinder-volume[86111]: WARNING cinder.volume.drivers.remotefs [None req-5e4e2957-04f9-40bf-a454-9a90e1426de6 tempest-CinderUnicodeTest-1577663243 None] /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-146cda44-cf9a-4618-a6e7-8f3b6fae24c3.a33dd968-fea3-48fb-9453-52f39d615700 is being set with open permissions: ugo+rw Aug 29 01:28:20 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-5e4e2957-04f9-40bf-a454-9a90e1426de6 tempest-CinderUnicodeTest-1577663243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-146cda44-cf9a-4618-a6e7-8f3b6fae24c3.a33dd968-fea3-48fb-9453-52f39d615700 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:20 devstack sudo[104949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-146cda44-cf9a-4618-a6e7-8f3b6fae24c3.a33dd968-fea3-48fb-9453-52f39d615700 Aug 29 01:28:20 devstack sudo[104949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:20 devstack sudo[104949]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:20 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-5e4e2957-04f9-40bf-a454-9a90e1426de6 tempest-CinderUnicodeTest-1577663243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-146cda44-cf9a-4618-a6e7-8f3b6fae24c3.a33dd968-fea3-48fb-9453-52f39d615700" returned: 0 in 0.242s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:20 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-5e4e2957-04f9-40bf-a454-9a90e1426de6 tempest-CinderUnicodeTest-1577663243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-146cda44-cf9a-4618-a6e7-8f3b6fae24c3.info {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:20 devstack sudo[104952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-146cda44-cf9a-4618-a6e7-8f3b6fae24c3.info Aug 29 01:28:20 devstack sudo[104952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:21 devstack sudo[104952]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:21 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-5e4e2957-04f9-40bf-a454-9a90e1426de6 tempest-CinderUnicodeTest-1577663243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-146cda44-cf9a-4618-a6e7-8f3b6fae24c3.info" returned: 0 in 0.285s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:21 devstack cinder-volume[86111]: WARNING cinder.volume.drivers.remotefs [None req-5e4e2957-04f9-40bf-a454-9a90e1426de6 tempest-CinderUnicodeTest-1577663243 None] /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-146cda44-cf9a-4618-a6e7-8f3b6fae24c3.info is being set with open permissions: ugo+rw Aug 29 01:28:21 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-5e4e2957-04f9-40bf-a454-9a90e1426de6 tempest-CinderUnicodeTest-1577663243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-146cda44-cf9a-4618-a6e7-8f3b6fae24c3.info {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:21 devstack sudo[104955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-146cda44-cf9a-4618-a6e7-8f3b6fae24c3.info Aug 29 01:28:21 devstack sudo[104955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:21 devstack sudo[104955]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:21 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-5e4e2957-04f9-40bf-a454-9a90e1426de6 tempest-CinderUnicodeTest-1577663243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-146cda44-cf9a-4618-a6e7-8f3b6fae24c3.info" returned: 0 in 0.351s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:21 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-5e4e2957-04f9-40bf-a454-9a90e1426de6 tempest-CinderUnicodeTest-1577663243 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.425s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:28:21 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-126b0ca9-ec6e-4486-a964-7b934fecc88b tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:28:21 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-126b0ca9-ec6e-4486-a964-7b934fecc88b tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Flow 'volume_create_manager' (8afe2ecf-77f6-4452-8ad8-d0a522251705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:28:21 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-126b0ca9-ec6e-4486-a964-7b934fecc88b tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85b24672-e2d8-44db-970d-1aee9702990e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:28:21 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-5e4e2957-04f9-40bf-a454-9a90e1426de6 tempest-CinderUnicodeTest-1577663243 None] Create snapshot completed successfully Aug 29 01:28:21 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-126b0ca9-ec6e-4486-a964-7b934fecc88b tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85b24672-e2d8-44db-970d-1aee9702990e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:28:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-428748766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e646040-b24b-49fa-ac8c-6a09d730eb7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b381a421a763410f95aaa499f5f64c5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:28:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:28:21Z,use_quota=True,user_id='bb10b91622c34f3f99dc2b2eb6040084',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:28:21 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-126b0ca9-ec6e-4486-a964-7b934fecc88b tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ecbcdfa-3351-4e96-abd2-59841a35432d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:28:21 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-126b0ca9-ec6e-4486-a964-7b934fecc88b tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ecbcdfa-3351-4e96-abd2-59841a35432d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:28:21 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-126b0ca9-ec6e-4486-a964-7b934fecc88b tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0befd238-340c-4644-83b2-a28c8d2ddc09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:28:21 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-126b0ca9-ec6e-4486-a964-7b934fecc88b tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0befd238-340c-4644-83b2-a28c8d2ddc09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e646040-b24b-49fa-ac8c-6a09d730eb7a', 'volume_name': 'volume-8e646040-b24b-49fa-ac8c-6a09d730eb7a', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:28:21 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-126b0ca9-ec6e-4486-a964-7b934fecc88b tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc32e67d-0457-4cc6-9f8a-8047c4233599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:28:21 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-126b0ca9-ec6e-4486-a964-7b934fecc88b tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc32e67d-0457-4cc6-9f8a-8047c4233599) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:28:21 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-126b0ca9-ec6e-4486-a964-7b934fecc88b tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7923e995-def3-4b36-bbe9-e60c34c8f4fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:28:21 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-126b0ca9-ec6e-4486-a964-7b934fecc88b tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Volume 8e646040-b24b-49fa-ac8c-6a09d730eb7a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e646040-b24b-49fa-ac8c-6a09d730eb7a', 'volume_size': 1} Aug 29 01:28:21 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-126b0ca9-ec6e-4486-a964-7b934fecc88b tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:28:21 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-126b0ca9-ec6e-4486-a964-7b934fecc88b tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:28:21 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-126b0ca9-ec6e-4486-a964-7b934fecc88b tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:28:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-428748766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e646040-b24b-49fa-ac8c-6a09d730eb7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b381a421a763410f95aaa499f5f64c5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:28:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:28:21Z,use_quota=True,user_id='bb10b91622c34f3f99dc2b2eb6040084',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:28:21 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-126b0ca9-ec6e-4486-a964-7b934fecc88b tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Creating volume 8e646040-b24b-49fa-ac8c-6a09d730eb7a {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:28:21 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-126b0ca9-ec6e-4486-a964-7b934fecc88b tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:28:21 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-126b0ca9-ec6e-4486-a964-7b934fecc88b tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:28:21 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-126b0ca9-ec6e-4486-a964-7b934fecc88b tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:28:21 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-126b0ca9-ec6e-4486-a964-7b934fecc88b tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:28:21 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-126b0ca9-ec6e-4486-a964-7b934fecc88b tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:28:21 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-126b0ca9-ec6e-4486-a964-7b934fecc88b tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:28:21 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-126b0ca9-ec6e-4486-a964-7b934fecc88b tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:28:21 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-126b0ca9-ec6e-4486-a964-7b934fecc88b tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-8e646040-b24b-49fa-ac8c-6a09d730eb7a 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:21 devstack sudo[104958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-8e646040-b24b-49fa-ac8c-6a09d730eb7a 1073741824 Aug 29 01:28:21 devstack sudo[104958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:22 devstack sudo[104958]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:22 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-126b0ca9-ec6e-4486-a964-7b934fecc88b tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-8e646040-b24b-49fa-ac8c-6a09d730eb7a 1073741824" returned: 0 in 0.471s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:22 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-126b0ca9-ec6e-4486-a964-7b934fecc88b tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-8e646040-b24b-49fa-ac8c-6a09d730eb7a {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:22 devstack sudo[104965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-8e646040-b24b-49fa-ac8c-6a09d730eb7a Aug 29 01:28:22 devstack sudo[104965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:22 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-c7023b23-b59c-4921-b8f6-9d3732081d50 tempest-CinderUnicodeTest-1577663243 None] Acquiring lock "cinder-a33dd968-fea3-48fb-9453-52f39d615700-delete_snapshot" by "delete_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:28:22 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-c7023b23-b59c-4921-b8f6-9d3732081d50 tempest-CinderUnicodeTest-1577663243 None] Lock "cinder-a33dd968-fea3-48fb-9453-52f39d615700-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:28:22 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-c7023b23-b59c-4921-b8f6-9d3732081d50 tempest-CinderUnicodeTest-1577663243 None] Acquiring lock "cinder-quobyte-146cda44-cf9a-4618-a6e7-8f3b6fae24c3" by "delete_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:28:22 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-c7023b23-b59c-4921-b8f6-9d3732081d50 tempest-CinderUnicodeTest-1577663243 None] Lock "cinder-quobyte-146cda44-cf9a-4618-a6e7-8f3b6fae24c3" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:28:22 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-c7023b23-b59c-4921-b8f6-9d3732081d50 tempest-CinderUnicodeTest-1577663243 None] Acquiring lock "cinder-quobyte-a33dd968-fea3-48fb-9453-52f39d615700" by "_delete_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:28:22 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-c7023b23-b59c-4921-b8f6-9d3732081d50 tempest-CinderUnicodeTest-1577663243 None] Lock "cinder-quobyte-a33dd968-fea3-48fb-9453-52f39d615700" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:28:22 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-c7023b23-b59c-4921-b8f6-9d3732081d50 tempest-CinderUnicodeTest-1577663243 None] Deleting offline snapshot a33dd968-fea3-48fb-9453-52f39d615700 of volume 146cda44-cf9a-4618-a6e7-8f3b6fae24c3 {{(pid=86111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 29 01:28:22 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-c7023b23-b59c-4921-b8f6-9d3732081d50 tempest-CinderUnicodeTest-1577663243 None] snapshot_file for this snap is: volume-146cda44-cf9a-4618-a6e7-8f3b6fae24c3.a33dd968-fea3-48fb-9453-52f39d615700 {{(pid=86111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 29 01:28:22 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[d98a5994-4194-4e5b-bb40-fff11847a898]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:28:22 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c7023b23-b59c-4921-b8f6-9d3732081d50 tempest-CinderUnicodeTest-1577663243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-146cda44-cf9a-4618-a6e7-8f3b6fae24c3.a33dd968-fea3-48fb-9453-52f39d615700 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:22 devstack sudo[104965]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:22 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-126b0ca9-ec6e-4486-a964-7b934fecc88b tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-8e646040-b24b-49fa-ac8c-6a09d730eb7a" returned: 0 in 0.361s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:22 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-126b0ca9-ec6e-4486-a964-7b934fecc88b tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] <== create_volume: return (878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:28:22 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-126b0ca9-ec6e-4486-a964-7b934fecc88b tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.880s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:28:22 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-126b0ca9-ec6e-4486-a964-7b934fecc88b tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7923e995-def3-4b36-bbe9-e60c34c8f4fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e646040-b24b-49fa-ac8c-6a09d730eb7a', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:28:22 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-126b0ca9-ec6e-4486-a964-7b934fecc88b tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad74cab8-b526-44b6-8c18-08b24cc78b97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:28:22 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-126b0ca9-ec6e-4486-a964-7b934fecc88b tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Volume volume-8e646040-b24b-49fa-ac8c-6a09d730eb7a (8e646040-b24b-49fa-ac8c-6a09d730eb7a): created successfully Aug 29 01:28:22 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-126b0ca9-ec6e-4486-a964-7b934fecc88b tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad74cab8-b526-44b6-8c18-08b24cc78b97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:28:22 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-126b0ca9-ec6e-4486-a964-7b934fecc88b tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Flow 'volume_create_manager' (8afe2ecf-77f6-4452-8ad8-d0a522251705) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:28:22 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-126b0ca9-ec6e-4486-a964-7b934fecc88b tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Created volume successfully. Aug 29 01:28:22 devstack sudo[104968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-146cda44-cf9a-4618-a6e7-8f3b6fae24c3.a33dd968-fea3-48fb-9453-52f39d615700 Aug 29 01:28:22 devstack sudo[104968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:22 devstack sudo[104968]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:22 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c7023b23-b59c-4921-b8f6-9d3732081d50 tempest-CinderUnicodeTest-1577663243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-146cda44-cf9a-4618-a6e7-8f3b6fae24c3.a33dd968-fea3-48fb-9453-52f39d615700" returned: 0 in 0.476s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:22 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-c7023b23-b59c-4921-b8f6-9d3732081d50 tempest-CinderUnicodeTest-1577663243 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-146cda44-cf9a-4618-a6e7-8f3b6fae24c3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 29 01:28:22 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[47049206-00b2-4baf-8430-4d22bef24c26]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:28:22 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c7023b23-b59c-4921-b8f6-9d3732081d50 tempest-CinderUnicodeTest-1577663243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-146cda44-cf9a-4618-a6e7-8f3b6fae24c3 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:23 devstack sudo[104979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-146cda44-cf9a-4618-a6e7-8f3b6fae24c3 Aug 29 01:28:23 devstack sudo[104979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:23 devstack sudo[104979]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:23 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c7023b23-b59c-4921-b8f6-9d3732081d50 tempest-CinderUnicodeTest-1577663243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-146cda44-cf9a-4618-a6e7-8f3b6fae24c3" returned: 0 in 0.445s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:23 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c7023b23-b59c-4921-b8f6-9d3732081d50 tempest-CinderUnicodeTest-1577663243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-146cda44-cf9a-4618-a6e7-8f3b6fae24c3.a33dd968-fea3-48fb-9453-52f39d615700 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:23 devstack sudo[104984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-146cda44-cf9a-4618-a6e7-8f3b6fae24c3.a33dd968-fea3-48fb-9453-52f39d615700 Aug 29 01:28:23 devstack sudo[104984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:23 devstack sudo[104984]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:23 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c7023b23-b59c-4921-b8f6-9d3732081d50 tempest-CinderUnicodeTest-1577663243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-146cda44-cf9a-4618-a6e7-8f3b6fae24c3.a33dd968-fea3-48fb-9453-52f39d615700" returned: 0 in 0.574s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:23 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c7023b23-b59c-4921-b8f6-9d3732081d50 tempest-CinderUnicodeTest-1577663243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-146cda44-cf9a-4618-a6e7-8f3b6fae24c3.a33dd968-fea3-48fb-9453-52f39d615700 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:23 devstack sudo[104992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-146cda44-cf9a-4618-a6e7-8f3b6fae24c3.a33dd968-fea3-48fb-9453-52f39d615700 Aug 29 01:28:23 devstack sudo[104992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:24 devstack sudo[104992]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:24 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c7023b23-b59c-4921-b8f6-9d3732081d50 tempest-CinderUnicodeTest-1577663243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-146cda44-cf9a-4618-a6e7-8f3b6fae24c3.a33dd968-fea3-48fb-9453-52f39d615700" returned: 0 in 0.367s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:24 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-98560798-b5fc-4e6d-85b5-a9c171e7afe5 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:28:24 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-98560798-b5fc-4e6d-85b5-a9c171e7afe5 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Flow 'volume_create_manager' (04c50fd9-d1eb-4bf7-8ef3-07e1a16343e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:28:24 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-98560798-b5fc-4e6d-85b5-a9c171e7afe5 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (121b3872-3e3f-43bb-a379-0cfb6fbb5a31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:28:24 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-c7023b23-b59c-4921-b8f6-9d3732081d50 tempest-CinderUnicodeTest-1577663243 None] Lock "cinder-quobyte-a33dd968-fea3-48fb-9453-52f39d615700" released by "_delete_snapshot" :: held 2.089s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:28:24 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-98560798-b5fc-4e6d-85b5-a9c171e7afe5 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (121b3872-3e3f-43bb-a379-0cfb6fbb5a31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:28:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1150596192',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60acf510-dcfc-41eb-8dd8-46d349772944,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b381a421a763410f95aaa499f5f64c5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:28:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:28:24Z,use_quota=True,user_id='bb10b91622c34f3f99dc2b2eb6040084',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:28:24 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-98560798-b5fc-4e6d-85b5-a9c171e7afe5 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f88a8cd-0a90-4090-b151-38bd6483f723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:28:24 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-98560798-b5fc-4e6d-85b5-a9c171e7afe5 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f88a8cd-0a90-4090-b151-38bd6483f723) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:28:24 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-98560798-b5fc-4e6d-85b5-a9c171e7afe5 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38c1b677-221d-4419-83cc-aeac3b1246d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:28:24 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-98560798-b5fc-4e6d-85b5-a9c171e7afe5 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38c1b677-221d-4419-83cc-aeac3b1246d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60acf510-dcfc-41eb-8dd8-46d349772944', 'volume_name': 'volume-60acf510-dcfc-41eb-8dd8-46d349772944', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:28:24 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-98560798-b5fc-4e6d-85b5-a9c171e7afe5 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e04feae6-a3dc-4729-a898-5140144a725e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:28:24 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-98560798-b5fc-4e6d-85b5-a9c171e7afe5 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e04feae6-a3dc-4729-a898-5140144a725e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:28:24 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-98560798-b5fc-4e6d-85b5-a9c171e7afe5 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6b6d58b-366f-4c72-8230-c4633485c511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:28:24 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-98560798-b5fc-4e6d-85b5-a9c171e7afe5 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Volume 60acf510-dcfc-41eb-8dd8-46d349772944: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60acf510-dcfc-41eb-8dd8-46d349772944', 'volume_size': 1} Aug 29 01:28:24 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-98560798-b5fc-4e6d-85b5-a9c171e7afe5 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:28:24 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-98560798-b5fc-4e6d-85b5-a9c171e7afe5 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:28:24 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-98560798-b5fc-4e6d-85b5-a9c171e7afe5 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:28:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1150596192',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60acf510-dcfc-41eb-8dd8-46d349772944,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b381a421a763410f95aaa499f5f64c5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:28:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:28:24Z,use_quota=True,user_id='bb10b91622c34f3f99dc2b2eb6040084',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:28:24 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-98560798-b5fc-4e6d-85b5-a9c171e7afe5 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Creating volume 60acf510-dcfc-41eb-8dd8-46d349772944 {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:28:24 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-98560798-b5fc-4e6d-85b5-a9c171e7afe5 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:28:24 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-98560798-b5fc-4e6d-85b5-a9c171e7afe5 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:28:24 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-98560798-b5fc-4e6d-85b5-a9c171e7afe5 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:28:24 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-98560798-b5fc-4e6d-85b5-a9c171e7afe5 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:28:24 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-98560798-b5fc-4e6d-85b5-a9c171e7afe5 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:28:24 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-98560798-b5fc-4e6d-85b5-a9c171e7afe5 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:28:24 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-98560798-b5fc-4e6d-85b5-a9c171e7afe5 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:28:24 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-98560798-b5fc-4e6d-85b5-a9c171e7afe5 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-60acf510-dcfc-41eb-8dd8-46d349772944 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:24 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-c7023b23-b59c-4921-b8f6-9d3732081d50 tempest-CinderUnicodeTest-1577663243 None] Lock "cinder-quobyte-146cda44-cf9a-4618-a6e7-8f3b6fae24c3" released by "delete_snapshot" :: held 2.195s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:28:24 devstack sudo[104997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-60acf510-dcfc-41eb-8dd8-46d349772944 1073741824 Aug 29 01:28:24 devstack sudo[104997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:24 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-c7023b23-b59c-4921-b8f6-9d3732081d50 tempest-CinderUnicodeTest-1577663243 None] Created reservations ['5c23b1a2-3845-4963-b2d3-8fe17b543e28', '37a4b90b-80c0-40ef-9950-1fb293682f6d', '80be127e-e4ba-44a6-b985-7e5a3cf1dcc8', '3e7fb55b-1e89-43db-b8ba-4e84be95aba9'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:28:24 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-c7023b23-b59c-4921-b8f6-9d3732081d50 tempest-CinderUnicodeTest-1577663243 None] Delete snapshot completed successfully. Aug 29 01:28:24 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-c7023b23-b59c-4921-b8f6-9d3732081d50 tempest-CinderUnicodeTest-1577663243 None] Lock "cinder-a33dd968-fea3-48fb-9453-52f39d615700-delete_snapshot" released by "delete_snapshot" :: held 2.549s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:28:24 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3439168-2e76-4e67-a6d6-df1a79ddc551 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:28:24 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-a3439168-2e76-4e67-a6d6-df1a79ddc551 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Flow 'volume_create_manager' (57d8a3e8-9cd8-4a2f-a8a6-fde73e0b8446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:28:24 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-a3439168-2e76-4e67-a6d6-df1a79ddc551 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b42e84a6-1bb0-46c3-8033-0c553c6d1df3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:28:24 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-a3439168-2e76-4e67-a6d6-df1a79ddc551 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b42e84a6-1bb0-46c3-8033-0c553c6d1df3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:28:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-331534099',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fbadc2a-47c3-410f-a83a-02f838f80ef5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b381a421a763410f95aaa499f5f64c5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:28:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:28:25Z,use_quota=True,user_id='bb10b91622c34f3f99dc2b2eb6040084',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:28:24 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-a3439168-2e76-4e67-a6d6-df1a79ddc551 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05ad3c31-73b0-4006-87fc-51e9fc675bc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:28:24 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-a3439168-2e76-4e67-a6d6-df1a79ddc551 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05ad3c31-73b0-4006-87fc-51e9fc675bc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:28:24 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-a3439168-2e76-4e67-a6d6-df1a79ddc551 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddf46f5d-6ace-4b99-b68d-fbecfa5d5ee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:28:24 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-a3439168-2e76-4e67-a6d6-df1a79ddc551 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddf46f5d-6ace-4b99-b68d-fbecfa5d5ee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1fbadc2a-47c3-410f-a83a-02f838f80ef5', 'volume_name': 'volume-1fbadc2a-47c3-410f-a83a-02f838f80ef5', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:28:24 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-a3439168-2e76-4e67-a6d6-df1a79ddc551 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cf1768f-87bb-4c84-b21d-a878caec2191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:28:24 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-a3439168-2e76-4e67-a6d6-df1a79ddc551 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cf1768f-87bb-4c84-b21d-a878caec2191) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:28:24 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-a3439168-2e76-4e67-a6d6-df1a79ddc551 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bee506f-26a4-47b5-bd27-6c65f04f9e6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:28:24 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-a3439168-2e76-4e67-a6d6-df1a79ddc551 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Volume 1fbadc2a-47c3-410f-a83a-02f838f80ef5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1fbadc2a-47c3-410f-a83a-02f838f80ef5', 'volume_size': 1} Aug 29 01:28:24 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-a3439168-2e76-4e67-a6d6-df1a79ddc551 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:28:25 devstack sudo[104997]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:25 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-98560798-b5fc-4e6d-85b5-a9c171e7afe5 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-60acf510-dcfc-41eb-8dd8-46d349772944 1073741824" returned: 0 in 0.648s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:25 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-98560798-b5fc-4e6d-85b5-a9c171e7afe5 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-60acf510-dcfc-41eb-8dd8-46d349772944 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:25 devstack sudo[105003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-60acf510-dcfc-41eb-8dd8-46d349772944 Aug 29 01:28:25 devstack sudo[105003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:25 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d318334-d2a3-4655-bfff-d30bac96e470 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:28:25 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6d318334-d2a3-4655-bfff-d30bac96e470 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Flow 'volume_create_manager' (f51bafae-fac1-4f20-9023-5120533d98e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:28:25 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6d318334-d2a3-4655-bfff-d30bac96e470 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bce0ccff-e8ad-4ae3-92dd-58663a092eb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:28:25 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6d318334-d2a3-4655-bfff-d30bac96e470 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bce0ccff-e8ad-4ae3-92dd-58663a092eb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:28:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1688791813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14a60f0c-e10e-430d-821e-484b69a11640,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b381a421a763410f95aaa499f5f64c5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:28:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:28:25Z,use_quota=True,user_id='bb10b91622c34f3f99dc2b2eb6040084',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:28:25 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6d318334-d2a3-4655-bfff-d30bac96e470 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45e003f7-455f-4750-8b83-295eea0a57f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:28:25 devstack sudo[105003]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:25 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6d318334-d2a3-4655-bfff-d30bac96e470 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45e003f7-455f-4750-8b83-295eea0a57f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:28:25 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6d318334-d2a3-4655-bfff-d30bac96e470 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e42e5bd5-31e7-4c00-a9a6-5729226a7316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:28:25 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6d318334-d2a3-4655-bfff-d30bac96e470 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e42e5bd5-31e7-4c00-a9a6-5729226a7316) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14a60f0c-e10e-430d-821e-484b69a11640', 'volume_name': 'volume-14a60f0c-e10e-430d-821e-484b69a11640', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:28:25 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6d318334-d2a3-4655-bfff-d30bac96e470 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (257875ac-d11a-4f76-a95b-e0c4fda61f06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:28:25 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6d318334-d2a3-4655-bfff-d30bac96e470 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (257875ac-d11a-4f76-a95b-e0c4fda61f06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:28:25 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6d318334-d2a3-4655-bfff-d30bac96e470 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14be999a-fb43-499c-aa38-ef3e519b54b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:28:25 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-6d318334-d2a3-4655-bfff-d30bac96e470 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Volume 14a60f0c-e10e-430d-821e-484b69a11640: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14a60f0c-e10e-430d-821e-484b69a11640', 'volume_size': 1} Aug 29 01:28:25 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-6d318334-d2a3-4655-bfff-d30bac96e470 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:28:25 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-10f60da9-425d-4e8e-bae4-2da038ca49dc tempest-CinderUnicodeTest-1577663243 None] Acquiring lock "cinder-146cda44-cf9a-4618-a6e7-8f3b6fae24c3-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:28:25 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-98560798-b5fc-4e6d-85b5-a9c171e7afe5 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-60acf510-dcfc-41eb-8dd8-46d349772944" returned: 0 in 0.465s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:25 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-98560798-b5fc-4e6d-85b5-a9c171e7afe5 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] <== create_volume: return (1180ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:28:25 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-98560798-b5fc-4e6d-85b5-a9c171e7afe5 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.183s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:28:25 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-a3439168-2e76-4e67-a6d6-df1a79ddc551 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.720s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:28:25 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-a3439168-2e76-4e67-a6d6-df1a79ddc551 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:28:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-331534099',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fbadc2a-47c3-410f-a83a-02f838f80ef5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b381a421a763410f95aaa499f5f64c5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:28:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:28:25Z,use_quota=True,user_id='bb10b91622c34f3f99dc2b2eb6040084',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:28:25 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-a3439168-2e76-4e67-a6d6-df1a79ddc551 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Creating volume 1fbadc2a-47c3-410f-a83a-02f838f80ef5 {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:28:25 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-a3439168-2e76-4e67-a6d6-df1a79ddc551 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:28:25 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-a3439168-2e76-4e67-a6d6-df1a79ddc551 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:28:25 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-a3439168-2e76-4e67-a6d6-df1a79ddc551 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:28:25 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-a3439168-2e76-4e67-a6d6-df1a79ddc551 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:28:25 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-a3439168-2e76-4e67-a6d6-df1a79ddc551 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:28:25 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-a3439168-2e76-4e67-a6d6-df1a79ddc551 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:28:25 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-a3439168-2e76-4e67-a6d6-df1a79ddc551 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:28:25 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-a3439168-2e76-4e67-a6d6-df1a79ddc551 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-1fbadc2a-47c3-410f-a83a-02f838f80ef5 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:25 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-10f60da9-425d-4e8e-bae4-2da038ca49dc tempest-CinderUnicodeTest-1577663243 None] Lock "cinder-146cda44-cf9a-4618-a6e7-8f3b6fae24c3-delete_volume" acquired by "delete_volume" :: waited 0.083s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:28:25 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-98560798-b5fc-4e6d-85b5-a9c171e7afe5 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6b6d58b-366f-4c72-8230-c4633485c511) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60acf510-dcfc-41eb-8dd8-46d349772944', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:28:25 devstack sudo[105006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-1fbadc2a-47c3-410f-a83a-02f838f80ef5 1073741824 Aug 29 01:28:25 devstack sudo[105006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:25 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-98560798-b5fc-4e6d-85b5-a9c171e7afe5 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81af8f51-ce77-45fe-8f8e-44befa3ca43e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:28:25 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-98560798-b5fc-4e6d-85b5-a9c171e7afe5 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Volume volume-60acf510-dcfc-41eb-8dd8-46d349772944 (60acf510-dcfc-41eb-8dd8-46d349772944): created successfully Aug 29 01:28:25 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-98560798-b5fc-4e6d-85b5-a9c171e7afe5 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81af8f51-ce77-45fe-8f8e-44befa3ca43e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:28:25 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-98560798-b5fc-4e6d-85b5-a9c171e7afe5 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Flow 'volume_create_manager' (04c50fd9-d1eb-4bf7-8ef3-07e1a16343e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:28:25 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-98560798-b5fc-4e6d-85b5-a9c171e7afe5 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Created volume successfully. Aug 29 01:28:25 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-10f60da9-425d-4e8e-bae4-2da038ca49dc tempest-CinderUnicodeTest-1577663243 None] Acquiring lock "cinder-quobyte-146cda44-cf9a-4618-a6e7-8f3b6fae24c3" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:28:25 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-10f60da9-425d-4e8e-bae4-2da038ca49dc tempest-CinderUnicodeTest-1577663243 None] Lock "cinder-quobyte-146cda44-cf9a-4618-a6e7-8f3b6fae24c3" acquired by "delete_volume" :: waited 0.032s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:28:25 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[51e878d7-3e5f-466c-85c8-1f481b6a32b4]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:28:25 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-10f60da9-425d-4e8e-bae4-2da038ca49dc tempest-CinderUnicodeTest-1577663243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-146cda44-cf9a-4618-a6e7-8f3b6fae24c3 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:26 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8088912-6bbe-4b49-9e4c-372a657aabd8 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:28:26 devstack sudo[105008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-146cda44-cf9a-4618-a6e7-8f3b6fae24c3 Aug 29 01:28:26 devstack sudo[105008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:26 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-f8088912-6bbe-4b49-9e4c-372a657aabd8 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Flow 'volume_create_manager' (9cd1a438-a065-4563-9787-8472ef8ddf4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:28:26 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-f8088912-6bbe-4b49-9e4c-372a657aabd8 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (403c7211-d2e2-4ff9-b9e7-ad9c850a82cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:28:26 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-f8088912-6bbe-4b49-9e4c-372a657aabd8 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (403c7211-d2e2-4ff9-b9e7-ad9c850a82cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:28:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1315785543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26dc6b92-49f8-4b67-8859-49d9e0d36ce6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b381a421a763410f95aaa499f5f64c5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:28:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:28:26Z,use_quota=True,user_id='bb10b91622c34f3f99dc2b2eb6040084',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:28:26 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-f8088912-6bbe-4b49-9e4c-372a657aabd8 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d97aa72-1e01-489c-b301-2a3524f12ca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:28:26 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-f8088912-6bbe-4b49-9e4c-372a657aabd8 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d97aa72-1e01-489c-b301-2a3524f12ca1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:28:26 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-f8088912-6bbe-4b49-9e4c-372a657aabd8 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6baae28-0789-44fa-8e6c-3badd8f150a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:28:26 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-f8088912-6bbe-4b49-9e4c-372a657aabd8 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6baae28-0789-44fa-8e6c-3badd8f150a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26dc6b92-49f8-4b67-8859-49d9e0d36ce6', 'volume_name': 'volume-26dc6b92-49f8-4b67-8859-49d9e0d36ce6', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:28:26 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-f8088912-6bbe-4b49-9e4c-372a657aabd8 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ebac861-cdd6-48f3-8d35-c2fa28663580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:28:26 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-f8088912-6bbe-4b49-9e4c-372a657aabd8 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ebac861-cdd6-48f3-8d35-c2fa28663580) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:28:26 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-f8088912-6bbe-4b49-9e4c-372a657aabd8 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c4fae2b-23e1-4ea3-9703-a8ba9b895103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:28:26 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-f8088912-6bbe-4b49-9e4c-372a657aabd8 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Volume 26dc6b92-49f8-4b67-8859-49d9e0d36ce6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26dc6b92-49f8-4b67-8859-49d9e0d36ce6', 'volume_size': 1} Aug 29 01:28:26 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-f8088912-6bbe-4b49-9e4c-372a657aabd8 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:28:26 devstack sudo[105006]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:26 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-a3439168-2e76-4e67-a6d6-df1a79ddc551 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-1fbadc2a-47c3-410f-a83a-02f838f80ef5 1073741824" returned: 0 in 0.688s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:26 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-a3439168-2e76-4e67-a6d6-df1a79ddc551 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-1fbadc2a-47c3-410f-a83a-02f838f80ef5 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:26 devstack sudo[105016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-1fbadc2a-47c3-410f-a83a-02f838f80ef5 Aug 29 01:28:26 devstack sudo[105016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:26 devstack sudo[105008]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:26 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-10f60da9-425d-4e8e-bae4-2da038ca49dc tempest-CinderUnicodeTest-1577663243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-146cda44-cf9a-4618-a6e7-8f3b6fae24c3" returned: 0 in 0.679s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:26 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-10f60da9-425d-4e8e-bae4-2da038ca49dc tempest-CinderUnicodeTest-1577663243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-146cda44-cf9a-4618-a6e7-8f3b6fae24c3 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:26 devstack sudo[105020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-146cda44-cf9a-4618-a6e7-8f3b6fae24c3 Aug 29 01:28:26 devstack sudo[105020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:26 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8cfe7a6-a7b0-4c89-aefa-bb956d20e067 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:28:26 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-a8cfe7a6-a7b0-4c89-aefa-bb956d20e067 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Flow 'volume_create_manager' (59baa62b-ffdb-4835-86a2-73bf728f937f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:28:26 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-a8cfe7a6-a7b0-4c89-aefa-bb956d20e067 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41927354-dc77-4953-ac71-28c48d219b6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:28:26 devstack sudo[105016]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:26 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-a8cfe7a6-a7b0-4c89-aefa-bb956d20e067 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41927354-dc77-4953-ac71-28c48d219b6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:28:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2043808347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=710b4388-e4b0-40d9-9240-584a4ba2d013,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b381a421a763410f95aaa499f5f64c5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:28:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:28:27Z,use_quota=True,user_id='bb10b91622c34f3f99dc2b2eb6040084',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:28:26 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-a8cfe7a6-a7b0-4c89-aefa-bb956d20e067 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb0c0d20-449c-45c7-b6b0-bb829a589bcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:28:26 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-a8cfe7a6-a7b0-4c89-aefa-bb956d20e067 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb0c0d20-449c-45c7-b6b0-bb829a589bcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:28:26 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-a8cfe7a6-a7b0-4c89-aefa-bb956d20e067 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e292b879-7036-4855-9f41-4b175c20e981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:28:26 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-a8cfe7a6-a7b0-4c89-aefa-bb956d20e067 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e292b879-7036-4855-9f41-4b175c20e981) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '710b4388-e4b0-40d9-9240-584a4ba2d013', 'volume_name': 'volume-710b4388-e4b0-40d9-9240-584a4ba2d013', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:28:26 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-a8cfe7a6-a7b0-4c89-aefa-bb956d20e067 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11212821-d316-42ad-8aa4-027cf6f8843e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:28:26 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-a8cfe7a6-a7b0-4c89-aefa-bb956d20e067 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11212821-d316-42ad-8aa4-027cf6f8843e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:28:26 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-a8cfe7a6-a7b0-4c89-aefa-bb956d20e067 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a23c435f-6de1-4690-be75-f2d035fabf26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:28:26 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-a8cfe7a6-a7b0-4c89-aefa-bb956d20e067 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Volume 710b4388-e4b0-40d9-9240-584a4ba2d013: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-710b4388-e4b0-40d9-9240-584a4ba2d013', 'volume_size': 1} Aug 29 01:28:26 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-a8cfe7a6-a7b0-4c89-aefa-bb956d20e067 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:28:26 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-a3439168-2e76-4e67-a6d6-df1a79ddc551 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-1fbadc2a-47c3-410f-a83a-02f838f80ef5" returned: 0 in 0.487s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:26 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-a3439168-2e76-4e67-a6d6-df1a79ddc551 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] <== create_volume: return (1253ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:28:26 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-a3439168-2e76-4e67-a6d6-df1a79ddc551 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.259s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:28:26 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-6d318334-d2a3-4655-bfff-d30bac96e470 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.299s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:28:26 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-6d318334-d2a3-4655-bfff-d30bac96e470 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:28:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1688791813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14a60f0c-e10e-430d-821e-484b69a11640,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b381a421a763410f95aaa499f5f64c5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:28:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:28:25Z,use_quota=True,user_id='bb10b91622c34f3f99dc2b2eb6040084',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:28:26 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-6d318334-d2a3-4655-bfff-d30bac96e470 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Creating volume 14a60f0c-e10e-430d-821e-484b69a11640 {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:28:26 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-6d318334-d2a3-4655-bfff-d30bac96e470 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:28:26 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-6d318334-d2a3-4655-bfff-d30bac96e470 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:28:26 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-6d318334-d2a3-4655-bfff-d30bac96e470 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:28:26 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-6d318334-d2a3-4655-bfff-d30bac96e470 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:28:26 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-6d318334-d2a3-4655-bfff-d30bac96e470 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:28:26 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-6d318334-d2a3-4655-bfff-d30bac96e470 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:28:26 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-6d318334-d2a3-4655-bfff-d30bac96e470 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:28:26 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-6d318334-d2a3-4655-bfff-d30bac96e470 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-14a60f0c-e10e-430d-821e-484b69a11640 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:26 devstack sudo[105020]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:27 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-10f60da9-425d-4e8e-bae4-2da038ca49dc tempest-CinderUnicodeTest-1577663243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-146cda44-cf9a-4618-a6e7-8f3b6fae24c3" returned: 0 in 0.349s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:27 devstack sudo[105024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-14a60f0c-e10e-430d-821e-484b69a11640 1073741824 Aug 29 01:28:27 devstack sudo[105024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:27 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-a3439168-2e76-4e67-a6d6-df1a79ddc551 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bee506f-26a4-47b5-bd27-6c65f04f9e6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1fbadc2a-47c3-410f-a83a-02f838f80ef5', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:28:27 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-a3439168-2e76-4e67-a6d6-df1a79ddc551 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecec3939-682f-42f6-9f8e-fe1bf7598fc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:28:27 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-10f60da9-425d-4e8e-bae4-2da038ca49dc tempest-CinderUnicodeTest-1577663243 None] Lock "cinder-quobyte-146cda44-cf9a-4618-a6e7-8f3b6fae24c3" released by "delete_volume" :: held 1.142s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:28:27 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-a3439168-2e76-4e67-a6d6-df1a79ddc551 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Volume volume-1fbadc2a-47c3-410f-a83a-02f838f80ef5 (1fbadc2a-47c3-410f-a83a-02f838f80ef5): created successfully Aug 29 01:28:27 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-a3439168-2e76-4e67-a6d6-df1a79ddc551 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecec3939-682f-42f6-9f8e-fe1bf7598fc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:28:27 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-a3439168-2e76-4e67-a6d6-df1a79ddc551 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Flow 'volume_create_manager' (57d8a3e8-9cd8-4a2f-a8a6-fde73e0b8446) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:28:27 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-a3439168-2e76-4e67-a6d6-df1a79ddc551 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Created volume successfully. Aug 29 01:28:27 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-10f60da9-425d-4e8e-bae4-2da038ca49dc tempest-CinderUnicodeTest-1577663243 None] Created reservations ['0926180f-69cf-4650-b470-d3a0fc80e394', 'e378d050-3e08-4495-b612-5d71631af487', 'b26650d8-7507-4aba-bd29-89b22ffaefde', '0335868c-b650-4cc0-93ba-7acf537efcf4'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:28:27 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-10f60da9-425d-4e8e-bae4-2da038ca49dc tempest-CinderUnicodeTest-1577663243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:28:27 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-10f60da9-425d-4e8e-bae4-2da038ca49dc tempest-CinderUnicodeTest-1577663243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:28:27 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-10f60da9-425d-4e8e-bae4-2da038ca49dc tempest-CinderUnicodeTest-1577663243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:28:27 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-10f60da9-425d-4e8e-bae4-2da038ca49dc tempest-CinderUnicodeTest-1577663243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:28:27 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-10f60da9-425d-4e8e-bae4-2da038ca49dc tempest-CinderUnicodeTest-1577663243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:28:27 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-10f60da9-425d-4e8e-bae4-2da038ca49dc tempest-CinderUnicodeTest-1577663243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:27 devstack sudo[105028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:28:27 devstack sudo[105028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:27 devstack sudo[105024]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:27 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-6d318334-d2a3-4655-bfff-d30bac96e470 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-14a60f0c-e10e-430d-821e-484b69a11640 1073741824" returned: 0 in 0.597s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:27 devstack sudo[105028]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:27 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-10f60da9-425d-4e8e-bae4-2da038ca49dc tempest-CinderUnicodeTest-1577663243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.366s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:27 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-10f60da9-425d-4e8e-bae4-2da038ca49dc tempest-CinderUnicodeTest-1577663243 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:28:27 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-10f60da9-425d-4e8e-bae4-2da038ca49dc tempest-CinderUnicodeTest-1577663243 None] Deleted volume successfully. Aug 29 01:28:27 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-6d318334-d2a3-4655-bfff-d30bac96e470 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-14a60f0c-e10e-430d-821e-484b69a11640 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:27 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-10f60da9-425d-4e8e-bae4-2da038ca49dc tempest-CinderUnicodeTest-1577663243 None] Lock "cinder-146cda44-cf9a-4618-a6e7-8f3b6fae24c3-delete_volume" released by "delete_volume" :: held 1.904s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:28:27 devstack sudo[105033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-14a60f0c-e10e-430d-821e-484b69a11640 Aug 29 01:28:27 devstack sudo[105033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:27 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f48f957-f39b-434c-a160-fb8fa05d982f tempest-ProjectReaderTests-1026512592 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:28:27 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6f48f957-f39b-434c-a160-fb8fa05d982f tempest-ProjectReaderTests-1026512592 None] Flow 'volume_create_manager' (9c3d7987-a1f3-46ca-aef1-f7fd791c3d7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:28:27 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6f48f957-f39b-434c-a160-fb8fa05d982f tempest-ProjectReaderTests-1026512592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89e6b7d7-3183-481c-b59c-455b2668ed5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:28:27 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6f48f957-f39b-434c-a160-fb8fa05d982f tempest-ProjectReaderTests-1026512592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89e6b7d7-3183-481c-b59c-455b2668ed5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:28:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1028867089',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56c86802-3a02-4929-9fc9-f4b587df0e1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f4ae73a5390439e915c9cd396d75553',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:28:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:28:28Z,use_quota=True,user_id='79682547ae2a4eadac72af1628b4ff73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:28:27 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6f48f957-f39b-434c-a160-fb8fa05d982f tempest-ProjectReaderTests-1026512592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (844962b2-5cbb-440e-a55c-8cc328280b89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:28:27 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6f48f957-f39b-434c-a160-fb8fa05d982f tempest-ProjectReaderTests-1026512592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (844962b2-5cbb-440e-a55c-8cc328280b89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:28:27 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6f48f957-f39b-434c-a160-fb8fa05d982f tempest-ProjectReaderTests-1026512592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1e66fe3-d44e-43a8-bcf6-704c168e12fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:28:27 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6f48f957-f39b-434c-a160-fb8fa05d982f tempest-ProjectReaderTests-1026512592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1e66fe3-d44e-43a8-bcf6-704c168e12fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56c86802-3a02-4929-9fc9-f4b587df0e1a', 'volume_name': 'volume-56c86802-3a02-4929-9fc9-f4b587df0e1a', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:28:27 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6f48f957-f39b-434c-a160-fb8fa05d982f tempest-ProjectReaderTests-1026512592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45c0331d-c2b0-4228-8a34-7c900895c3b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:28:27 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6f48f957-f39b-434c-a160-fb8fa05d982f tempest-ProjectReaderTests-1026512592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45c0331d-c2b0-4228-8a34-7c900895c3b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:28:27 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6f48f957-f39b-434c-a160-fb8fa05d982f tempest-ProjectReaderTests-1026512592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (103587e8-5ab1-4953-903d-2ad37af0f30d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:28:27 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-6f48f957-f39b-434c-a160-fb8fa05d982f tempest-ProjectReaderTests-1026512592 None] Volume 56c86802-3a02-4929-9fc9-f4b587df0e1a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56c86802-3a02-4929-9fc9-f4b587df0e1a', 'volume_size': 1} Aug 29 01:28:27 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-6f48f957-f39b-434c-a160-fb8fa05d982f tempest-ProjectReaderTests-1026512592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:28:27 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-f153bfee-fa28-4dc1-942a-f8f55e098381 tempest-CinderUnicodeTest-1577663243 None] Acquiring lock "cinder-218c03fa-26df-4b44-b2e9-47a36656524a-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:28:27 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c5f992a-5603-47f8-a0ce-205dc7d763d6 tempest-ProjectMemberTests-1570638723 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:28:27 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-1c5f992a-5603-47f8-a0ce-205dc7d763d6 tempest-ProjectMemberTests-1570638723 None] Flow 'volume_create_manager' (7b6d043b-5913-4732-a4f1-b50d274c0d67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:28:27 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-1c5f992a-5603-47f8-a0ce-205dc7d763d6 tempest-ProjectMemberTests-1570638723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0da71a8-2be4-4e56-82b2-2bfea0333ced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:28:27 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-1c5f992a-5603-47f8-a0ce-205dc7d763d6 tempest-ProjectMemberTests-1570638723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0da71a8-2be4-4e56-82b2-2bfea0333ced) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:28:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-157107407',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a14cb8da-9fd4-4c7c-b2c0-6a940ad70de3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc3e18b86dee456398aada5b169dc198',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:28:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:28:28Z,use_quota=True,user_id='ea18f1190bab494589a803742a7eb22a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:28:27 devstack sudo[105033]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:27 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-1c5f992a-5603-47f8-a0ce-205dc7d763d6 tempest-ProjectMemberTests-1570638723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77c1dcf9-3476-458e-88b0-464b4b018558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:28:27 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-1c5f992a-5603-47f8-a0ce-205dc7d763d6 tempest-ProjectMemberTests-1570638723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77c1dcf9-3476-458e-88b0-464b4b018558) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:28:27 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-1c5f992a-5603-47f8-a0ce-205dc7d763d6 tempest-ProjectMemberTests-1570638723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f29146ad-d83f-428e-9ea3-117607cb58f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:28:27 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-1c5f992a-5603-47f8-a0ce-205dc7d763d6 tempest-ProjectMemberTests-1570638723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f29146ad-d83f-428e-9ea3-117607cb58f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a14cb8da-9fd4-4c7c-b2c0-6a940ad70de3', 'volume_name': 'volume-a14cb8da-9fd4-4c7c-b2c0-6a940ad70de3', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:28:28 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-1c5f992a-5603-47f8-a0ce-205dc7d763d6 tempest-ProjectMemberTests-1570638723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a14457d-4fe4-4aea-ac81-a561988e9f9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:28:28 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-1c5f992a-5603-47f8-a0ce-205dc7d763d6 tempest-ProjectMemberTests-1570638723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a14457d-4fe4-4aea-ac81-a561988e9f9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:28:28 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-1c5f992a-5603-47f8-a0ce-205dc7d763d6 tempest-ProjectMemberTests-1570638723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9254b5d-cbf4-4e27-aa02-90fc7d713720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:28:28 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-1c5f992a-5603-47f8-a0ce-205dc7d763d6 tempest-ProjectMemberTests-1570638723 None] Volume a14cb8da-9fd4-4c7c-b2c0-6a940ad70de3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a14cb8da-9fd4-4c7c-b2c0-6a940ad70de3', 'volume_size': 1} Aug 29 01:28:28 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-1c5f992a-5603-47f8-a0ce-205dc7d763d6 tempest-ProjectMemberTests-1570638723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:28:28 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-6d318334-d2a3-4655-bfff-d30bac96e470 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-14a60f0c-e10e-430d-821e-484b69a11640" returned: 0 in 0.374s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:28 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-6d318334-d2a3-4655-bfff-d30bac96e470 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] <== create_volume: return (1051ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:28:28 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-6d318334-d2a3-4655-bfff-d30bac96e470 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.055s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:28:28 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-f8088912-6bbe-4b49-9e4c-372a657aabd8 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.732s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:28:28 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-f8088912-6bbe-4b49-9e4c-372a657aabd8 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:28:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1315785543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26dc6b92-49f8-4b67-8859-49d9e0d36ce6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b381a421a763410f95aaa499f5f64c5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:28:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:28:26Z,use_quota=True,user_id='bb10b91622c34f3f99dc2b2eb6040084',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:28:28 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-f8088912-6bbe-4b49-9e4c-372a657aabd8 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Creating volume 26dc6b92-49f8-4b67-8859-49d9e0d36ce6 {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:28:28 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-f8088912-6bbe-4b49-9e4c-372a657aabd8 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:28:28 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-f8088912-6bbe-4b49-9e4c-372a657aabd8 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:28:28 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-f8088912-6bbe-4b49-9e4c-372a657aabd8 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:28:28 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-f8088912-6bbe-4b49-9e4c-372a657aabd8 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:28:28 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-f8088912-6bbe-4b49-9e4c-372a657aabd8 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:28:28 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-f8088912-6bbe-4b49-9e4c-372a657aabd8 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:28:28 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-f8088912-6bbe-4b49-9e4c-372a657aabd8 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:28:28 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-f8088912-6bbe-4b49-9e4c-372a657aabd8 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-26dc6b92-49f8-4b67-8859-49d9e0d36ce6 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:28 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-f153bfee-fa28-4dc1-942a-f8f55e098381 tempest-CinderUnicodeTest-1577663243 None] Lock "cinder-218c03fa-26df-4b44-b2e9-47a36656524a-delete_volume" acquired by "delete_volume" :: waited 0.112s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:28:28 devstack sudo[105036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-26dc6b92-49f8-4b67-8859-49d9e0d36ce6 1073741824 Aug 29 01:28:28 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6d318334-d2a3-4655-bfff-d30bac96e470 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14be999a-fb43-499c-aa38-ef3e519b54b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14a60f0c-e10e-430d-821e-484b69a11640', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:28:28 devstack sudo[105036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:28 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6d318334-d2a3-4655-bfff-d30bac96e470 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3560f7ce-939b-492f-a39b-67a1c75dbfe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:28:28 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-6d318334-d2a3-4655-bfff-d30bac96e470 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Volume volume-14a60f0c-e10e-430d-821e-484b69a11640 (14a60f0c-e10e-430d-821e-484b69a11640): created successfully Aug 29 01:28:28 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6d318334-d2a3-4655-bfff-d30bac96e470 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3560f7ce-939b-492f-a39b-67a1c75dbfe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:28:28 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6d318334-d2a3-4655-bfff-d30bac96e470 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Flow 'volume_create_manager' (f51bafae-fac1-4f20-9023-5120533d98e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:28:28 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-6d318334-d2a3-4655-bfff-d30bac96e470 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Created volume successfully. Aug 29 01:28:28 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-f153bfee-fa28-4dc1-942a-f8f55e098381 tempest-CinderUnicodeTest-1577663243 None] Acquiring lock "cinder-quobyte-218c03fa-26df-4b44-b2e9-47a36656524a" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:28:28 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-f153bfee-fa28-4dc1-942a-f8f55e098381 tempest-CinderUnicodeTest-1577663243 None] Lock "cinder-quobyte-218c03fa-26df-4b44-b2e9-47a36656524a" acquired by "delete_volume" :: waited 0.020s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:28:28 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3526d9f-8736-4f60-86be-4f51849f4eec]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:28:28 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-f153bfee-fa28-4dc1-942a-f8f55e098381 tempest-CinderUnicodeTest-1577663243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-218c03fa-26df-4b44-b2e9-47a36656524a {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:28 devstack sudo[105038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-218c03fa-26df-4b44-b2e9-47a36656524a Aug 29 01:28:28 devstack sudo[105038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:28 devstack sudo[105036]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:28 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-f8088912-6bbe-4b49-9e4c-372a657aabd8 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-26dc6b92-49f8-4b67-8859-49d9e0d36ce6 1073741824" returned: 0 in 0.421s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:28 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-f8088912-6bbe-4b49-9e4c-372a657aabd8 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-26dc6b92-49f8-4b67-8859-49d9e0d36ce6 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:28 devstack sudo[105046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-26dc6b92-49f8-4b67-8859-49d9e0d36ce6 Aug 29 01:28:28 devstack sudo[105046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:28 devstack sudo[105038]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:28 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-f153bfee-fa28-4dc1-942a-f8f55e098381 tempest-CinderUnicodeTest-1577663243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-218c03fa-26df-4b44-b2e9-47a36656524a" returned: 0 in 0.389s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:28 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-f153bfee-fa28-4dc1-942a-f8f55e098381 tempest-CinderUnicodeTest-1577663243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-218c03fa-26df-4b44-b2e9-47a36656524a {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:28 devstack sudo[105048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-218c03fa-26df-4b44-b2e9-47a36656524a Aug 29 01:28:28 devstack sudo[105048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:28 devstack sudo[105046]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:28 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-f8088912-6bbe-4b49-9e4c-372a657aabd8 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-26dc6b92-49f8-4b67-8859-49d9e0d36ce6" returned: 0 in 0.251s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:28 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-f8088912-6bbe-4b49-9e4c-372a657aabd8 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] <== create_volume: return (717ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:28:28 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-f8088912-6bbe-4b49-9e4c-372a657aabd8 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.720s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:28:28 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-a8cfe7a6-a7b0-4c89-aefa-bb956d20e067 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.795s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:28:28 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-a8cfe7a6-a7b0-4c89-aefa-bb956d20e067 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:28:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2043808347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=710b4388-e4b0-40d9-9240-584a4ba2d013,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b381a421a763410f95aaa499f5f64c5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:28:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:28:27Z,use_quota=True,user_id='bb10b91622c34f3f99dc2b2eb6040084',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:28:28 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-a8cfe7a6-a7b0-4c89-aefa-bb956d20e067 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Creating volume 710b4388-e4b0-40d9-9240-584a4ba2d013 {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:28:28 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-a8cfe7a6-a7b0-4c89-aefa-bb956d20e067 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:28:28 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-a8cfe7a6-a7b0-4c89-aefa-bb956d20e067 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:28:28 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-a8cfe7a6-a7b0-4c89-aefa-bb956d20e067 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:28:28 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-a8cfe7a6-a7b0-4c89-aefa-bb956d20e067 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:28:28 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-a8cfe7a6-a7b0-4c89-aefa-bb956d20e067 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:28:28 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-a8cfe7a6-a7b0-4c89-aefa-bb956d20e067 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:28:28 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-a8cfe7a6-a7b0-4c89-aefa-bb956d20e067 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:28:28 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-a8cfe7a6-a7b0-4c89-aefa-bb956d20e067 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-710b4388-e4b0-40d9-9240-584a4ba2d013 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:28 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-f8088912-6bbe-4b49-9e4c-372a657aabd8 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c4fae2b-23e1-4ea3-9703-a8ba9b895103) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26dc6b92-49f8-4b67-8859-49d9e0d36ce6', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:28:28 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-f8088912-6bbe-4b49-9e4c-372a657aabd8 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d82dedc-f190-41a5-adb4-388ceab5e4f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:28:28 devstack sudo[105052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-710b4388-e4b0-40d9-9240-584a4ba2d013 1073741824 Aug 29 01:28:28 devstack sudo[105052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:28 devstack sudo[105048]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:28 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-f8088912-6bbe-4b49-9e4c-372a657aabd8 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Volume volume-26dc6b92-49f8-4b67-8859-49d9e0d36ce6 (26dc6b92-49f8-4b67-8859-49d9e0d36ce6): created successfully Aug 29 01:28:28 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-f8088912-6bbe-4b49-9e4c-372a657aabd8 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d82dedc-f190-41a5-adb4-388ceab5e4f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:28:28 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-f8088912-6bbe-4b49-9e4c-372a657aabd8 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Flow 'volume_create_manager' (9cd1a438-a065-4563-9787-8472ef8ddf4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:28:28 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-f153bfee-fa28-4dc1-942a-f8f55e098381 tempest-CinderUnicodeTest-1577663243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-218c03fa-26df-4b44-b2e9-47a36656524a" returned: 0 in 0.276s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:28 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-f153bfee-fa28-4dc1-942a-f8f55e098381 tempest-CinderUnicodeTest-1577663243 None] Lock "cinder-quobyte-218c03fa-26df-4b44-b2e9-47a36656524a" released by "delete_volume" :: held 0.701s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:28:28 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-f8088912-6bbe-4b49-9e4c-372a657aabd8 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Created volume successfully. Aug 29 01:28:28 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-f153bfee-fa28-4dc1-942a-f8f55e098381 tempest-CinderUnicodeTest-1577663243 None] Created reservations ['8c210565-644a-42fb-af4b-130ceef31a47', '123cdbd9-4ee0-41b8-8272-ba79284b1ca0', 'e5a36063-b00c-431e-a51f-741a846eddb4', '147e2f9e-486b-448b-8312-97e973c019a1'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:28:28 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-f153bfee-fa28-4dc1-942a-f8f55e098381 tempest-CinderUnicodeTest-1577663243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:28:28 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-f153bfee-fa28-4dc1-942a-f8f55e098381 tempest-CinderUnicodeTest-1577663243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:28:28 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-f153bfee-fa28-4dc1-942a-f8f55e098381 tempest-CinderUnicodeTest-1577663243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:28:28 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-f153bfee-fa28-4dc1-942a-f8f55e098381 tempest-CinderUnicodeTest-1577663243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:28:28 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-f153bfee-fa28-4dc1-942a-f8f55e098381 tempest-CinderUnicodeTest-1577663243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:28:28 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-f153bfee-fa28-4dc1-942a-f8f55e098381 tempest-CinderUnicodeTest-1577663243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:28 devstack sudo[105054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:28:28 devstack sudo[105054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:29 devstack sudo[105054]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:29 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-f153bfee-fa28-4dc1-942a-f8f55e098381 tempest-CinderUnicodeTest-1577663243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.294s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:29 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-f153bfee-fa28-4dc1-942a-f8f55e098381 tempest-CinderUnicodeTest-1577663243 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:28:29 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-f153bfee-fa28-4dc1-942a-f8f55e098381 tempest-CinderUnicodeTest-1577663243 None] Deleted volume successfully. Aug 29 01:28:29 devstack sudo[105052]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:29 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-a8cfe7a6-a7b0-4c89-aefa-bb956d20e067 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-710b4388-e4b0-40d9-9240-584a4ba2d013 1073741824" returned: 0 in 0.508s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:29 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-f153bfee-fa28-4dc1-942a-f8f55e098381 tempest-CinderUnicodeTest-1577663243 None] Lock "cinder-218c03fa-26df-4b44-b2e9-47a36656524a-delete_volume" released by "delete_volume" :: held 1.236s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:28:29 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-a8cfe7a6-a7b0-4c89-aefa-bb956d20e067 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-710b4388-e4b0-40d9-9240-584a4ba2d013 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:29 devstack sudo[105060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-710b4388-e4b0-40d9-9240-584a4ba2d013 Aug 29 01:28:29 devstack sudo[105060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:29 devstack sudo[105060]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:29 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-a8cfe7a6-a7b0-4c89-aefa-bb956d20e067 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-710b4388-e4b0-40d9-9240-584a4ba2d013" returned: 0 in 0.248s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:29 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-a8cfe7a6-a7b0-4c89-aefa-bb956d20e067 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] <== create_volume: return (805ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:28:29 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-a8cfe7a6-a7b0-4c89-aefa-bb956d20e067 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.808s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:28:29 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-6f48f957-f39b-434c-a160-fb8fa05d982f tempest-ProjectReaderTests-1026512592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.680s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:28:29 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-6f48f957-f39b-434c-a160-fb8fa05d982f tempest-ProjectReaderTests-1026512592 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:28:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1028867089',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56c86802-3a02-4929-9fc9-f4b587df0e1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f4ae73a5390439e915c9cd396d75553',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:28:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:28:28Z,use_quota=True,user_id='79682547ae2a4eadac72af1628b4ff73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:28:29 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-6f48f957-f39b-434c-a160-fb8fa05d982f tempest-ProjectReaderTests-1026512592 None] Creating volume 56c86802-3a02-4929-9fc9-f4b587df0e1a {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:28:29 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-6f48f957-f39b-434c-a160-fb8fa05d982f tempest-ProjectReaderTests-1026512592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:28:29 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-6f48f957-f39b-434c-a160-fb8fa05d982f tempest-ProjectReaderTests-1026512592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:28:29 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-6f48f957-f39b-434c-a160-fb8fa05d982f tempest-ProjectReaderTests-1026512592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:28:29 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-6f48f957-f39b-434c-a160-fb8fa05d982f tempest-ProjectReaderTests-1026512592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:28:29 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-6f48f957-f39b-434c-a160-fb8fa05d982f tempest-ProjectReaderTests-1026512592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:28:29 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-6f48f957-f39b-434c-a160-fb8fa05d982f tempest-ProjectReaderTests-1026512592 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:28:29 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-6f48f957-f39b-434c-a160-fb8fa05d982f tempest-ProjectReaderTests-1026512592 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:28:29 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-6f48f957-f39b-434c-a160-fb8fa05d982f tempest-ProjectReaderTests-1026512592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-56c86802-3a02-4929-9fc9-f4b587df0e1a 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:29 devstack sudo[105064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-56c86802-3a02-4929-9fc9-f4b587df0e1a 1073741824 Aug 29 01:28:29 devstack sudo[105064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:29 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-a8cfe7a6-a7b0-4c89-aefa-bb956d20e067 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a23c435f-6de1-4690-be75-f2d035fabf26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-710b4388-e4b0-40d9-9240-584a4ba2d013', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:28:29 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-a8cfe7a6-a7b0-4c89-aefa-bb956d20e067 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7b3d245-57c4-41ed-9023-1c407da6a7b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:28:29 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-a8cfe7a6-a7b0-4c89-aefa-bb956d20e067 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Volume volume-710b4388-e4b0-40d9-9240-584a4ba2d013 (710b4388-e4b0-40d9-9240-584a4ba2d013): created successfully Aug 29 01:28:29 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-a8cfe7a6-a7b0-4c89-aefa-bb956d20e067 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7b3d245-57c4-41ed-9023-1c407da6a7b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:28:29 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-a8cfe7a6-a7b0-4c89-aefa-bb956d20e067 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Flow 'volume_create_manager' (59baa62b-ffdb-4835-86a2-73bf728f937f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:28:29 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-a8cfe7a6-a7b0-4c89-aefa-bb956d20e067 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Created volume successfully. Aug 29 01:28:30 devstack sudo[105064]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:30 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-6f48f957-f39b-434c-a160-fb8fa05d982f tempest-ProjectReaderTests-1026512592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-56c86802-3a02-4929-9fc9-f4b587df0e1a 1073741824" returned: 0 in 0.458s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:30 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-6f48f957-f39b-434c-a160-fb8fa05d982f tempest-ProjectReaderTests-1026512592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-56c86802-3a02-4929-9fc9-f4b587df0e1a {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:30 devstack sudo[105070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-56c86802-3a02-4929-9fc9-f4b587df0e1a Aug 29 01:28:30 devstack sudo[105070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:30 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-3cfc7652-edd3-4d30-937b-12e653ae90e3 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Acquiring lock "cinder-710b4388-e4b0-40d9-9240-584a4ba2d013-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:28:30 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-3cfc7652-edd3-4d30-937b-12e653ae90e3 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Lock "cinder-710b4388-e4b0-40d9-9240-584a4ba2d013-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:28:30 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-3cfc7652-edd3-4d30-937b-12e653ae90e3 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Acquiring lock "cinder-quobyte-710b4388-e4b0-40d9-9240-584a4ba2d013" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:28:30 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-3cfc7652-edd3-4d30-937b-12e653ae90e3 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Lock "cinder-quobyte-710b4388-e4b0-40d9-9240-584a4ba2d013" acquired by "delete_volume" :: waited 0.018s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:28:30 devstack sudo[105070]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:30 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-6f48f957-f39b-434c-a160-fb8fa05d982f tempest-ProjectReaderTests-1026512592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-56c86802-3a02-4929-9fc9-f4b587df0e1a" returned: 0 in 0.303s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:30 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-6f48f957-f39b-434c-a160-fb8fa05d982f tempest-ProjectReaderTests-1026512592 None] <== create_volume: return (804ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:28:30 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-6f48f957-f39b-434c-a160-fb8fa05d982f tempest-ProjectReaderTests-1026512592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.806s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:28:30 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-1c5f992a-5603-47f8-a0ce-205dc7d763d6 tempest-ProjectMemberTests-1570638723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.353s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:28:30 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-1c5f992a-5603-47f8-a0ce-205dc7d763d6 tempest-ProjectMemberTests-1570638723 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:28:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-157107407',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a14cb8da-9fd4-4c7c-b2c0-6a940ad70de3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc3e18b86dee456398aada5b169dc198',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:28:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:28:28Z,use_quota=True,user_id='ea18f1190bab494589a803742a7eb22a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:28:30 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-1c5f992a-5603-47f8-a0ce-205dc7d763d6 tempest-ProjectMemberTests-1570638723 None] Creating volume a14cb8da-9fd4-4c7c-b2c0-6a940ad70de3 {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:28:30 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-1c5f992a-5603-47f8-a0ce-205dc7d763d6 tempest-ProjectMemberTests-1570638723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:28:30 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-1c5f992a-5603-47f8-a0ce-205dc7d763d6 tempest-ProjectMemberTests-1570638723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:28:30 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-1c5f992a-5603-47f8-a0ce-205dc7d763d6 tempest-ProjectMemberTests-1570638723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:28:30 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-1c5f992a-5603-47f8-a0ce-205dc7d763d6 tempest-ProjectMemberTests-1570638723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:28:30 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-1c5f992a-5603-47f8-a0ce-205dc7d763d6 tempest-ProjectMemberTests-1570638723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:28:30 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-1c5f992a-5603-47f8-a0ce-205dc7d763d6 tempest-ProjectMemberTests-1570638723 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:28:30 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-1c5f992a-5603-47f8-a0ce-205dc7d763d6 tempest-ProjectMemberTests-1570638723 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:28:30 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-1c5f992a-5603-47f8-a0ce-205dc7d763d6 tempest-ProjectMemberTests-1570638723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a14cb8da-9fd4-4c7c-b2c0-6a940ad70de3 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:30 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b324639-44f7-449c-96ad-f798871f94dd]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:28:30 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-3cfc7652-edd3-4d30-937b-12e653ae90e3 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-710b4388-e4b0-40d9-9240-584a4ba2d013 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:30 devstack sudo[105073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a14cb8da-9fd4-4c7c-b2c0-6a940ad70de3 1073741824 Aug 29 01:28:30 devstack sudo[105073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:30 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6f48f957-f39b-434c-a160-fb8fa05d982f tempest-ProjectReaderTests-1026512592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (103587e8-5ab1-4953-903d-2ad37af0f30d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56c86802-3a02-4929-9fc9-f4b587df0e1a', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:28:30 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6f48f957-f39b-434c-a160-fb8fa05d982f tempest-ProjectReaderTests-1026512592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f5f0a29-e03d-4a60-8755-e8e1310e0a2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:28:30 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-6f48f957-f39b-434c-a160-fb8fa05d982f tempest-ProjectReaderTests-1026512592 None] Volume volume-56c86802-3a02-4929-9fc9-f4b587df0e1a (56c86802-3a02-4929-9fc9-f4b587df0e1a): created successfully Aug 29 01:28:30 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6f48f957-f39b-434c-a160-fb8fa05d982f tempest-ProjectReaderTests-1026512592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f5f0a29-e03d-4a60-8755-e8e1310e0a2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:28:30 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-6f48f957-f39b-434c-a160-fb8fa05d982f tempest-ProjectReaderTests-1026512592 None] Flow 'volume_create_manager' (9c3d7987-a1f3-46ca-aef1-f7fd791c3d7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:28:30 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-6f48f957-f39b-434c-a160-fb8fa05d982f tempest-ProjectReaderTests-1026512592 None] Created volume successfully. Aug 29 01:28:30 devstack sudo[105075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-710b4388-e4b0-40d9-9240-584a4ba2d013 Aug 29 01:28:30 devstack sudo[105075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:30 devstack sudo[105075]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:30 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-3cfc7652-edd3-4d30-937b-12e653ae90e3 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-710b4388-e4b0-40d9-9240-584a4ba2d013" returned: 0 in 0.424s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:30 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-3cfc7652-edd3-4d30-937b-12e653ae90e3 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-710b4388-e4b0-40d9-9240-584a4ba2d013 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:30 devstack sudo[105084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-710b4388-e4b0-40d9-9240-584a4ba2d013 Aug 29 01:28:30 devstack sudo[105084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:30 devstack sudo[105073]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:30 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-1c5f992a-5603-47f8-a0ce-205dc7d763d6 tempest-ProjectMemberTests-1570638723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a14cb8da-9fd4-4c7c-b2c0-6a940ad70de3 1073741824" returned: 0 in 0.512s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:30 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-1c5f992a-5603-47f8-a0ce-205dc7d763d6 tempest-ProjectMemberTests-1570638723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a14cb8da-9fd4-4c7c-b2c0-6a940ad70de3 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:30 devstack sudo[105086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a14cb8da-9fd4-4c7c-b2c0-6a940ad70de3 Aug 29 01:28:30 devstack sudo[105086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:31 devstack sudo[105084]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:31 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-3cfc7652-edd3-4d30-937b-12e653ae90e3 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-710b4388-e4b0-40d9-9240-584a4ba2d013" returned: 0 in 0.290s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:31 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-3cfc7652-edd3-4d30-937b-12e653ae90e3 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Lock "cinder-quobyte-710b4388-e4b0-40d9-9240-584a4ba2d013" released by "delete_volume" :: held 0.778s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:28:31 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-0d4324f9-9ccb-4c80-b038-47ff14f1ee20 tempest-ProjectReaderTests-1026512592 None] Acquiring lock "cinder-56c86802-3a02-4929-9fc9-f4b587df0e1a-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:28:31 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-3cfc7652-edd3-4d30-937b-12e653ae90e3 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Created reservations ['b8f58ca0-e5c3-4520-bd22-38f2d5433ade', '93fde172-1fd6-4d89-8f1b-8da123c3b86c', '34442d18-8c52-40bd-830b-d99a1e49c5f6', 'ab4b6c62-01eb-47eb-9e17-b5d5ee43479d'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:28:31 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-0d4324f9-9ccb-4c80-b038-47ff14f1ee20 tempest-ProjectReaderTests-1026512592 None] Lock "cinder-56c86802-3a02-4929-9fc9-f4b587df0e1a-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:28:31 devstack sudo[105086]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:31 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-1c5f992a-5603-47f8-a0ce-205dc7d763d6 tempest-ProjectMemberTests-1570638723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a14cb8da-9fd4-4c7c-b2c0-6a940ad70de3" returned: 0 in 0.321s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:31 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-1c5f992a-5603-47f8-a0ce-205dc7d763d6 tempest-ProjectMemberTests-1570638723 None] <== create_volume: return (892ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:28:31 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-1c5f992a-5603-47f8-a0ce-205dc7d763d6 tempest-ProjectMemberTests-1570638723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.895s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:28:31 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-1c5f992a-5603-47f8-a0ce-205dc7d763d6 tempest-ProjectMemberTests-1570638723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9254b5d-cbf4-4e27-aa02-90fc7d713720) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a14cb8da-9fd4-4c7c-b2c0-6a940ad70de3', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:28:31 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-1c5f992a-5603-47f8-a0ce-205dc7d763d6 tempest-ProjectMemberTests-1570638723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ea9eadb-5c0e-46b9-8a8c-76f52c29c886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:28:31 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-0d4324f9-9ccb-4c80-b038-47ff14f1ee20 tempest-ProjectReaderTests-1026512592 None] Acquiring lock "cinder-quobyte-56c86802-3a02-4929-9fc9-f4b587df0e1a" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:28:31 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-1c5f992a-5603-47f8-a0ce-205dc7d763d6 tempest-ProjectMemberTests-1570638723 None] Volume volume-a14cb8da-9fd4-4c7c-b2c0-6a940ad70de3 (a14cb8da-9fd4-4c7c-b2c0-6a940ad70de3): created successfully Aug 29 01:28:31 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-1c5f992a-5603-47f8-a0ce-205dc7d763d6 tempest-ProjectMemberTests-1570638723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ea9eadb-5c0e-46b9-8a8c-76f52c29c886) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:28:31 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-1c5f992a-5603-47f8-a0ce-205dc7d763d6 tempest-ProjectMemberTests-1570638723 None] Flow 'volume_create_manager' (7b6d043b-5913-4732-a4f1-b50d274c0d67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:28:31 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-0d4324f9-9ccb-4c80-b038-47ff14f1ee20 tempest-ProjectReaderTests-1026512592 None] Lock "cinder-quobyte-56c86802-3a02-4929-9fc9-f4b587df0e1a" acquired by "delete_volume" :: waited 0.048s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:28:31 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-1c5f992a-5603-47f8-a0ce-205dc7d763d6 tempest-ProjectMemberTests-1570638723 None] Created volume successfully. Aug 29 01:28:31 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-3cfc7652-edd3-4d30-937b-12e653ae90e3 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:28:31 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-3cfc7652-edd3-4d30-937b-12e653ae90e3 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:28:31 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-3cfc7652-edd3-4d30-937b-12e653ae90e3 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:28:31 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-3cfc7652-edd3-4d30-937b-12e653ae90e3 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:28:31 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-3cfc7652-edd3-4d30-937b-12e653ae90e3 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:28:31 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-3cfc7652-edd3-4d30-937b-12e653ae90e3 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:31 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d6757d8-f278-4193-a25d-1fb18b6d3684]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:28:31 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-0d4324f9-9ccb-4c80-b038-47ff14f1ee20 tempest-ProjectReaderTests-1026512592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-56c86802-3a02-4929-9fc9-f4b587df0e1a {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:31 devstack sudo[105090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:28:31 devstack sudo[105090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:31 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-dae5e9f6-cf46-4edc-b1bb-570950e47a7f tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Acquiring lock "cinder-26dc6b92-49f8-4b67-8859-49d9e0d36ce6-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:28:31 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-dae5e9f6-cf46-4edc-b1bb-570950e47a7f tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Lock "cinder-26dc6b92-49f8-4b67-8859-49d9e0d36ce6-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:28:31 devstack sudo[105091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-56c86802-3a02-4929-9fc9-f4b587df0e1a Aug 29 01:28:31 devstack sudo[105091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:31 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-dae5e9f6-cf46-4edc-b1bb-570950e47a7f tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Acquiring lock "cinder-quobyte-26dc6b92-49f8-4b67-8859-49d9e0d36ce6" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:28:31 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-dae5e9f6-cf46-4edc-b1bb-570950e47a7f tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Lock "cinder-quobyte-26dc6b92-49f8-4b67-8859-49d9e0d36ce6" acquired by "delete_volume" :: waited 0.031s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:28:31 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7c0f5d1-c9b1-4fd0-abf9-8439d35ccb74]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:28:31 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-dae5e9f6-cf46-4edc-b1bb-570950e47a7f tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-26dc6b92-49f8-4b67-8859-49d9e0d36ce6 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:31 devstack sudo[105094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-26dc6b92-49f8-4b67-8859-49d9e0d36ce6 Aug 29 01:28:31 devstack sudo[105094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:31 devstack sudo[105090]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:31 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-3cfc7652-edd3-4d30-937b-12e653ae90e3 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.401s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:31 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-3cfc7652-edd3-4d30-937b-12e653ae90e3 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:28:31 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-3cfc7652-edd3-4d30-937b-12e653ae90e3 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Deleted volume successfully. Aug 29 01:28:31 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-3cfc7652-edd3-4d30-937b-12e653ae90e3 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Lock "cinder-710b4388-e4b0-40d9-9240-584a4ba2d013-delete_volume" released by "delete_volume" :: held 1.577s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:28:31 devstack sudo[105091]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:31 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-0d4324f9-9ccb-4c80-b038-47ff14f1ee20 tempest-ProjectReaderTests-1026512592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-56c86802-3a02-4929-9fc9-f4b587df0e1a" returned: 0 in 0.472s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:31 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-0d4324f9-9ccb-4c80-b038-47ff14f1ee20 tempest-ProjectReaderTests-1026512592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-56c86802-3a02-4929-9fc9-f4b587df0e1a {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:31 devstack sudo[105100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-56c86802-3a02-4929-9fc9-f4b587df0e1a Aug 29 01:28:31 devstack sudo[105100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:32 devstack sudo[105094]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:32 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-dae5e9f6-cf46-4edc-b1bb-570950e47a7f tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-26dc6b92-49f8-4b67-8859-49d9e0d36ce6" returned: 0 in 0.415s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:32 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-dae5e9f6-cf46-4edc-b1bb-570950e47a7f tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-26dc6b92-49f8-4b67-8859-49d9e0d36ce6 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:32 devstack sudo[105105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-26dc6b92-49f8-4b67-8859-49d9e0d36ce6 Aug 29 01:28:32 devstack sudo[105105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:32 devstack sudo[105100]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:32 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-0d4324f9-9ccb-4c80-b038-47ff14f1ee20 tempest-ProjectReaderTests-1026512592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-56c86802-3a02-4929-9fc9-f4b587df0e1a" returned: 0 in 0.292s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:32 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-0d4324f9-9ccb-4c80-b038-47ff14f1ee20 tempest-ProjectReaderTests-1026512592 None] Lock "cinder-quobyte-56c86802-3a02-4929-9fc9-f4b587df0e1a" released by "delete_volume" :: held 0.843s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:28:32 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-0d4324f9-9ccb-4c80-b038-47ff14f1ee20 tempest-ProjectReaderTests-1026512592 None] Created reservations ['0e2480ee-cff0-4054-9268-4cad1abb2306', '57fdbe45-e2f6-431d-9a85-49e9b10d355a', '360cf5eb-9fd0-4b3c-af9b-ad8948d391da', 'cdf74752-4b07-4ddf-b52e-69d8836e9a18'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:28:32 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-0d4324f9-9ccb-4c80-b038-47ff14f1ee20 tempest-ProjectReaderTests-1026512592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:28:32 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-0d4324f9-9ccb-4c80-b038-47ff14f1ee20 tempest-ProjectReaderTests-1026512592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:28:32 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-0d4324f9-9ccb-4c80-b038-47ff14f1ee20 tempest-ProjectReaderTests-1026512592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:28:32 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-0d4324f9-9ccb-4c80-b038-47ff14f1ee20 tempest-ProjectReaderTests-1026512592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:28:32 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-0d4324f9-9ccb-4c80-b038-47ff14f1ee20 tempest-ProjectReaderTests-1026512592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:28:32 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-0d4324f9-9ccb-4c80-b038-47ff14f1ee20 tempest-ProjectReaderTests-1026512592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:32 devstack sudo[105111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:28:32 devstack sudo[105111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:32 devstack sudo[105105]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:32 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-dae5e9f6-cf46-4edc-b1bb-570950e47a7f tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-26dc6b92-49f8-4b67-8859-49d9e0d36ce6" returned: 0 in 0.365s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:32 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-dae5e9f6-cf46-4edc-b1bb-570950e47a7f tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Lock "cinder-quobyte-26dc6b92-49f8-4b67-8859-49d9e0d36ce6" released by "delete_volume" :: held 0.847s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:28:32 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-dae5e9f6-cf46-4edc-b1bb-570950e47a7f tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Created reservations ['d32d000e-91de-44c3-9e91-28738590d246', 'c6102f16-2755-4b73-a932-b577f66c8dac', '549a14f0-eccd-45aa-82bd-e9da6d7f53e5', '8f2cd687-25f8-4c8b-b4a0-48e166fbbe35'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:28:32 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-dae5e9f6-cf46-4edc-b1bb-570950e47a7f tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:28:32 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-dae5e9f6-cf46-4edc-b1bb-570950e47a7f tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:28:32 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-dae5e9f6-cf46-4edc-b1bb-570950e47a7f tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:28:32 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-dae5e9f6-cf46-4edc-b1bb-570950e47a7f tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:28:32 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-dae5e9f6-cf46-4edc-b1bb-570950e47a7f tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:28:32 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-dae5e9f6-cf46-4edc-b1bb-570950e47a7f tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:32 devstack sudo[105145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:28:32 devstack sudo[105145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:32 devstack sudo[105111]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:32 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-f01bd308-ecd9-4e26-b236-d0643677a0a2 tempest-ProjectMemberTests-1570638723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:28:32 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-f01bd308-ecd9-4e26-b236-d0643677a0a2 tempest-ProjectMemberTests-1570638723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:28:32 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-0d4324f9-9ccb-4c80-b038-47ff14f1ee20 tempest-ProjectReaderTests-1026512592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.398s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:32 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-0d4324f9-9ccb-4c80-b038-47ff14f1ee20 tempest-ProjectReaderTests-1026512592 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:28:32 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-0d4324f9-9ccb-4c80-b038-47ff14f1ee20 tempest-ProjectReaderTests-1026512592 None] Deleted volume successfully. Aug 29 01:28:32 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-f01bd308-ecd9-4e26-b236-d0643677a0a2 tempest-ProjectMemberTests-1570638723 None] Creating offline snapshot 449cce49-4e9a-494d-a1c9-e18b7043d50b of volume a14cb8da-9fd4-4c7c-b2c0-6a940ad70de3 {{(pid=86111) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 29 01:28:32 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-0d4324f9-9ccb-4c80-b038-47ff14f1ee20 tempest-ProjectReaderTests-1026512592 None] Lock "cinder-56c86802-3a02-4929-9fc9-f4b587df0e1a-delete_volume" released by "delete_volume" :: held 1.583s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:28:32 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[16c09b5c-a4ad-40b1-b5cd-f86b683c87e7]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:28:32 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-f01bd308-ecd9-4e26-b236-d0643677a0a2 tempest-ProjectMemberTests-1570638723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a14cb8da-9fd4-4c7c-b2c0-6a940ad70de3 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:32 devstack sudo[105148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a14cb8da-9fd4-4c7c-b2c0-6a940ad70de3 Aug 29 01:28:32 devstack sudo[105148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:33 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-dbb521d2-fe9f-478a-a303-7a4ddfb2bd75 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Acquiring lock "cinder-14a60f0c-e10e-430d-821e-484b69a11640-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:28:33 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-dbb521d2-fe9f-478a-a303-7a4ddfb2bd75 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Lock "cinder-14a60f0c-e10e-430d-821e-484b69a11640-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:28:33 devstack sudo[105145]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:33 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-dae5e9f6-cf46-4edc-b1bb-570950e47a7f tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.506s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:33 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-dae5e9f6-cf46-4edc-b1bb-570950e47a7f tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:28:33 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-dae5e9f6-cf46-4edc-b1bb-570950e47a7f tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Deleted volume successfully. Aug 29 01:28:33 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-dae5e9f6-cf46-4edc-b1bb-570950e47a7f tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Lock "cinder-26dc6b92-49f8-4b67-8859-49d9e0d36ce6-delete_volume" released by "delete_volume" :: held 1.724s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:28:33 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-dbb521d2-fe9f-478a-a303-7a4ddfb2bd75 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Acquiring lock "cinder-quobyte-14a60f0c-e10e-430d-821e-484b69a11640" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:28:33 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-dbb521d2-fe9f-478a-a303-7a4ddfb2bd75 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Lock "cinder-quobyte-14a60f0c-e10e-430d-821e-484b69a11640" acquired by "delete_volume" :: waited 0.021s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:28:33 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[4444cb35-b5fb-4890-943d-6c3c02bccd11]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:28:33 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-dbb521d2-fe9f-478a-a303-7a4ddfb2bd75 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-14a60f0c-e10e-430d-821e-484b69a11640 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:33 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2d693a8-a970-4bc4-9312-67f72cdac56e tempest-ProjectReaderTests-1026512592 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:28:33 devstack sudo[105148]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:33 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-e2d693a8-a970-4bc4-9312-67f72cdac56e tempest-ProjectReaderTests-1026512592 None] Flow 'volume_create_manager' (1f56e2a4-b4f6-4b4d-9a17-cbe9207753d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:28:33 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-e2d693a8-a970-4bc4-9312-67f72cdac56e tempest-ProjectReaderTests-1026512592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f054d229-4fd0-45ad-abd9-483fd1513e4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:28:33 devstack sudo[105151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-14a60f0c-e10e-430d-821e-484b69a11640 Aug 29 01:28:33 devstack sudo[105151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:33 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-e2d693a8-a970-4bc4-9312-67f72cdac56e tempest-ProjectReaderTests-1026512592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f054d229-4fd0-45ad-abd9-483fd1513e4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:28:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1522272161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04ac99cc-1f68-4522-a37b-dc9bb64cf0e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f4ae73a5390439e915c9cd396d75553',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:28:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:28:33Z,use_quota=True,user_id='79682547ae2a4eadac72af1628b4ff73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:28:33 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-e2d693a8-a970-4bc4-9312-67f72cdac56e tempest-ProjectReaderTests-1026512592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aaa6010d-d7e5-4188-992f-b15765b12b8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:28:33 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-e2d693a8-a970-4bc4-9312-67f72cdac56e tempest-ProjectReaderTests-1026512592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aaa6010d-d7e5-4188-992f-b15765b12b8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:28:33 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-e2d693a8-a970-4bc4-9312-67f72cdac56e tempest-ProjectReaderTests-1026512592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6f083ae-42ac-40cb-857c-0ed834936418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:28:33 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-e2d693a8-a970-4bc4-9312-67f72cdac56e tempest-ProjectReaderTests-1026512592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6f083ae-42ac-40cb-857c-0ed834936418) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04ac99cc-1f68-4522-a37b-dc9bb64cf0e0', 'volume_name': 'volume-04ac99cc-1f68-4522-a37b-dc9bb64cf0e0', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:28:33 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-e2d693a8-a970-4bc4-9312-67f72cdac56e tempest-ProjectReaderTests-1026512592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5e3ffcc-16c4-42d4-908d-22e18ca70837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:28:33 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-e2d693a8-a970-4bc4-9312-67f72cdac56e tempest-ProjectReaderTests-1026512592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5e3ffcc-16c4-42d4-908d-22e18ca70837) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:28:33 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-e2d693a8-a970-4bc4-9312-67f72cdac56e tempest-ProjectReaderTests-1026512592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb44aff4-cd8e-4f46-8621-7999cd60f33b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:28:33 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-e2d693a8-a970-4bc4-9312-67f72cdac56e tempest-ProjectReaderTests-1026512592 None] Volume 04ac99cc-1f68-4522-a37b-dc9bb64cf0e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04ac99cc-1f68-4522-a37b-dc9bb64cf0e0', 'volume_size': 1} Aug 29 01:28:33 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-e2d693a8-a970-4bc4-9312-67f72cdac56e tempest-ProjectReaderTests-1026512592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:28:33 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-f01bd308-ecd9-4e26-b236-d0643677a0a2 tempest-ProjectMemberTests-1570638723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a14cb8da-9fd4-4c7c-b2c0-6a940ad70de3" returned: 0 in 0.722s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:33 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-f01bd308-ecd9-4e26-b236-d0643677a0a2 tempest-ProjectMemberTests-1570638723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a14cb8da-9fd4-4c7c-b2c0-6a940ad70de3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a14cb8da-9fd4-4c7c-b2c0-6a940ad70de3.449cce49-4e9a-494d-a1c9-e18b7043d50b 1G {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:33 devstack sudo[105158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a14cb8da-9fd4-4c7c-b2c0-6a940ad70de3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a14cb8da-9fd4-4c7c-b2c0-6a940ad70de3.449cce49-4e9a-494d-a1c9-e18b7043d50b 1G Aug 29 01:28:33 devstack sudo[105158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:33 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-c68cd65a-192f-426d-9642-6af45e1e2589 tempest-ProjectReaderTests-1698516188 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:28:33 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-c68cd65a-192f-426d-9642-6af45e1e2589 tempest-ProjectReaderTests-1698516188 None] Flow 'volume_create_manager' (064a7eec-5fde-4c5b-a909-4f31570c71aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:28:33 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-c68cd65a-192f-426d-9642-6af45e1e2589 tempest-ProjectReaderTests-1698516188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (881c06fd-3875-4589-8a31-d7119da170df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:28:33 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-c68cd65a-192f-426d-9642-6af45e1e2589 tempest-ProjectReaderTests-1698516188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (881c06fd-3875-4589-8a31-d7119da170df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:28:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-669279420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92339296-323e-4b99-b174-9e8a85b13b7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f049b4b9de194d0bb816e863c7740f77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:28:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:28:33Z,use_quota=True,user_id='168ab677c6ef4d8f93d853c32c291481',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:28:33 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-c68cd65a-192f-426d-9642-6af45e1e2589 tempest-ProjectReaderTests-1698516188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b51108fe-2fce-44e5-98d0-d4b0997f7d70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:28:33 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-c68cd65a-192f-426d-9642-6af45e1e2589 tempest-ProjectReaderTests-1698516188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b51108fe-2fce-44e5-98d0-d4b0997f7d70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:28:33 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-c68cd65a-192f-426d-9642-6af45e1e2589 tempest-ProjectReaderTests-1698516188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13fd23a0-efee-42e0-952a-af07482ab232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:28:33 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-c68cd65a-192f-426d-9642-6af45e1e2589 tempest-ProjectReaderTests-1698516188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13fd23a0-efee-42e0-952a-af07482ab232) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92339296-323e-4b99-b174-9e8a85b13b7b', 'volume_name': 'volume-92339296-323e-4b99-b174-9e8a85b13b7b', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:28:33 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-c68cd65a-192f-426d-9642-6af45e1e2589 tempest-ProjectReaderTests-1698516188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7d8d589-68ed-44fc-851d-8bb9093d5bc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:28:33 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-c68cd65a-192f-426d-9642-6af45e1e2589 tempest-ProjectReaderTests-1698516188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7d8d589-68ed-44fc-851d-8bb9093d5bc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:28:33 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-c68cd65a-192f-426d-9642-6af45e1e2589 tempest-ProjectReaderTests-1698516188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4e4ef27-1f50-4cd3-9973-d269a2868eb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:28:33 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-c68cd65a-192f-426d-9642-6af45e1e2589 tempest-ProjectReaderTests-1698516188 None] Volume 92339296-323e-4b99-b174-9e8a85b13b7b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92339296-323e-4b99-b174-9e8a85b13b7b', 'volume_size': 1} Aug 29 01:28:33 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-c68cd65a-192f-426d-9642-6af45e1e2589 tempest-ProjectReaderTests-1698516188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:28:33 devstack sudo[105151]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:33 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-dbb521d2-fe9f-478a-a303-7a4ddfb2bd75 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-14a60f0c-e10e-430d-821e-484b69a11640" returned: 0 in 0.459s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:33 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-dbb521d2-fe9f-478a-a303-7a4ddfb2bd75 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-14a60f0c-e10e-430d-821e-484b69a11640 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:33 devstack sudo[105163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-14a60f0c-e10e-430d-821e-484b69a11640 Aug 29 01:28:33 devstack sudo[105163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:33 devstack sudo[105158]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:33 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-f01bd308-ecd9-4e26-b236-d0643677a0a2 tempest-ProjectMemberTests-1570638723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a14cb8da-9fd4-4c7c-b2c0-6a940ad70de3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a14cb8da-9fd4-4c7c-b2c0-6a940ad70de3.449cce49-4e9a-494d-a1c9-e18b7043d50b 1G" returned: 0 in 0.408s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:33 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-f01bd308-ecd9-4e26-b236-d0643677a0a2 tempest-ProjectMemberTests-1570638723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a14cb8da-9fd4-4c7c-b2c0-6a940ad70de3 -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a14cb8da-9fd4-4c7c-b2c0-6a940ad70de3.449cce49-4e9a-494d-a1c9-e18b7043d50b {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:33 devstack sudo[105169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a14cb8da-9fd4-4c7c-b2c0-6a940ad70de3 -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a14cb8da-9fd4-4c7c-b2c0-6a940ad70de3.449cce49-4e9a-494d-a1c9-e18b7043d50b Aug 29 01:28:33 devstack sudo[105169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:34 devstack sudo[105163]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:34 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-dbb521d2-fe9f-478a-a303-7a4ddfb2bd75 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-14a60f0c-e10e-430d-821e-484b69a11640" returned: 0 in 0.287s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:34 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-dbb521d2-fe9f-478a-a303-7a4ddfb2bd75 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Lock "cinder-quobyte-14a60f0c-e10e-430d-821e-484b69a11640" released by "delete_volume" :: held 0.789s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:28:34 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-dbb521d2-fe9f-478a-a303-7a4ddfb2bd75 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Created reservations ['5e241b0e-685c-45e4-930c-95cb6e0d3859', '634f9168-5d42-46e7-82fe-40db824e1684', 'ba121e89-b6b2-443e-8dcc-6fe4d7096a9c', '61e7d6c0-e262-484e-a284-9fed0f2086db'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:28:34 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-dbb521d2-fe9f-478a-a303-7a4ddfb2bd75 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:28:34 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-dbb521d2-fe9f-478a-a303-7a4ddfb2bd75 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:28:34 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-dbb521d2-fe9f-478a-a303-7a4ddfb2bd75 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:28:34 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-dbb521d2-fe9f-478a-a303-7a4ddfb2bd75 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:28:34 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-dbb521d2-fe9f-478a-a303-7a4ddfb2bd75 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:28:34 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-dbb521d2-fe9f-478a-a303-7a4ddfb2bd75 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:34 devstack sudo[105172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:28:34 devstack sudo[105172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:34 devstack sudo[105169]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:34 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-4b790fb6-b405-4868-a69b-e1df455cb8b4 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Acquiring lock "cinder-1fbadc2a-47c3-410f-a83a-02f838f80ef5-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:28:34 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-f01bd308-ecd9-4e26-b236-d0643677a0a2 tempest-ProjectMemberTests-1570638723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a14cb8da-9fd4-4c7c-b2c0-6a940ad70de3 -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a14cb8da-9fd4-4c7c-b2c0-6a940ad70de3.449cce49-4e9a-494d-a1c9-e18b7043d50b" returned: 0 in 0.354s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:34 devstack cinder-volume[86111]: WARNING cinder.volume.drivers.remotefs [None req-f01bd308-ecd9-4e26-b236-d0643677a0a2 tempest-ProjectMemberTests-1570638723 None] /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a14cb8da-9fd4-4c7c-b2c0-6a940ad70de3.449cce49-4e9a-494d-a1c9-e18b7043d50b is being set with open permissions: ugo+rw Aug 29 01:28:34 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-f01bd308-ecd9-4e26-b236-d0643677a0a2 tempest-ProjectMemberTests-1570638723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a14cb8da-9fd4-4c7c-b2c0-6a940ad70de3.449cce49-4e9a-494d-a1c9-e18b7043d50b {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:34 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-4b790fb6-b405-4868-a69b-e1df455cb8b4 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Lock "cinder-1fbadc2a-47c3-410f-a83a-02f838f80ef5-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:28:34 devstack sudo[105177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a14cb8da-9fd4-4c7c-b2c0-6a940ad70de3.449cce49-4e9a-494d-a1c9-e18b7043d50b Aug 29 01:28:34 devstack sudo[105177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:34 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-4b790fb6-b405-4868-a69b-e1df455cb8b4 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Acquiring lock "cinder-quobyte-1fbadc2a-47c3-410f-a83a-02f838f80ef5" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:28:34 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-4b790fb6-b405-4868-a69b-e1df455cb8b4 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Lock "cinder-quobyte-1fbadc2a-47c3-410f-a83a-02f838f80ef5" acquired by "delete_volume" :: waited 0.022s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:28:34 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1c6c3ec-41b7-42a4-98c0-0eb61e4756b8]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:28:34 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-4b790fb6-b405-4868-a69b-e1df455cb8b4 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-1fbadc2a-47c3-410f-a83a-02f838f80ef5 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:34 devstack sudo[105172]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:34 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-dbb521d2-fe9f-478a-a303-7a4ddfb2bd75 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.278s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:34 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-dbb521d2-fe9f-478a-a303-7a4ddfb2bd75 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:28:34 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-dbb521d2-fe9f-478a-a303-7a4ddfb2bd75 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Deleted volume successfully. Aug 29 01:28:34 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-dbb521d2-fe9f-478a-a303-7a4ddfb2bd75 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Lock "cinder-14a60f0c-e10e-430d-821e-484b69a11640-delete_volume" released by "delete_volume" :: held 1.332s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:28:34 devstack sudo[105180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-1fbadc2a-47c3-410f-a83a-02f838f80ef5 Aug 29 01:28:34 devstack sudo[105180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:34 devstack sudo[105177]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:34 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-f01bd308-ecd9-4e26-b236-d0643677a0a2 tempest-ProjectMemberTests-1570638723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a14cb8da-9fd4-4c7c-b2c0-6a940ad70de3.449cce49-4e9a-494d-a1c9-e18b7043d50b" returned: 0 in 0.285s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:34 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-f01bd308-ecd9-4e26-b236-d0643677a0a2 tempest-ProjectMemberTests-1570638723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a14cb8da-9fd4-4c7c-b2c0-6a940ad70de3.info {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:34 devstack sudo[105183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a14cb8da-9fd4-4c7c-b2c0-6a940ad70de3.info Aug 29 01:28:34 devstack sudo[105183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:34 devstack sudo[105180]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:34 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-4b790fb6-b405-4868-a69b-e1df455cb8b4 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-1fbadc2a-47c3-410f-a83a-02f838f80ef5" returned: 0 in 0.380s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:34 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-4b790fb6-b405-4868-a69b-e1df455cb8b4 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-1fbadc2a-47c3-410f-a83a-02f838f80ef5 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:34 devstack sudo[105188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-1fbadc2a-47c3-410f-a83a-02f838f80ef5 Aug 29 01:28:34 devstack sudo[105188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:34 devstack sudo[105183]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:34 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-f01bd308-ecd9-4e26-b236-d0643677a0a2 tempest-ProjectMemberTests-1570638723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a14cb8da-9fd4-4c7c-b2c0-6a940ad70de3.info" returned: 0 in 0.253s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:34 devstack cinder-volume[86111]: WARNING cinder.volume.drivers.remotefs [None req-f01bd308-ecd9-4e26-b236-d0643677a0a2 tempest-ProjectMemberTests-1570638723 None] /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a14cb8da-9fd4-4c7c-b2c0-6a940ad70de3.info is being set with open permissions: ugo+rw Aug 29 01:28:34 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-f01bd308-ecd9-4e26-b236-d0643677a0a2 tempest-ProjectMemberTests-1570638723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a14cb8da-9fd4-4c7c-b2c0-6a940ad70de3.info {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:34 devstack sudo[105191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a14cb8da-9fd4-4c7c-b2c0-6a940ad70de3.info Aug 29 01:28:34 devstack sudo[105191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:35 devstack sudo[105188]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:35 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-4b790fb6-b405-4868-a69b-e1df455cb8b4 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-1fbadc2a-47c3-410f-a83a-02f838f80ef5" returned: 0 in 0.249s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:35 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-4b790fb6-b405-4868-a69b-e1df455cb8b4 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Lock "cinder-quobyte-1fbadc2a-47c3-410f-a83a-02f838f80ef5" released by "delete_volume" :: held 0.671s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:28:35 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-4b790fb6-b405-4868-a69b-e1df455cb8b4 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Created reservations ['43e9dfb7-c485-45e6-9615-e3aaf1c9362b', '8990a187-0e27-439a-b4dd-56616c7c083b', '9e133168-2c6d-4ee3-a3fa-5188529fa850', 'd593a229-c1f3-45a9-8db6-76cd841bfe83'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:28:35 devstack sudo[105191]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:35 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-f01bd308-ecd9-4e26-b236-d0643677a0a2 tempest-ProjectMemberTests-1570638723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a14cb8da-9fd4-4c7c-b2c0-6a940ad70de3.info" returned: 0 in 0.256s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:35 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-f01bd308-ecd9-4e26-b236-d0643677a0a2 tempest-ProjectMemberTests-1570638723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.396s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:28:35 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-e2d693a8-a970-4bc4-9312-67f72cdac56e tempest-ProjectReaderTests-1026512592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.622s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:28:35 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-e2d693a8-a970-4bc4-9312-67f72cdac56e tempest-ProjectReaderTests-1026512592 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:28:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1522272161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04ac99cc-1f68-4522-a37b-dc9bb64cf0e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f4ae73a5390439e915c9cd396d75553',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:28:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:28:33Z,use_quota=True,user_id='79682547ae2a4eadac72af1628b4ff73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:28:35 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-e2d693a8-a970-4bc4-9312-67f72cdac56e tempest-ProjectReaderTests-1026512592 None] Creating volume 04ac99cc-1f68-4522-a37b-dc9bb64cf0e0 {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:28:35 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-e2d693a8-a970-4bc4-9312-67f72cdac56e tempest-ProjectReaderTests-1026512592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:28:35 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-e2d693a8-a970-4bc4-9312-67f72cdac56e tempest-ProjectReaderTests-1026512592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:28:35 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-e2d693a8-a970-4bc4-9312-67f72cdac56e tempest-ProjectReaderTests-1026512592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:28:35 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-e2d693a8-a970-4bc4-9312-67f72cdac56e tempest-ProjectReaderTests-1026512592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:28:35 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-e2d693a8-a970-4bc4-9312-67f72cdac56e tempest-ProjectReaderTests-1026512592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:28:35 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-e2d693a8-a970-4bc4-9312-67f72cdac56e tempest-ProjectReaderTests-1026512592 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:28:35 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-e2d693a8-a970-4bc4-9312-67f72cdac56e tempest-ProjectReaderTests-1026512592 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:28:35 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-e2d693a8-a970-4bc4-9312-67f72cdac56e tempest-ProjectReaderTests-1026512592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-04ac99cc-1f68-4522-a37b-dc9bb64cf0e0 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:35 devstack sudo[105195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-04ac99cc-1f68-4522-a37b-dc9bb64cf0e0 1073741824 Aug 29 01:28:35 devstack sudo[105195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:35 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-f01bd308-ecd9-4e26-b236-d0643677a0a2 tempest-ProjectMemberTests-1570638723 None] Create snapshot completed successfully Aug 29 01:28:35 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-4b790fb6-b405-4868-a69b-e1df455cb8b4 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:28:35 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-4b790fb6-b405-4868-a69b-e1df455cb8b4 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:28:35 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-4b790fb6-b405-4868-a69b-e1df455cb8b4 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:28:35 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-4b790fb6-b405-4868-a69b-e1df455cb8b4 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:28:35 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-4b790fb6-b405-4868-a69b-e1df455cb8b4 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:28:35 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-4b790fb6-b405-4868-a69b-e1df455cb8b4 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:35 devstack sudo[105197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:28:35 devstack sudo[105197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:35 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-61f01d3b-3d6d-450a-bdad-9fbe501f8ca4 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Acquiring lock "cinder-60acf510-dcfc-41eb-8dd8-46d349772944-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:28:35 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-61f01d3b-3d6d-450a-bdad-9fbe501f8ca4 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Lock "cinder-60acf510-dcfc-41eb-8dd8-46d349772944-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:28:35 devstack sudo[105197]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:35 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-4b790fb6-b405-4868-a69b-e1df455cb8b4 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.294s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:35 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-4b790fb6-b405-4868-a69b-e1df455cb8b4 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:28:35 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-61f01d3b-3d6d-450a-bdad-9fbe501f8ca4 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Acquiring lock "cinder-quobyte-60acf510-dcfc-41eb-8dd8-46d349772944" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:28:35 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-4b790fb6-b405-4868-a69b-e1df455cb8b4 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Deleted volume successfully. Aug 29 01:28:35 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-61f01d3b-3d6d-450a-bdad-9fbe501f8ca4 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Lock "cinder-quobyte-60acf510-dcfc-41eb-8dd8-46d349772944" acquired by "delete_volume" :: waited 0.024s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:28:35 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-4b790fb6-b405-4868-a69b-e1df455cb8b4 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Lock "cinder-1fbadc2a-47c3-410f-a83a-02f838f80ef5-delete_volume" released by "delete_volume" :: held 1.244s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:28:35 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbd30d01-bc9c-4d6c-9dc7-f6cc2c4fd4cc]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:28:35 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-61f01d3b-3d6d-450a-bdad-9fbe501f8ca4 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-60acf510-dcfc-41eb-8dd8-46d349772944 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:35 devstack sudo[105195]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:35 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-e2d693a8-a970-4bc4-9312-67f72cdac56e tempest-ProjectReaderTests-1026512592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-04ac99cc-1f68-4522-a37b-dc9bb64cf0e0 1073741824" returned: 0 in 0.498s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:35 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-e2d693a8-a970-4bc4-9312-67f72cdac56e tempest-ProjectReaderTests-1026512592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-04ac99cc-1f68-4522-a37b-dc9bb64cf0e0 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:35 devstack sudo[105204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-60acf510-dcfc-41eb-8dd8-46d349772944 Aug 29 01:28:35 devstack sudo[105204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:35 devstack sudo[105205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-04ac99cc-1f68-4522-a37b-dc9bb64cf0e0 Aug 29 01:28:35 devstack sudo[105205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:35 devstack sudo[105205]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:35 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-e2d693a8-a970-4bc4-9312-67f72cdac56e tempest-ProjectReaderTests-1026512592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-04ac99cc-1f68-4522-a37b-dc9bb64cf0e0" returned: 0 in 0.254s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:35 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-e2d693a8-a970-4bc4-9312-67f72cdac56e tempest-ProjectReaderTests-1026512592 None] <== create_volume: return (793ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:28:35 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-e2d693a8-a970-4bc4-9312-67f72cdac56e tempest-ProjectReaderTests-1026512592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.795s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:28:35 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-c68cd65a-192f-426d-9642-6af45e1e2589 tempest-ProjectReaderTests-1698516188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.300s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:28:35 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-c68cd65a-192f-426d-9642-6af45e1e2589 tempest-ProjectReaderTests-1698516188 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:28:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-669279420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92339296-323e-4b99-b174-9e8a85b13b7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f049b4b9de194d0bb816e863c7740f77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:28:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:28:33Z,use_quota=True,user_id='168ab677c6ef4d8f93d853c32c291481',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:28:35 devstack sudo[105204]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:35 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-c68cd65a-192f-426d-9642-6af45e1e2589 tempest-ProjectReaderTests-1698516188 None] Creating volume 92339296-323e-4b99-b174-9e8a85b13b7b {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:28:35 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-c68cd65a-192f-426d-9642-6af45e1e2589 tempest-ProjectReaderTests-1698516188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:28:35 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-c68cd65a-192f-426d-9642-6af45e1e2589 tempest-ProjectReaderTests-1698516188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:28:35 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-c68cd65a-192f-426d-9642-6af45e1e2589 tempest-ProjectReaderTests-1698516188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:28:35 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-c68cd65a-192f-426d-9642-6af45e1e2589 tempest-ProjectReaderTests-1698516188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:28:35 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-c68cd65a-192f-426d-9642-6af45e1e2589 tempest-ProjectReaderTests-1698516188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:28:35 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-c68cd65a-192f-426d-9642-6af45e1e2589 tempest-ProjectReaderTests-1698516188 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:28:35 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-c68cd65a-192f-426d-9642-6af45e1e2589 tempest-ProjectReaderTests-1698516188 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:28:35 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c68cd65a-192f-426d-9642-6af45e1e2589 tempest-ProjectReaderTests-1698516188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-92339296-323e-4b99-b174-9e8a85b13b7b 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:35 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-61f01d3b-3d6d-450a-bdad-9fbe501f8ca4 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-60acf510-dcfc-41eb-8dd8-46d349772944" returned: 0 in 0.384s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:35 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-61f01d3b-3d6d-450a-bdad-9fbe501f8ca4 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-60acf510-dcfc-41eb-8dd8-46d349772944 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:35 devstack sudo[105213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-92339296-323e-4b99-b174-9e8a85b13b7b 1073741824 Aug 29 01:28:35 devstack sudo[105213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:36 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-e2d693a8-a970-4bc4-9312-67f72cdac56e tempest-ProjectReaderTests-1026512592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb44aff4-cd8e-4f46-8621-7999cd60f33b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04ac99cc-1f68-4522-a37b-dc9bb64cf0e0', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:28:36 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-e2d693a8-a970-4bc4-9312-67f72cdac56e tempest-ProjectReaderTests-1026512592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80a34632-65b6-4166-9237-cea4c63485cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:28:36 devstack sudo[105214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-60acf510-dcfc-41eb-8dd8-46d349772944 Aug 29 01:28:36 devstack sudo[105214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:36 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-e2d693a8-a970-4bc4-9312-67f72cdac56e tempest-ProjectReaderTests-1026512592 None] Volume volume-04ac99cc-1f68-4522-a37b-dc9bb64cf0e0 (04ac99cc-1f68-4522-a37b-dc9bb64cf0e0): created successfully Aug 29 01:28:36 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-e2d693a8-a970-4bc4-9312-67f72cdac56e tempest-ProjectReaderTests-1026512592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80a34632-65b6-4166-9237-cea4c63485cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:28:36 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-e2d693a8-a970-4bc4-9312-67f72cdac56e tempest-ProjectReaderTests-1026512592 None] Flow 'volume_create_manager' (1f56e2a4-b4f6-4b4d-9a17-cbe9207753d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:28:36 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-e2d693a8-a970-4bc4-9312-67f72cdac56e tempest-ProjectReaderTests-1026512592 None] Created volume successfully. Aug 29 01:28:36 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-706f1d57-baaa-49f9-a5fd-b542b99b3c14 tempest-ProjectMemberTests-1570638723 None] Acquiring lock "cinder-449cce49-4e9a-494d-a1c9-e18b7043d50b-delete_snapshot" by "delete_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:28:36 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-706f1d57-baaa-49f9-a5fd-b542b99b3c14 tempest-ProjectMemberTests-1570638723 None] Lock "cinder-449cce49-4e9a-494d-a1c9-e18b7043d50b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:28:36 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-706f1d57-baaa-49f9-a5fd-b542b99b3c14 tempest-ProjectMemberTests-1570638723 None] Acquiring lock "cinder-quobyte-a14cb8da-9fd4-4c7c-b2c0-6a940ad70de3" by "delete_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:28:36 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-706f1d57-baaa-49f9-a5fd-b542b99b3c14 tempest-ProjectMemberTests-1570638723 None] Lock "cinder-quobyte-a14cb8da-9fd4-4c7c-b2c0-6a940ad70de3" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:28:36 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-706f1d57-baaa-49f9-a5fd-b542b99b3c14 tempest-ProjectMemberTests-1570638723 None] Acquiring lock "cinder-quobyte-449cce49-4e9a-494d-a1c9-e18b7043d50b" by "_delete_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:28:36 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-706f1d57-baaa-49f9-a5fd-b542b99b3c14 tempest-ProjectMemberTests-1570638723 None] Lock "cinder-quobyte-449cce49-4e9a-494d-a1c9-e18b7043d50b" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:28:36 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-706f1d57-baaa-49f9-a5fd-b542b99b3c14 tempest-ProjectMemberTests-1570638723 None] Deleting offline snapshot 449cce49-4e9a-494d-a1c9-e18b7043d50b of volume a14cb8da-9fd4-4c7c-b2c0-6a940ad70de3 {{(pid=86111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 29 01:28:36 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-706f1d57-baaa-49f9-a5fd-b542b99b3c14 tempest-ProjectMemberTests-1570638723 None] snapshot_file for this snap is: volume-a14cb8da-9fd4-4c7c-b2c0-6a940ad70de3.449cce49-4e9a-494d-a1c9-e18b7043d50b {{(pid=86111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 29 01:28:36 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[7844b311-d428-4dd2-9cf4-6d3093b428c4]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:28:36 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-706f1d57-baaa-49f9-a5fd-b542b99b3c14 tempest-ProjectMemberTests-1570638723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a14cb8da-9fd4-4c7c-b2c0-6a940ad70de3.449cce49-4e9a-494d-a1c9-e18b7043d50b {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:36 devstack sudo[105214]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:36 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-61f01d3b-3d6d-450a-bdad-9fbe501f8ca4 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-60acf510-dcfc-41eb-8dd8-46d349772944" returned: 0 in 0.307s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:36 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-61f01d3b-3d6d-450a-bdad-9fbe501f8ca4 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Lock "cinder-quobyte-60acf510-dcfc-41eb-8dd8-46d349772944" released by "delete_volume" :: held 0.734s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:28:36 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-c2c0cc0a-070a-429e-afde-4fa03cacb861 tempest-ProjectReaderTests-1026512592 None] Acquiring lock "cinder-04ac99cc-1f68-4522-a37b-dc9bb64cf0e0-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:28:36 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-61f01d3b-3d6d-450a-bdad-9fbe501f8ca4 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Created reservations ['ecfafa0d-f8ef-4d7d-8e22-09f04762cccd', 'cedd03a1-55a4-4e55-982a-eba1cca29591', '58eff58d-7db7-416a-ab0b-a47bd96f8b5f', '0b137152-542a-4b47-889b-8663ae3cc52d'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:28:36 devstack sudo[105221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a14cb8da-9fd4-4c7c-b2c0-6a940ad70de3.449cce49-4e9a-494d-a1c9-e18b7043d50b Aug 29 01:28:36 devstack sudo[105221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:36 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-c2c0cc0a-070a-429e-afde-4fa03cacb861 tempest-ProjectReaderTests-1026512592 None] Lock "cinder-04ac99cc-1f68-4522-a37b-dc9bb64cf0e0-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:28:36 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-c2c0cc0a-070a-429e-afde-4fa03cacb861 tempest-ProjectReaderTests-1026512592 None] Acquiring lock "cinder-quobyte-04ac99cc-1f68-4522-a37b-dc9bb64cf0e0" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:28:36 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-61f01d3b-3d6d-450a-bdad-9fbe501f8ca4 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:28:36 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-61f01d3b-3d6d-450a-bdad-9fbe501f8ca4 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:28:36 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-61f01d3b-3d6d-450a-bdad-9fbe501f8ca4 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:28:36 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-61f01d3b-3d6d-450a-bdad-9fbe501f8ca4 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:28:36 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-61f01d3b-3d6d-450a-bdad-9fbe501f8ca4 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:28:36 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-61f01d3b-3d6d-450a-bdad-9fbe501f8ca4 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:36 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-c2c0cc0a-070a-429e-afde-4fa03cacb861 tempest-ProjectReaderTests-1026512592 None] Lock "cinder-quobyte-04ac99cc-1f68-4522-a37b-dc9bb64cf0e0" acquired by "delete_volume" :: waited 0.049s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:28:36 devstack sudo[105213]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:36 devstack sudo[105223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:28:36 devstack sudo[105223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:36 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c68cd65a-192f-426d-9642-6af45e1e2589 tempest-ProjectReaderTests-1698516188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-92339296-323e-4b99-b174-9e8a85b13b7b 1073741824" returned: 0 in 0.595s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:36 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fe5a3b1-e3f1-452d-8dbb-e2acde3af254]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:28:36 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c2c0cc0a-070a-429e-afde-4fa03cacb861 tempest-ProjectReaderTests-1026512592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-04ac99cc-1f68-4522-a37b-dc9bb64cf0e0 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:36 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c68cd65a-192f-426d-9642-6af45e1e2589 tempest-ProjectReaderTests-1698516188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-92339296-323e-4b99-b174-9e8a85b13b7b {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:36 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-96037107-5348-418c-8cf8-f24915f4d593 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Acquiring lock "cinder-8e646040-b24b-49fa-ac8c-6a09d730eb7a-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:28:36 devstack sudo[105228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-92339296-323e-4b99-b174-9e8a85b13b7b Aug 29 01:28:36 devstack sudo[105228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:36 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-96037107-5348-418c-8cf8-f24915f4d593 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Lock "cinder-8e646040-b24b-49fa-ac8c-6a09d730eb7a-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:28:36 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-96037107-5348-418c-8cf8-f24915f4d593 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Acquiring lock "cinder-quobyte-8e646040-b24b-49fa-ac8c-6a09d730eb7a" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:28:36 devstack sudo[105221]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:36 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-706f1d57-baaa-49f9-a5fd-b542b99b3c14 tempest-ProjectMemberTests-1570638723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a14cb8da-9fd4-4c7c-b2c0-6a940ad70de3.449cce49-4e9a-494d-a1c9-e18b7043d50b" returned: 0 in 0.531s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:36 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-706f1d57-baaa-49f9-a5fd-b542b99b3c14 tempest-ProjectMemberTests-1570638723 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a14cb8da-9fd4-4c7c-b2c0-6a940ad70de3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 29 01:28:36 devstack sudo[105225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-04ac99cc-1f68-4522-a37b-dc9bb64cf0e0 Aug 29 01:28:36 devstack sudo[105225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:36 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-96037107-5348-418c-8cf8-f24915f4d593 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Lock "cinder-quobyte-8e646040-b24b-49fa-ac8c-6a09d730eb7a" acquired by "delete_volume" :: waited 0.052s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:28:36 devstack sudo[105223]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:36 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[76f1701b-4ccf-4ddd-83e9-9c4b6ee71775]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:28:36 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-706f1d57-baaa-49f9-a5fd-b542b99b3c14 tempest-ProjectMemberTests-1570638723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a14cb8da-9fd4-4c7c-b2c0-6a940ad70de3 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:36 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[d492025b-2ffe-4697-a85a-fe8ceed58994]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:28:36 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-96037107-5348-418c-8cf8-f24915f4d593 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-8e646040-b24b-49fa-ac8c-6a09d730eb7a {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:36 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-61f01d3b-3d6d-450a-bdad-9fbe501f8ca4 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.353s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:36 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-61f01d3b-3d6d-450a-bdad-9fbe501f8ca4 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:28:36 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-61f01d3b-3d6d-450a-bdad-9fbe501f8ca4 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Deleted volume successfully. Aug 29 01:28:36 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-61f01d3b-3d6d-450a-bdad-9fbe501f8ca4 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Lock "cinder-60acf510-dcfc-41eb-8dd8-46d349772944-delete_volume" released by "delete_volume" :: held 1.428s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:28:36 devstack sudo[105228]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:36 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c68cd65a-192f-426d-9642-6af45e1e2589 tempest-ProjectReaderTests-1698516188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-92339296-323e-4b99-b174-9e8a85b13b7b" returned: 0 in 0.332s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:36 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-c68cd65a-192f-426d-9642-6af45e1e2589 tempest-ProjectReaderTests-1698516188 None] <== create_volume: return (1011ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:28:36 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-c68cd65a-192f-426d-9642-6af45e1e2589 tempest-ProjectReaderTests-1698516188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.014s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:28:36 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-c68cd65a-192f-426d-9642-6af45e1e2589 tempest-ProjectReaderTests-1698516188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4e4ef27-1f50-4cd3-9973-d269a2868eb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92339296-323e-4b99-b174-9e8a85b13b7b', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:28:36 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-c68cd65a-192f-426d-9642-6af45e1e2589 tempest-ProjectReaderTests-1698516188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f768374-b339-4586-a1e5-1c9477f02427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:28:36 devstack sudo[105233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a14cb8da-9fd4-4c7c-b2c0-6a940ad70de3 Aug 29 01:28:36 devstack sudo[105233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:37 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-c68cd65a-192f-426d-9642-6af45e1e2589 tempest-ProjectReaderTests-1698516188 None] Volume volume-92339296-323e-4b99-b174-9e8a85b13b7b (92339296-323e-4b99-b174-9e8a85b13b7b): created successfully Aug 29 01:28:37 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-c68cd65a-192f-426d-9642-6af45e1e2589 tempest-ProjectReaderTests-1698516188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f768374-b339-4586-a1e5-1c9477f02427) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:28:37 devstack sudo[105234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-8e646040-b24b-49fa-ac8c-6a09d730eb7a Aug 29 01:28:37 devstack sudo[105234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:37 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-c68cd65a-192f-426d-9642-6af45e1e2589 tempest-ProjectReaderTests-1698516188 None] Flow 'volume_create_manager' (064a7eec-5fde-4c5b-a909-4f31570c71aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:28:37 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-c68cd65a-192f-426d-9642-6af45e1e2589 tempest-ProjectReaderTests-1698516188 None] Created volume successfully. Aug 29 01:28:37 devstack sudo[105225]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:37 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c2c0cc0a-070a-429e-afde-4fa03cacb861 tempest-ProjectReaderTests-1026512592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-04ac99cc-1f68-4522-a37b-dc9bb64cf0e0" returned: 0 in 0.548s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:37 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c2c0cc0a-070a-429e-afde-4fa03cacb861 tempest-ProjectReaderTests-1026512592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-04ac99cc-1f68-4522-a37b-dc9bb64cf0e0 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:37 devstack sudo[105241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-04ac99cc-1f68-4522-a37b-dc9bb64cf0e0 Aug 29 01:28:37 devstack sudo[105241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:37 devstack sudo[105233]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:37 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-706f1d57-baaa-49f9-a5fd-b542b99b3c14 tempest-ProjectMemberTests-1570638723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a14cb8da-9fd4-4c7c-b2c0-6a940ad70de3" returned: 0 in 0.440s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:37 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-706f1d57-baaa-49f9-a5fd-b542b99b3c14 tempest-ProjectMemberTests-1570638723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a14cb8da-9fd4-4c7c-b2c0-6a940ad70de3.449cce49-4e9a-494d-a1c9-e18b7043d50b {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:37 devstack sudo[105234]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:37 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-96037107-5348-418c-8cf8-f24915f4d593 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-8e646040-b24b-49fa-ac8c-6a09d730eb7a" returned: 0 in 0.439s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:37 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-96037107-5348-418c-8cf8-f24915f4d593 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-8e646040-b24b-49fa-ac8c-6a09d730eb7a {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:37 devstack sudo[105249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a14cb8da-9fd4-4c7c-b2c0-6a940ad70de3.449cce49-4e9a-494d-a1c9-e18b7043d50b Aug 29 01:28:37 devstack sudo[105249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:37 devstack sudo[105250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-8e646040-b24b-49fa-ac8c-6a09d730eb7a Aug 29 01:28:37 devstack sudo[105250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:37 devstack sudo[105241]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:37 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c2c0cc0a-070a-429e-afde-4fa03cacb861 tempest-ProjectReaderTests-1026512592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-04ac99cc-1f68-4522-a37b-dc9bb64cf0e0" returned: 0 in 0.280s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:37 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-c2c0cc0a-070a-429e-afde-4fa03cacb861 tempest-ProjectReaderTests-1026512592 None] Lock "cinder-quobyte-04ac99cc-1f68-4522-a37b-dc9bb64cf0e0" released by "delete_volume" :: held 0.900s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:28:37 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-c2c0cc0a-070a-429e-afde-4fa03cacb861 tempest-ProjectReaderTests-1026512592 None] Created reservations ['c4360fc4-e984-4b35-be40-ba254622aa0c', '608a6205-b641-4209-a432-ce63855b9a71', 'a8db5136-78ac-44a0-b4c3-a2e898344771', '6afae540-a177-4fc5-a1f1-88b142e1a831'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:28:37 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-c2c0cc0a-070a-429e-afde-4fa03cacb861 tempest-ProjectReaderTests-1026512592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:28:37 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-c2c0cc0a-070a-429e-afde-4fa03cacb861 tempest-ProjectReaderTests-1026512592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:28:37 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-c2c0cc0a-070a-429e-afde-4fa03cacb861 tempest-ProjectReaderTests-1026512592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:28:37 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-c2c0cc0a-070a-429e-afde-4fa03cacb861 tempest-ProjectReaderTests-1026512592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:28:37 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-c2c0cc0a-070a-429e-afde-4fa03cacb861 tempest-ProjectReaderTests-1026512592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:28:37 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c2c0cc0a-070a-429e-afde-4fa03cacb861 tempest-ProjectReaderTests-1026512592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:37 devstack sudo[105250]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:37 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-96037107-5348-418c-8cf8-f24915f4d593 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-8e646040-b24b-49fa-ac8c-6a09d730eb7a" returned: 0 in 0.364s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:37 devstack sudo[105258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:28:37 devstack sudo[105258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:37 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-96037107-5348-418c-8cf8-f24915f4d593 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Lock "cinder-quobyte-8e646040-b24b-49fa-ac8c-6a09d730eb7a" released by "delete_volume" :: held 0.867s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:28:37 devstack sudo[105249]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:37 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-706f1d57-baaa-49f9-a5fd-b542b99b3c14 tempest-ProjectMemberTests-1570638723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a14cb8da-9fd4-4c7c-b2c0-6a940ad70de3.449cce49-4e9a-494d-a1c9-e18b7043d50b" returned: 0 in 0.468s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:37 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-706f1d57-baaa-49f9-a5fd-b542b99b3c14 tempest-ProjectMemberTests-1570638723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a14cb8da-9fd4-4c7c-b2c0-6a940ad70de3.449cce49-4e9a-494d-a1c9-e18b7043d50b {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:37 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-96037107-5348-418c-8cf8-f24915f4d593 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Created reservations ['58aa4776-d216-43f7-b587-b82eafbf74e9', 'e8e50fa2-fe54-4061-8913-72966ae3d7c7', '4e0968da-f219-42af-801e-d205d7785935', '3421b919-49a1-4db6-b857-893aa5d5bfcd'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:28:37 devstack sudo[105260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a14cb8da-9fd4-4c7c-b2c0-6a940ad70de3.449cce49-4e9a-494d-a1c9-e18b7043d50b Aug 29 01:28:37 devstack sudo[105260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:37 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-96037107-5348-418c-8cf8-f24915f4d593 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:28:37 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-96037107-5348-418c-8cf8-f24915f4d593 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:28:37 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-96037107-5348-418c-8cf8-f24915f4d593 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:28:37 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-96037107-5348-418c-8cf8-f24915f4d593 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:28:37 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-96037107-5348-418c-8cf8-f24915f4d593 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:28:37 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-96037107-5348-418c-8cf8-f24915f4d593 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:37 devstack sudo[105262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:28:37 devstack sudo[105262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:37 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-8ec16d24-9d41-4e20-b935-de6a19b1aff1 tempest-ProjectReaderTests-1698516188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:28:37 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-8ec16d24-9d41-4e20-b935-de6a19b1aff1 tempest-ProjectReaderTests-1698516188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:28:37 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-8ec16d24-9d41-4e20-b935-de6a19b1aff1 tempest-ProjectReaderTests-1698516188 None] Creating offline snapshot a3341df2-8c7f-4b93-8eb0-73533945c6a8 of volume 92339296-323e-4b99-b174-9e8a85b13b7b {{(pid=86111) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 29 01:28:37 devstack sudo[105258]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:37 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c2c0cc0a-070a-429e-afde-4fa03cacb861 tempest-ProjectReaderTests-1026512592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.327s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:37 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-c2c0cc0a-070a-429e-afde-4fa03cacb861 tempest-ProjectReaderTests-1026512592 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:28:37 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-c2c0cc0a-070a-429e-afde-4fa03cacb861 tempest-ProjectReaderTests-1026512592 None] Deleted volume successfully. Aug 29 01:28:37 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[131f4dfd-dde0-4eaf-812b-92cf76110a03]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:28:37 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8ec16d24-9d41-4e20-b935-de6a19b1aff1 tempest-ProjectReaderTests-1698516188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-92339296-323e-4b99-b174-9e8a85b13b7b {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:38 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-c2c0cc0a-070a-429e-afde-4fa03cacb861 tempest-ProjectReaderTests-1026512592 None] Lock "cinder-04ac99cc-1f68-4522-a37b-dc9bb64cf0e0-delete_volume" released by "delete_volume" :: held 1.606s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:28:38 devstack sudo[105265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-92339296-323e-4b99-b174-9e8a85b13b7b Aug 29 01:28:38 devstack sudo[105265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:38 devstack sudo[105260]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:38 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-706f1d57-baaa-49f9-a5fd-b542b99b3c14 tempest-ProjectMemberTests-1570638723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a14cb8da-9fd4-4c7c-b2c0-6a940ad70de3.449cce49-4e9a-494d-a1c9-e18b7043d50b" returned: 0 in 0.360s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:38 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-706f1d57-baaa-49f9-a5fd-b542b99b3c14 tempest-ProjectMemberTests-1570638723 None] Lock "cinder-quobyte-449cce49-4e9a-494d-a1c9-e18b7043d50b" released by "_delete_snapshot" :: held 1.950s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:28:38 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-706f1d57-baaa-49f9-a5fd-b542b99b3c14 tempest-ProjectMemberTests-1570638723 None] Lock "cinder-quobyte-a14cb8da-9fd4-4c7c-b2c0-6a940ad70de3" released by "delete_snapshot" :: held 1.983s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:28:38 devstack sudo[105262]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:38 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-96037107-5348-418c-8cf8-f24915f4d593 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.278s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:38 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-96037107-5348-418c-8cf8-f24915f4d593 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:28:38 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-96037107-5348-418c-8cf8-f24915f4d593 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Deleted volume successfully. Aug 29 01:28:38 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-96037107-5348-418c-8cf8-f24915f4d593 tempest-CreateVolumesFromSourceVolumeTest-1929268928 None] Lock "cinder-8e646040-b24b-49fa-ac8c-6a09d730eb7a-delete_volume" released by "delete_volume" :: held 1.504s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:28:38 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-706f1d57-baaa-49f9-a5fd-b542b99b3c14 tempest-ProjectMemberTests-1570638723 None] Created reservations ['79e1b8ea-15ff-40e9-9079-e58be4201378', '6f923031-8e8e-4d18-b3da-b62217a8934a', 'a22b4997-f696-4da9-906f-62b58e35484d', '4da3bb65-aa91-4a04-8eca-f218732ec6d9'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:28:38 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-706f1d57-baaa-49f9-a5fd-b542b99b3c14 tempest-ProjectMemberTests-1570638723 None] Delete snapshot completed successfully. Aug 29 01:28:38 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-706f1d57-baaa-49f9-a5fd-b542b99b3c14 tempest-ProjectMemberTests-1570638723 None] Lock "cinder-449cce49-4e9a-494d-a1c9-e18b7043d50b-delete_snapshot" released by "delete_snapshot" :: held 2.160s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:28:38 devstack sudo[105265]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:38 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8ec16d24-9d41-4e20-b935-de6a19b1aff1 tempest-ProjectReaderTests-1698516188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-92339296-323e-4b99-b174-9e8a85b13b7b" returned: 0 in 0.382s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:38 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8ec16d24-9d41-4e20-b935-de6a19b1aff1 tempest-ProjectReaderTests-1698516188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-92339296-323e-4b99-b174-9e8a85b13b7b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-92339296-323e-4b99-b174-9e8a85b13b7b.a3341df2-8c7f-4b93-8eb0-73533945c6a8 1G {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:38 devstack sudo[105272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-92339296-323e-4b99-b174-9e8a85b13b7b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-92339296-323e-4b99-b174-9e8a85b13b7b.a3341df2-8c7f-4b93-8eb0-73533945c6a8 1G Aug 29 01:28:38 devstack sudo[105272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:38 devstack sudo[105272]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:38 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8ec16d24-9d41-4e20-b935-de6a19b1aff1 tempest-ProjectReaderTests-1698516188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-92339296-323e-4b99-b174-9e8a85b13b7b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-92339296-323e-4b99-b174-9e8a85b13b7b.a3341df2-8c7f-4b93-8eb0-73533945c6a8 1G" returned: 0 in 0.400s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:38 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8ec16d24-9d41-4e20-b935-de6a19b1aff1 tempest-ProjectReaderTests-1698516188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92339296-323e-4b99-b174-9e8a85b13b7b -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-92339296-323e-4b99-b174-9e8a85b13b7b.a3341df2-8c7f-4b93-8eb0-73533945c6a8 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:38 devstack sudo[105277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92339296-323e-4b99-b174-9e8a85b13b7b -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-92339296-323e-4b99-b174-9e8a85b13b7b.a3341df2-8c7f-4b93-8eb0-73533945c6a8 Aug 29 01:28:38 devstack sudo[105277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:39 devstack sudo[105277]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:39 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8ec16d24-9d41-4e20-b935-de6a19b1aff1 tempest-ProjectReaderTests-1698516188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92339296-323e-4b99-b174-9e8a85b13b7b -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-92339296-323e-4b99-b174-9e8a85b13b7b.a3341df2-8c7f-4b93-8eb0-73533945c6a8" returned: 0 in 0.346s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:39 devstack cinder-volume[86111]: WARNING cinder.volume.drivers.remotefs [None req-8ec16d24-9d41-4e20-b935-de6a19b1aff1 tempest-ProjectReaderTests-1698516188 None] /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-92339296-323e-4b99-b174-9e8a85b13b7b.a3341df2-8c7f-4b93-8eb0-73533945c6a8 is being set with open permissions: ugo+rw Aug 29 01:28:39 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8ec16d24-9d41-4e20-b935-de6a19b1aff1 tempest-ProjectReaderTests-1698516188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-92339296-323e-4b99-b174-9e8a85b13b7b.a3341df2-8c7f-4b93-8eb0-73533945c6a8 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:39 devstack cinder-volume[86111]: DEBUG dbcounter [-] [86111] Writing DB stats cinder:UPDATE=324,cinder:SELECT=225,cinder:INSERT=80,cinder:DELETE=29 {{(pid=86111) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 29 01:28:39 devstack sudo[105282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-92339296-323e-4b99-b174-9e8a85b13b7b.a3341df2-8c7f-4b93-8eb0-73533945c6a8 Aug 29 01:28:39 devstack sudo[105282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:39 devstack cinder-volume[86111]: DEBUG dbcounter [-] [86111] Writing DB stats cinder:SELECT=234,cinder:UPDATE=302,cinder:DELETE=27,cinder:INSERT=86 {{(pid=86111) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 29 01:28:39 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-08cdd6b6-f980-406c-b86f-f84e51a95e77 tempest-ProjectReaderTests-1026512592 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:28:39 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-08cdd6b6-f980-406c-b86f-f84e51a95e77 tempest-ProjectReaderTests-1026512592 None] Flow 'volume_create_manager' (b40fafd4-e243-4bd5-9609-33bec4b9d672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:28:39 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-08cdd6b6-f980-406c-b86f-f84e51a95e77 tempest-ProjectReaderTests-1026512592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bf6a907-2ff8-44c7-9b42-5f91198cde37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:28:39 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-08cdd6b6-f980-406c-b86f-f84e51a95e77 tempest-ProjectReaderTests-1026512592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bf6a907-2ff8-44c7-9b42-5f91198cde37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:28:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1687668164',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=892a8c7d-f161-4dfe-9805-9fb4c13d137f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f4ae73a5390439e915c9cd396d75553',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:28:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:28:39Z,use_quota=True,user_id='79682547ae2a4eadac72af1628b4ff73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:28:39 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-08cdd6b6-f980-406c-b86f-f84e51a95e77 tempest-ProjectReaderTests-1026512592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5965a3ad-3678-4dee-9749-22e9519b8d98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:28:39 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-08cdd6b6-f980-406c-b86f-f84e51a95e77 tempest-ProjectReaderTests-1026512592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5965a3ad-3678-4dee-9749-22e9519b8d98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:28:39 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-08cdd6b6-f980-406c-b86f-f84e51a95e77 tempest-ProjectReaderTests-1026512592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04dbdc39-8a17-47c5-9ae0-b87b2b9e36a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:28:39 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-08cdd6b6-f980-406c-b86f-f84e51a95e77 tempest-ProjectReaderTests-1026512592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04dbdc39-8a17-47c5-9ae0-b87b2b9e36a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '892a8c7d-f161-4dfe-9805-9fb4c13d137f', 'volume_name': 'volume-892a8c7d-f161-4dfe-9805-9fb4c13d137f', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:28:39 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-08cdd6b6-f980-406c-b86f-f84e51a95e77 tempest-ProjectReaderTests-1026512592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eec29f1a-47d8-4147-875a-577279d6ed70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:28:39 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-08cdd6b6-f980-406c-b86f-f84e51a95e77 tempest-ProjectReaderTests-1026512592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eec29f1a-47d8-4147-875a-577279d6ed70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:28:39 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-08cdd6b6-f980-406c-b86f-f84e51a95e77 tempest-ProjectReaderTests-1026512592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb263370-3b7e-4e32-87f1-e25287652c4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:28:39 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-08cdd6b6-f980-406c-b86f-f84e51a95e77 tempest-ProjectReaderTests-1026512592 None] Volume 892a8c7d-f161-4dfe-9805-9fb4c13d137f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-892a8c7d-f161-4dfe-9805-9fb4c13d137f', 'volume_size': 1} Aug 29 01:28:39 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-08cdd6b6-f980-406c-b86f-f84e51a95e77 tempest-ProjectReaderTests-1026512592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:28:39 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-ec6ec9e3-3686-41dc-a740-2505902e0bdd tempest-ProjectMemberTests-1570638723 None] Acquiring lock "cinder-a14cb8da-9fd4-4c7c-b2c0-6a940ad70de3-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:28:39 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-ec6ec9e3-3686-41dc-a740-2505902e0bdd tempest-ProjectMemberTests-1570638723 None] Lock "cinder-a14cb8da-9fd4-4c7c-b2c0-6a940ad70de3-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:28:39 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-ec6ec9e3-3686-41dc-a740-2505902e0bdd tempest-ProjectMemberTests-1570638723 None] Acquiring lock "cinder-quobyte-a14cb8da-9fd4-4c7c-b2c0-6a940ad70de3" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:28:39 devstack sudo[105282]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:39 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8ec16d24-9d41-4e20-b935-de6a19b1aff1 tempest-ProjectReaderTests-1698516188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-92339296-323e-4b99-b174-9e8a85b13b7b.a3341df2-8c7f-4b93-8eb0-73533945c6a8" returned: 0 in 0.316s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:39 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-ec6ec9e3-3686-41dc-a740-2505902e0bdd tempest-ProjectMemberTests-1570638723 None] Lock "cinder-quobyte-a14cb8da-9fd4-4c7c-b2c0-6a940ad70de3" acquired by "delete_volume" :: waited 0.028s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:28:39 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[1beeaceb-3341-41f0-9e9a-849a660d7893]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:28:39 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-ec6ec9e3-3686-41dc-a740-2505902e0bdd tempest-ProjectMemberTests-1570638723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a14cb8da-9fd4-4c7c-b2c0-6a940ad70de3 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:39 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8ec16d24-9d41-4e20-b935-de6a19b1aff1 tempest-ProjectReaderTests-1698516188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-92339296-323e-4b99-b174-9e8a85b13b7b.info {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:39 devstack sudo[105287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-92339296-323e-4b99-b174-9e8a85b13b7b.info Aug 29 01:28:39 devstack sudo[105287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:39 devstack sudo[105286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a14cb8da-9fd4-4c7c-b2c0-6a940ad70de3 Aug 29 01:28:39 devstack sudo[105286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:39 devstack sudo[105287]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:39 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8ec16d24-9d41-4e20-b935-de6a19b1aff1 tempest-ProjectReaderTests-1698516188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-92339296-323e-4b99-b174-9e8a85b13b7b.info" returned: 0 in 0.302s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:39 devstack cinder-volume[86111]: WARNING cinder.volume.drivers.remotefs [None req-8ec16d24-9d41-4e20-b935-de6a19b1aff1 tempest-ProjectReaderTests-1698516188 None] /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-92339296-323e-4b99-b174-9e8a85b13b7b.info is being set with open permissions: ugo+rw Aug 29 01:28:39 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8ec16d24-9d41-4e20-b935-de6a19b1aff1 tempest-ProjectReaderTests-1698516188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-92339296-323e-4b99-b174-9e8a85b13b7b.info {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:39 devstack sudo[105293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-92339296-323e-4b99-b174-9e8a85b13b7b.info Aug 29 01:28:39 devstack sudo[105293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:39 devstack sudo[105286]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:39 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-ec6ec9e3-3686-41dc-a740-2505902e0bdd tempest-ProjectMemberTests-1570638723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a14cb8da-9fd4-4c7c-b2c0-6a940ad70de3" returned: 0 in 0.398s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:39 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-ec6ec9e3-3686-41dc-a740-2505902e0bdd tempest-ProjectMemberTests-1570638723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a14cb8da-9fd4-4c7c-b2c0-6a940ad70de3 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:39 devstack sudo[105296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a14cb8da-9fd4-4c7c-b2c0-6a940ad70de3 Aug 29 01:28:39 devstack sudo[105296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:40 devstack sudo[105293]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8ec16d24-9d41-4e20-b935-de6a19b1aff1 tempest-ProjectReaderTests-1698516188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-92339296-323e-4b99-b174-9e8a85b13b7b.info" returned: 0 in 0.284s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-8ec16d24-9d41-4e20-b935-de6a19b1aff1 tempest-ProjectReaderTests-1698516188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.192s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:28:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-08cdd6b6-f980-406c-b86f-f84e51a95e77 tempest-ProjectReaderTests-1026512592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.863s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:28:40 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-08cdd6b6-f980-406c-b86f-f84e51a95e77 tempest-ProjectReaderTests-1026512592 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:28:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1687668164',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=892a8c7d-f161-4dfe-9805-9fb4c13d137f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f4ae73a5390439e915c9cd396d75553',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:28:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:28:39Z,use_quota=True,user_id='79682547ae2a4eadac72af1628b4ff73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:28:40 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-08cdd6b6-f980-406c-b86f-f84e51a95e77 tempest-ProjectReaderTests-1026512592 None] Creating volume 892a8c7d-f161-4dfe-9805-9fb4c13d137f {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:28:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-08cdd6b6-f980-406c-b86f-f84e51a95e77 tempest-ProjectReaderTests-1026512592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:28:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-08cdd6b6-f980-406c-b86f-f84e51a95e77 tempest-ProjectReaderTests-1026512592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:28:40 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-08cdd6b6-f980-406c-b86f-f84e51a95e77 tempest-ProjectReaderTests-1026512592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:28:40 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-08cdd6b6-f980-406c-b86f-f84e51a95e77 tempest-ProjectReaderTests-1026512592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:28:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-08cdd6b6-f980-406c-b86f-f84e51a95e77 tempest-ProjectReaderTests-1026512592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:28:40 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-08cdd6b6-f980-406c-b86f-f84e51a95e77 tempest-ProjectReaderTests-1026512592 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:28:40 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-08cdd6b6-f980-406c-b86f-f84e51a95e77 tempest-ProjectReaderTests-1026512592 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:28:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-08cdd6b6-f980-406c-b86f-f84e51a95e77 tempest-ProjectReaderTests-1026512592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-892a8c7d-f161-4dfe-9805-9fb4c13d137f 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:40 devstack sudo[105296]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-ec6ec9e3-3686-41dc-a740-2505902e0bdd tempest-ProjectMemberTests-1570638723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-a14cb8da-9fd4-4c7c-b2c0-6a940ad70de3" returned: 0 in 0.290s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:40 devstack sudo[105300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-892a8c7d-f161-4dfe-9805-9fb4c13d137f 1073741824 Aug 29 01:28:40 devstack sudo[105300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:40 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-ec6ec9e3-3686-41dc-a740-2505902e0bdd tempest-ProjectMemberTests-1570638723 None] Lock "cinder-quobyte-a14cb8da-9fd4-4c7c-b2c0-6a940ad70de3" released by "delete_volume" :: held 0.756s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:28:40 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-8ec16d24-9d41-4e20-b935-de6a19b1aff1 tempest-ProjectReaderTests-1698516188 None] Create snapshot completed successfully Aug 29 01:28:40 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-ec6ec9e3-3686-41dc-a740-2505902e0bdd tempest-ProjectMemberTests-1570638723 None] Created reservations ['0a8f9279-115c-4393-8a94-76af73611e6e', '29a50442-296d-4c0f-befd-e70ee47fd9d4', '71fd857b-733e-49ef-afe9-a7357d0ed3d0', 'ea53eac0-899c-4416-8713-e8f02280dbbe'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:28:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-ec6ec9e3-3686-41dc-a740-2505902e0bdd tempest-ProjectMemberTests-1570638723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:28:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-ec6ec9e3-3686-41dc-a740-2505902e0bdd tempest-ProjectMemberTests-1570638723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:28:40 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-ec6ec9e3-3686-41dc-a740-2505902e0bdd tempest-ProjectMemberTests-1570638723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:28:40 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-ec6ec9e3-3686-41dc-a740-2505902e0bdd tempest-ProjectMemberTests-1570638723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:28:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-ec6ec9e3-3686-41dc-a740-2505902e0bdd tempest-ProjectMemberTests-1570638723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:28:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-ec6ec9e3-3686-41dc-a740-2505902e0bdd tempest-ProjectMemberTests-1570638723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:40 devstack sudo[105302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:28:40 devstack sudo[105302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:40 devstack sudo[105302]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-ec6ec9e3-3686-41dc-a740-2505902e0bdd tempest-ProjectMemberTests-1570638723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.275s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:40 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-ec6ec9e3-3686-41dc-a740-2505902e0bdd tempest-ProjectMemberTests-1570638723 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:28:40 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-ec6ec9e3-3686-41dc-a740-2505902e0bdd tempest-ProjectMemberTests-1570638723 None] Deleted volume successfully. Aug 29 01:28:40 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-ec6ec9e3-3686-41dc-a740-2505902e0bdd tempest-ProjectMemberTests-1570638723 None] Lock "cinder-a14cb8da-9fd4-4c7c-b2c0-6a940ad70de3-delete_volume" released by "delete_volume" :: held 1.281s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:28:40 devstack sudo[105300]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-08cdd6b6-f980-406c-b86f-f84e51a95e77 tempest-ProjectReaderTests-1026512592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-892a8c7d-f161-4dfe-9805-9fb4c13d137f 1073741824" returned: 0 in 0.534s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-08cdd6b6-f980-406c-b86f-f84e51a95e77 tempest-ProjectReaderTests-1026512592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-892a8c7d-f161-4dfe-9805-9fb4c13d137f {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:40 devstack sudo[105309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-892a8c7d-f161-4dfe-9805-9fb4c13d137f Aug 29 01:28:40 devstack sudo[105309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:40 devstack cinder-volume[86111]: DEBUG oslo_service.periodic_task [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86111) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 29 01:28:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:28:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:28:40 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:28:40 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:28:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:28:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:40 devstack sudo[105311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:28:40 devstack sudo[105311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:41 devstack sudo[105309]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:41 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-08cdd6b6-f980-406c-b86f-f84e51a95e77 tempest-ProjectReaderTests-1026512592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-892a8c7d-f161-4dfe-9805-9fb4c13d137f" returned: 0 in 0.336s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:41 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-08cdd6b6-f980-406c-b86f-f84e51a95e77 tempest-ProjectReaderTests-1026512592 None] <== create_volume: return (924ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:28:41 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-08cdd6b6-f980-406c-b86f-f84e51a95e77 tempest-ProjectReaderTests-1026512592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.928s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:28:41 devstack sudo[105311]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:41 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-08cdd6b6-f980-406c-b86f-f84e51a95e77 tempest-ProjectReaderTests-1026512592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb263370-3b7e-4e32-87f1-e25287652c4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-892a8c7d-f161-4dfe-9805-9fb4c13d137f', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:28:41 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-08cdd6b6-f980-406c-b86f-f84e51a95e77 tempest-ProjectReaderTests-1026512592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1730998-173f-48d7-bfe5-3ea993cfa435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:28:41 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-de752545-d617-440e-8362-d04fae0901a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.314s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:41 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:28:41 devstack cinder-volume[86111]: DEBUG oslo_service.periodic_task [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Running periodic task VolumeManager._thread_info {{(pid=86111) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 29 01:28:41 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-de752545-d617-440e-8362-d04fae0901a5 None None] thread count: 28 {{(pid=86111) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 29 01:28:41 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-de752545-d617-440e-8362-d04fae0901a5 None None] thread info: [<_MainThread(MainThread, started 129173440548992)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86111) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 29 01:28:41 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-08cdd6b6-f980-406c-b86f-f84e51a95e77 tempest-ProjectReaderTests-1026512592 None] Volume volume-892a8c7d-f161-4dfe-9805-9fb4c13d137f (892a8c7d-f161-4dfe-9805-9fb4c13d137f): created successfully Aug 29 01:28:41 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-08cdd6b6-f980-406c-b86f-f84e51a95e77 tempest-ProjectReaderTests-1026512592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1730998-173f-48d7-bfe5-3ea993cfa435) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:28:41 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-08cdd6b6-f980-406c-b86f-f84e51a95e77 tempest-ProjectReaderTests-1026512592 None] Flow 'volume_create_manager' (b40fafd4-e243-4bd5-9609-33bec4b9d672) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:28:41 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-08cdd6b6-f980-406c-b86f-f84e51a95e77 tempest-ProjectReaderTests-1026512592 None] Created volume successfully. Aug 29 01:28:41 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-21baccfb-daba-487e-941e-9ab208e628be tempest-ProjectMemberTests-1570638723 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:28:41 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-21baccfb-daba-487e-941e-9ab208e628be tempest-ProjectMemberTests-1570638723 None] Flow 'volume_create_manager' (fcd05440-3242-448a-9684-d9907eeaba7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:28:41 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-21baccfb-daba-487e-941e-9ab208e628be tempest-ProjectMemberTests-1570638723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (741f2e5b-9f9a-4636-a1a2-4d8877ecd4fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:28:41 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-21baccfb-daba-487e-941e-9ab208e628be tempest-ProjectMemberTests-1570638723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (741f2e5b-9f9a-4636-a1a2-4d8877ecd4fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:28:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1081222876',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a3cad99-b6cb-45cd-b5e0-72b2221ed88e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc3e18b86dee456398aada5b169dc198',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:28:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:28:41Z,use_quota=True,user_id='ea18f1190bab494589a803742a7eb22a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:28:41 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-21baccfb-daba-487e-941e-9ab208e628be tempest-ProjectMemberTests-1570638723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e79e4395-fe23-4883-adbd-46f17b103eac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:28:41 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-21baccfb-daba-487e-941e-9ab208e628be tempest-ProjectMemberTests-1570638723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e79e4395-fe23-4883-adbd-46f17b103eac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:28:41 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-21baccfb-daba-487e-941e-9ab208e628be tempest-ProjectMemberTests-1570638723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a5f6bb2-d7d5-42ad-89fb-8d86464bf0ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:28:41 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-21baccfb-daba-487e-941e-9ab208e628be tempest-ProjectMemberTests-1570638723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a5f6bb2-d7d5-42ad-89fb-8d86464bf0ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a3cad99-b6cb-45cd-b5e0-72b2221ed88e', 'volume_name': 'volume-4a3cad99-b6cb-45cd-b5e0-72b2221ed88e', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:28:41 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-21baccfb-daba-487e-941e-9ab208e628be tempest-ProjectMemberTests-1570638723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (041f24fa-71c2-47b6-935d-19f70140864d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:28:41 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-21baccfb-daba-487e-941e-9ab208e628be tempest-ProjectMemberTests-1570638723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (041f24fa-71c2-47b6-935d-19f70140864d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:28:41 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-21baccfb-daba-487e-941e-9ab208e628be tempest-ProjectMemberTests-1570638723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fbe6785-b973-4363-99dc-5371877afd99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:28:41 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-21baccfb-daba-487e-941e-9ab208e628be tempest-ProjectMemberTests-1570638723 None] Volume 4a3cad99-b6cb-45cd-b5e0-72b2221ed88e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a3cad99-b6cb-45cd-b5e0-72b2221ed88e', 'volume_size': 1} Aug 29 01:28:41 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-21baccfb-daba-487e-941e-9ab208e628be tempest-ProjectMemberTests-1570638723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:28:41 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-21baccfb-daba-487e-941e-9ab208e628be tempest-ProjectMemberTests-1570638723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:28:41 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-21baccfb-daba-487e-941e-9ab208e628be tempest-ProjectMemberTests-1570638723 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:28:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1081222876',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a3cad99-b6cb-45cd-b5e0-72b2221ed88e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc3e18b86dee456398aada5b169dc198',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:28:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:28:41Z,use_quota=True,user_id='ea18f1190bab494589a803742a7eb22a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:28:41 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-21baccfb-daba-487e-941e-9ab208e628be tempest-ProjectMemberTests-1570638723 None] Creating volume 4a3cad99-b6cb-45cd-b5e0-72b2221ed88e {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:28:41 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-21baccfb-daba-487e-941e-9ab208e628be tempest-ProjectMemberTests-1570638723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:28:41 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-21baccfb-daba-487e-941e-9ab208e628be tempest-ProjectMemberTests-1570638723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:28:41 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-21baccfb-daba-487e-941e-9ab208e628be tempest-ProjectMemberTests-1570638723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:28:41 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-21baccfb-daba-487e-941e-9ab208e628be tempest-ProjectMemberTests-1570638723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:28:41 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-21baccfb-daba-487e-941e-9ab208e628be tempest-ProjectMemberTests-1570638723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:28:41 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-21baccfb-daba-487e-941e-9ab208e628be tempest-ProjectMemberTests-1570638723 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:28:41 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-21baccfb-daba-487e-941e-9ab208e628be tempest-ProjectMemberTests-1570638723 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:28:41 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-21baccfb-daba-487e-941e-9ab208e628be tempest-ProjectMemberTests-1570638723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-4a3cad99-b6cb-45cd-b5e0-72b2221ed88e 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:41 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-c0e2710a-9eb8-4280-a423-0ef6c80ff4b2 tempest-ProjectReaderTests-1026512592 None] Acquiring lock "cinder-892a8c7d-f161-4dfe-9805-9fb4c13d137f-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:28:41 devstack sudo[105315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-4a3cad99-b6cb-45cd-b5e0-72b2221ed88e 1073741824 Aug 29 01:28:41 devstack sudo[105315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:41 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-c0e2710a-9eb8-4280-a423-0ef6c80ff4b2 tempest-ProjectReaderTests-1026512592 None] Lock "cinder-892a8c7d-f161-4dfe-9805-9fb4c13d137f-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:28:41 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-8fd9a98a-6710-4cc7-a6a6-afed1b21552c tempest-ProjectReaderTests-1698516188 None] Acquiring lock "cinder-a3341df2-8c7f-4b93-8eb0-73533945c6a8-delete_snapshot" by "delete_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:28:41 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-8fd9a98a-6710-4cc7-a6a6-afed1b21552c tempest-ProjectReaderTests-1698516188 None] Lock "cinder-a3341df2-8c7f-4b93-8eb0-73533945c6a8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:28:41 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-8fd9a98a-6710-4cc7-a6a6-afed1b21552c tempest-ProjectReaderTests-1698516188 None] Acquiring lock "cinder-quobyte-92339296-323e-4b99-b174-9e8a85b13b7b" by "delete_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:28:41 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-c0e2710a-9eb8-4280-a423-0ef6c80ff4b2 tempest-ProjectReaderTests-1026512592 None] Acquiring lock "cinder-quobyte-892a8c7d-f161-4dfe-9805-9fb4c13d137f" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:28:41 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-8fd9a98a-6710-4cc7-a6a6-afed1b21552c tempest-ProjectReaderTests-1698516188 None] Lock "cinder-quobyte-92339296-323e-4b99-b174-9e8a85b13b7b" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:28:41 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-8fd9a98a-6710-4cc7-a6a6-afed1b21552c tempest-ProjectReaderTests-1698516188 None] Acquiring lock "cinder-quobyte-a3341df2-8c7f-4b93-8eb0-73533945c6a8" by "_delete_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:28:41 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-c0e2710a-9eb8-4280-a423-0ef6c80ff4b2 tempest-ProjectReaderTests-1026512592 None] Lock "cinder-quobyte-892a8c7d-f161-4dfe-9805-9fb4c13d137f" acquired by "delete_volume" :: waited 0.031s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:28:41 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-8fd9a98a-6710-4cc7-a6a6-afed1b21552c tempest-ProjectReaderTests-1698516188 None] Lock "cinder-quobyte-a3341df2-8c7f-4b93-8eb0-73533945c6a8" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:28:41 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-8fd9a98a-6710-4cc7-a6a6-afed1b21552c tempest-ProjectReaderTests-1698516188 None] Deleting offline snapshot a3341df2-8c7f-4b93-8eb0-73533945c6a8 of volume 92339296-323e-4b99-b174-9e8a85b13b7b {{(pid=86111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 29 01:28:41 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-8fd9a98a-6710-4cc7-a6a6-afed1b21552c tempest-ProjectReaderTests-1698516188 None] snapshot_file for this snap is: volume-92339296-323e-4b99-b174-9e8a85b13b7b.a3341df2-8c7f-4b93-8eb0-73533945c6a8 {{(pid=86111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 29 01:28:41 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[13be3158-3128-4adf-9779-5a4cd9cbd60e]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:28:41 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c0e2710a-9eb8-4280-a423-0ef6c80ff4b2 tempest-ProjectReaderTests-1026512592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-892a8c7d-f161-4dfe-9805-9fb4c13d137f {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:41 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7a4c515-5f48-409c-9c2e-3480a9d0bca9]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:28:41 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8fd9a98a-6710-4cc7-a6a6-afed1b21552c tempest-ProjectReaderTests-1698516188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-92339296-323e-4b99-b174-9e8a85b13b7b.a3341df2-8c7f-4b93-8eb0-73533945c6a8 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:41 devstack sudo[105317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-892a8c7d-f161-4dfe-9805-9fb4c13d137f Aug 29 01:28:41 devstack sudo[105317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:41 devstack sudo[105318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-92339296-323e-4b99-b174-9e8a85b13b7b.a3341df2-8c7f-4b93-8eb0-73533945c6a8 Aug 29 01:28:41 devstack sudo[105318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:41 devstack sudo[105315]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:41 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-21baccfb-daba-487e-941e-9ab208e628be tempest-ProjectMemberTests-1570638723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-4a3cad99-b6cb-45cd-b5e0-72b2221ed88e 1073741824" returned: 0 in 0.600s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:41 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-21baccfb-daba-487e-941e-9ab208e628be tempest-ProjectMemberTests-1570638723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-4a3cad99-b6cb-45cd-b5e0-72b2221ed88e {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:42 devstack sudo[105332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-4a3cad99-b6cb-45cd-b5e0-72b2221ed88e Aug 29 01:28:42 devstack sudo[105332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:42 devstack sudo[105317]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:42 devstack sudo[105318]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:42 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8fd9a98a-6710-4cc7-a6a6-afed1b21552c tempest-ProjectReaderTests-1698516188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-92339296-323e-4b99-b174-9e8a85b13b7b.a3341df2-8c7f-4b93-8eb0-73533945c6a8" returned: 0 in 0.497s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:42 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c0e2710a-9eb8-4280-a423-0ef6c80ff4b2 tempest-ProjectReaderTests-1026512592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-892a8c7d-f161-4dfe-9805-9fb4c13d137f" returned: 0 in 0.515s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:42 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-8fd9a98a-6710-4cc7-a6a6-afed1b21552c tempest-ProjectReaderTests-1698516188 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-92339296-323e-4b99-b174-9e8a85b13b7b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 29 01:28:42 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c0e2710a-9eb8-4280-a423-0ef6c80ff4b2 tempest-ProjectReaderTests-1026512592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-892a8c7d-f161-4dfe-9805-9fb4c13d137f {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:42 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[a98b7708-1ed9-47e5-a423-881018161b56]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:28:42 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8fd9a98a-6710-4cc7-a6a6-afed1b21552c tempest-ProjectReaderTests-1698516188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-92339296-323e-4b99-b174-9e8a85b13b7b {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:42 devstack sudo[105334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-892a8c7d-f161-4dfe-9805-9fb4c13d137f Aug 29 01:28:42 devstack sudo[105334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:42 devstack sudo[105335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-92339296-323e-4b99-b174-9e8a85b13b7b Aug 29 01:28:42 devstack sudo[105335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:42 devstack sudo[105332]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:42 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-21baccfb-daba-487e-941e-9ab208e628be tempest-ProjectMemberTests-1570638723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-4a3cad99-b6cb-45cd-b5e0-72b2221ed88e" returned: 0 in 0.299s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:42 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-21baccfb-daba-487e-941e-9ab208e628be tempest-ProjectMemberTests-1570638723 None] <== create_volume: return (987ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:28:42 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-21baccfb-daba-487e-941e-9ab208e628be tempest-ProjectMemberTests-1570638723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.991s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:28:42 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-21baccfb-daba-487e-941e-9ab208e628be tempest-ProjectMemberTests-1570638723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fbe6785-b973-4363-99dc-5371877afd99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a3cad99-b6cb-45cd-b5e0-72b2221ed88e', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:28:42 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-21baccfb-daba-487e-941e-9ab208e628be tempest-ProjectMemberTests-1570638723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5eaae3f7-09e0-419b-8398-3f921122eb8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:28:42 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-21baccfb-daba-487e-941e-9ab208e628be tempest-ProjectMemberTests-1570638723 None] Volume volume-4a3cad99-b6cb-45cd-b5e0-72b2221ed88e (4a3cad99-b6cb-45cd-b5e0-72b2221ed88e): created successfully Aug 29 01:28:42 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-21baccfb-daba-487e-941e-9ab208e628be tempest-ProjectMemberTests-1570638723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5eaae3f7-09e0-419b-8398-3f921122eb8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:28:42 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-21baccfb-daba-487e-941e-9ab208e628be tempest-ProjectMemberTests-1570638723 None] Flow 'volume_create_manager' (fcd05440-3242-448a-9684-d9907eeaba7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:28:42 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-21baccfb-daba-487e-941e-9ab208e628be tempest-ProjectMemberTests-1570638723 None] Created volume successfully. Aug 29 01:28:42 devstack sudo[105334]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:42 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c0e2710a-9eb8-4280-a423-0ef6c80ff4b2 tempest-ProjectReaderTests-1026512592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-892a8c7d-f161-4dfe-9805-9fb4c13d137f" returned: 0 in 0.300s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:42 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-c0e2710a-9eb8-4280-a423-0ef6c80ff4b2 tempest-ProjectReaderTests-1026512592 None] Lock "cinder-quobyte-892a8c7d-f161-4dfe-9805-9fb4c13d137f" released by "delete_volume" :: held 0.893s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:28:42 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-c0e2710a-9eb8-4280-a423-0ef6c80ff4b2 tempest-ProjectReaderTests-1026512592 None] Created reservations ['d2fd806f-18fd-486b-ba15-06193c8766f6', '10cb1b42-b862-4df0-8043-6bd5ecdffca8', '98be1257-4331-4e4f-ae27-c5ea12b3645c', 'd29cb676-47b6-4721-9318-929e7e515490'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:28:42 devstack sudo[105335]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:42 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-c0e2710a-9eb8-4280-a423-0ef6c80ff4b2 tempest-ProjectReaderTests-1026512592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:28:42 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-c0e2710a-9eb8-4280-a423-0ef6c80ff4b2 tempest-ProjectReaderTests-1026512592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:28:42 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-c0e2710a-9eb8-4280-a423-0ef6c80ff4b2 tempest-ProjectReaderTests-1026512592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:28:42 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-c0e2710a-9eb8-4280-a423-0ef6c80ff4b2 tempest-ProjectReaderTests-1026512592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:28:42 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-c0e2710a-9eb8-4280-a423-0ef6c80ff4b2 tempest-ProjectReaderTests-1026512592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:28:42 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c0e2710a-9eb8-4280-a423-0ef6c80ff4b2 tempest-ProjectReaderTests-1026512592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:42 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8fd9a98a-6710-4cc7-a6a6-afed1b21552c tempest-ProjectReaderTests-1698516188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-92339296-323e-4b99-b174-9e8a85b13b7b" returned: 0 in 0.470s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:42 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8fd9a98a-6710-4cc7-a6a6-afed1b21552c tempest-ProjectReaderTests-1698516188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-92339296-323e-4b99-b174-9e8a85b13b7b.a3341df2-8c7f-4b93-8eb0-73533945c6a8 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:42 devstack sudo[105343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:28:42 devstack sudo[105343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:42 devstack sudo[105344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-92339296-323e-4b99-b174-9e8a85b13b7b.a3341df2-8c7f-4b93-8eb0-73533945c6a8 Aug 29 01:28:42 devstack sudo[105344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:42 devstack sudo[105343]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:42 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c0e2710a-9eb8-4280-a423-0ef6c80ff4b2 tempest-ProjectReaderTests-1026512592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.326s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:42 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-c0e2710a-9eb8-4280-a423-0ef6c80ff4b2 tempest-ProjectReaderTests-1026512592 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:28:42 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-c0e2710a-9eb8-4280-a423-0ef6c80ff4b2 tempest-ProjectReaderTests-1026512592 None] Deleted volume successfully. Aug 29 01:28:42 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-c0e2710a-9eb8-4280-a423-0ef6c80ff4b2 tempest-ProjectReaderTests-1026512592 None] Lock "cinder-892a8c7d-f161-4dfe-9805-9fb4c13d137f-delete_volume" released by "delete_volume" :: held 1.556s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:28:43 devstack sudo[105344]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:43 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8fd9a98a-6710-4cc7-a6a6-afed1b21552c tempest-ProjectReaderTests-1698516188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-92339296-323e-4b99-b174-9e8a85b13b7b.a3341df2-8c7f-4b93-8eb0-73533945c6a8" returned: 0 in 0.461s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:43 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8fd9a98a-6710-4cc7-a6a6-afed1b21552c tempest-ProjectReaderTests-1698516188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-92339296-323e-4b99-b174-9e8a85b13b7b.a3341df2-8c7f-4b93-8eb0-73533945c6a8 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:43 devstack sudo[105351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-92339296-323e-4b99-b174-9e8a85b13b7b.a3341df2-8c7f-4b93-8eb0-73533945c6a8 Aug 29 01:28:43 devstack sudo[105351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:43 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a4f1811-46eb-4b01-89e7-7672db4bf4d5 tempest-ProjectReaderTests-1026512592 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:28:43 devstack sudo[105351]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:43 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-7a4f1811-46eb-4b01-89e7-7672db4bf4d5 tempest-ProjectReaderTests-1026512592 None] Flow 'volume_create_manager' (2d677f94-a6b9-4f70-ad3b-d0ccc029484c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:28:43 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-7a4f1811-46eb-4b01-89e7-7672db4bf4d5 tempest-ProjectReaderTests-1026512592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82e3da3e-a167-4089-a3d5-bd45935ddec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:28:43 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8fd9a98a-6710-4cc7-a6a6-afed1b21552c tempest-ProjectReaderTests-1698516188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-92339296-323e-4b99-b174-9e8a85b13b7b.a3341df2-8c7f-4b93-8eb0-73533945c6a8" returned: 0 in 0.315s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:43 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-7a4f1811-46eb-4b01-89e7-7672db4bf4d5 tempest-ProjectReaderTests-1026512592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82e3da3e-a167-4089-a3d5-bd45935ddec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:28:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-559281205',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a2a1d0f-974a-4a52-9081-ea1c850b1653,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f4ae73a5390439e915c9cd396d75553',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:28:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:28:43Z,use_quota=True,user_id='79682547ae2a4eadac72af1628b4ff73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:28:43 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-7a4f1811-46eb-4b01-89e7-7672db4bf4d5 tempest-ProjectReaderTests-1026512592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfbfbaab-6c34-4d5a-ae36-173d9ebe7ac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:28:43 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-7a4f1811-46eb-4b01-89e7-7672db4bf4d5 tempest-ProjectReaderTests-1026512592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfbfbaab-6c34-4d5a-ae36-173d9ebe7ac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:28:43 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-7a4f1811-46eb-4b01-89e7-7672db4bf4d5 tempest-ProjectReaderTests-1026512592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b84cc56-5bbc-4bbf-84b5-cab6a6a6901c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:28:43 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-7a4f1811-46eb-4b01-89e7-7672db4bf4d5 tempest-ProjectReaderTests-1026512592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b84cc56-5bbc-4bbf-84b5-cab6a6a6901c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a2a1d0f-974a-4a52-9081-ea1c850b1653', 'volume_name': 'volume-3a2a1d0f-974a-4a52-9081-ea1c850b1653', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:28:43 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-7a4f1811-46eb-4b01-89e7-7672db4bf4d5 tempest-ProjectReaderTests-1026512592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7dd48a2-e9ee-40ef-b215-f6b5f3fe73cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:28:43 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-7a4f1811-46eb-4b01-89e7-7672db4bf4d5 tempest-ProjectReaderTests-1026512592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7dd48a2-e9ee-40ef-b215-f6b5f3fe73cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:28:43 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-7a4f1811-46eb-4b01-89e7-7672db4bf4d5 tempest-ProjectReaderTests-1026512592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fe25a2a-586b-4800-9431-83e39c7f6478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:28:43 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-7a4f1811-46eb-4b01-89e7-7672db4bf4d5 tempest-ProjectReaderTests-1026512592 None] Volume 3a2a1d0f-974a-4a52-9081-ea1c850b1653: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a2a1d0f-974a-4a52-9081-ea1c850b1653', 'volume_size': 1} Aug 29 01:28:43 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-7a4f1811-46eb-4b01-89e7-7672db4bf4d5 tempest-ProjectReaderTests-1026512592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:28:43 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-7a4f1811-46eb-4b01-89e7-7672db4bf4d5 tempest-ProjectReaderTests-1026512592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:28:43 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-7a4f1811-46eb-4b01-89e7-7672db4bf4d5 tempest-ProjectReaderTests-1026512592 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:28:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-559281205',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a2a1d0f-974a-4a52-9081-ea1c850b1653,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f4ae73a5390439e915c9cd396d75553',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:28:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:28:43Z,use_quota=True,user_id='79682547ae2a4eadac72af1628b4ff73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:28:43 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-7a4f1811-46eb-4b01-89e7-7672db4bf4d5 tempest-ProjectReaderTests-1026512592 None] Creating volume 3a2a1d0f-974a-4a52-9081-ea1c850b1653 {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:28:43 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-7a4f1811-46eb-4b01-89e7-7672db4bf4d5 tempest-ProjectReaderTests-1026512592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:28:43 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-7a4f1811-46eb-4b01-89e7-7672db4bf4d5 tempest-ProjectReaderTests-1026512592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:28:43 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-7a4f1811-46eb-4b01-89e7-7672db4bf4d5 tempest-ProjectReaderTests-1026512592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:28:43 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-7a4f1811-46eb-4b01-89e7-7672db4bf4d5 tempest-ProjectReaderTests-1026512592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:28:43 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-7a4f1811-46eb-4b01-89e7-7672db4bf4d5 tempest-ProjectReaderTests-1026512592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:28:43 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-7a4f1811-46eb-4b01-89e7-7672db4bf4d5 tempest-ProjectReaderTests-1026512592 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:28:43 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-7a4f1811-46eb-4b01-89e7-7672db4bf4d5 tempest-ProjectReaderTests-1026512592 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:28:43 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-7a4f1811-46eb-4b01-89e7-7672db4bf4d5 tempest-ProjectReaderTests-1026512592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3a2a1d0f-974a-4a52-9081-ea1c850b1653 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:43 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-8fd9a98a-6710-4cc7-a6a6-afed1b21552c tempest-ProjectReaderTests-1698516188 None] Lock "cinder-quobyte-a3341df2-8c7f-4b93-8eb0-73533945c6a8" released by "_delete_snapshot" :: held 1.935s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:28:43 devstack sudo[105354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3a2a1d0f-974a-4a52-9081-ea1c850b1653 1073741824 Aug 29 01:28:43 devstack sudo[105354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:43 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-8fd9a98a-6710-4cc7-a6a6-afed1b21552c tempest-ProjectReaderTests-1698516188 None] Lock "cinder-quobyte-92339296-323e-4b99-b174-9e8a85b13b7b" released by "delete_snapshot" :: held 1.997s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:28:43 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-623e516b-856f-4e69-a0b6-dfb461fb408c tempest-ProjectMemberTests-1570638723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:28:43 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-8fd9a98a-6710-4cc7-a6a6-afed1b21552c tempest-ProjectReaderTests-1698516188 None] Created reservations ['ed4e461f-cc58-4851-8f90-2aae0c14fe12', '5b26879d-4839-44a2-adb6-3ea06e5baa6c', '986eac76-4d21-4217-994d-c9adef74a7f9', 'f8f2b3b0-2ed1-48fa-9401-77874093f731'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:28:43 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-8fd9a98a-6710-4cc7-a6a6-afed1b21552c tempest-ProjectReaderTests-1698516188 None] Delete snapshot completed successfully. Aug 29 01:28:43 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-8fd9a98a-6710-4cc7-a6a6-afed1b21552c tempest-ProjectReaderTests-1698516188 None] Lock "cinder-a3341df2-8c7f-4b93-8eb0-73533945c6a8-delete_snapshot" released by "delete_snapshot" :: held 2.211s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:28:43 devstack sudo[105354]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:43 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-7a4f1811-46eb-4b01-89e7-7672db4bf4d5 tempest-ProjectReaderTests-1026512592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3a2a1d0f-974a-4a52-9081-ea1c850b1653 1073741824" returned: 0 in 0.430s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:43 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-7a4f1811-46eb-4b01-89e7-7672db4bf4d5 tempest-ProjectReaderTests-1026512592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3a2a1d0f-974a-4a52-9081-ea1c850b1653 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:43 devstack sudo[105360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3a2a1d0f-974a-4a52-9081-ea1c850b1653 Aug 29 01:28:43 devstack sudo[105360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:44 devstack sudo[105360]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:44 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-7a4f1811-46eb-4b01-89e7-7672db4bf4d5 tempest-ProjectReaderTests-1026512592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3a2a1d0f-974a-4a52-9081-ea1c850b1653" returned: 0 in 0.244s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:44 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-7a4f1811-46eb-4b01-89e7-7672db4bf4d5 tempest-ProjectReaderTests-1026512592 None] <== create_volume: return (711ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:28:44 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-7a4f1811-46eb-4b01-89e7-7672db4bf4d5 tempest-ProjectReaderTests-1026512592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.713s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:28:44 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-623e516b-856f-4e69-a0b6-dfb461fb408c tempest-ProjectMemberTests-1570638723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.641s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:28:44 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-7a4f1811-46eb-4b01-89e7-7672db4bf4d5 tempest-ProjectReaderTests-1026512592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fe25a2a-586b-4800-9431-83e39c7f6478) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a2a1d0f-974a-4a52-9081-ea1c850b1653', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:28:44 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-7a4f1811-46eb-4b01-89e7-7672db4bf4d5 tempest-ProjectReaderTests-1026512592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8980296-337f-4343-bb12-a443ff2c0be0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:28:44 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-623e516b-856f-4e69-a0b6-dfb461fb408c tempest-ProjectMemberTests-1570638723 None] Creating offline snapshot 99c2e4dc-4845-4bf4-afd1-d908c17d3091 of volume 4a3cad99-b6cb-45cd-b5e0-72b2221ed88e {{(pid=86111) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 29 01:28:44 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-7a4f1811-46eb-4b01-89e7-7672db4bf4d5 tempest-ProjectReaderTests-1026512592 None] Volume volume-3a2a1d0f-974a-4a52-9081-ea1c850b1653 (3a2a1d0f-974a-4a52-9081-ea1c850b1653): created successfully Aug 29 01:28:44 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-7a4f1811-46eb-4b01-89e7-7672db4bf4d5 tempest-ProjectReaderTests-1026512592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8980296-337f-4343-bb12-a443ff2c0be0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:28:44 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-7a4f1811-46eb-4b01-89e7-7672db4bf4d5 tempest-ProjectReaderTests-1026512592 None] Flow 'volume_create_manager' (2d677f94-a6b9-4f70-ad3b-d0ccc029484c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:28:44 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[e840108c-6d06-40b1-82b9-40dfba298c4e]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:28:44 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-623e516b-856f-4e69-a0b6-dfb461fb408c tempest-ProjectMemberTests-1570638723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-4a3cad99-b6cb-45cd-b5e0-72b2221ed88e {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:44 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-7a4f1811-46eb-4b01-89e7-7672db4bf4d5 tempest-ProjectReaderTests-1026512592 None] Created volume successfully. Aug 29 01:28:44 devstack sudo[105363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-4a3cad99-b6cb-45cd-b5e0-72b2221ed88e Aug 29 01:28:44 devstack sudo[105363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:44 devstack sudo[105363]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:44 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-1721cbd2-478a-4907-a7ea-ea24089ab01b tempest-ProjectReaderTests-1698516188 None] Acquiring lock "cinder-92339296-323e-4b99-b174-9e8a85b13b7b-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:28:44 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-623e516b-856f-4e69-a0b6-dfb461fb408c tempest-ProjectMemberTests-1570638723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-4a3cad99-b6cb-45cd-b5e0-72b2221ed88e" returned: 0 in 0.421s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:44 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-623e516b-856f-4e69-a0b6-dfb461fb408c tempest-ProjectMemberTests-1570638723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-4a3cad99-b6cb-45cd-b5e0-72b2221ed88e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-4a3cad99-b6cb-45cd-b5e0-72b2221ed88e.99c2e4dc-4845-4bf4-afd1-d908c17d3091 1G {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:44 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-1721cbd2-478a-4907-a7ea-ea24089ab01b tempest-ProjectReaderTests-1698516188 None] Lock "cinder-92339296-323e-4b99-b174-9e8a85b13b7b-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:28:44 devstack sudo[105369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-4a3cad99-b6cb-45cd-b5e0-72b2221ed88e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-4a3cad99-b6cb-45cd-b5e0-72b2221ed88e.99c2e4dc-4845-4bf4-afd1-d908c17d3091 1G Aug 29 01:28:44 devstack sudo[105369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:44 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-1721cbd2-478a-4907-a7ea-ea24089ab01b tempest-ProjectReaderTests-1698516188 None] Acquiring lock "cinder-quobyte-92339296-323e-4b99-b174-9e8a85b13b7b" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:28:44 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-1721cbd2-478a-4907-a7ea-ea24089ab01b tempest-ProjectReaderTests-1698516188 None] Lock "cinder-quobyte-92339296-323e-4b99-b174-9e8a85b13b7b" acquired by "delete_volume" :: waited 0.018s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:28:44 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d300592-05f4-4483-9bf6-fb892595af91]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:28:44 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-1721cbd2-478a-4907-a7ea-ea24089ab01b tempest-ProjectReaderTests-1698516188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-92339296-323e-4b99-b174-9e8a85b13b7b {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:44 devstack sudo[105371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-92339296-323e-4b99-b174-9e8a85b13b7b Aug 29 01:28:44 devstack sudo[105371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:45 devstack sudo[105369]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:45 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-623e516b-856f-4e69-a0b6-dfb461fb408c tempest-ProjectMemberTests-1570638723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-4a3cad99-b6cb-45cd-b5e0-72b2221ed88e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-4a3cad99-b6cb-45cd-b5e0-72b2221ed88e.99c2e4dc-4845-4bf4-afd1-d908c17d3091 1G" returned: 0 in 0.518s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:45 devstack sudo[105371]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:45 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-623e516b-856f-4e69-a0b6-dfb461fb408c tempest-ProjectMemberTests-1570638723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a3cad99-b6cb-45cd-b5e0-72b2221ed88e -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-4a3cad99-b6cb-45cd-b5e0-72b2221ed88e.99c2e4dc-4845-4bf4-afd1-d908c17d3091 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:45 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-1721cbd2-478a-4907-a7ea-ea24089ab01b tempest-ProjectReaderTests-1698516188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-92339296-323e-4b99-b174-9e8a85b13b7b" returned: 0 in 0.402s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:45 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-1721cbd2-478a-4907-a7ea-ea24089ab01b tempest-ProjectReaderTests-1698516188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-92339296-323e-4b99-b174-9e8a85b13b7b {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:45 devstack sudo[105381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a3cad99-b6cb-45cd-b5e0-72b2221ed88e -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-4a3cad99-b6cb-45cd-b5e0-72b2221ed88e.99c2e4dc-4845-4bf4-afd1-d908c17d3091 Aug 29 01:28:45 devstack sudo[105381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:45 devstack sudo[105382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-92339296-323e-4b99-b174-9e8a85b13b7b Aug 29 01:28:45 devstack sudo[105382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:45 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-83f6b057-eddc-4862-b289-625a6152bcc7 tempest-ProjectReaderTests-1026512592 None] Acquiring lock "cinder-3a2a1d0f-974a-4a52-9081-ea1c850b1653-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:28:45 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-83f6b057-eddc-4862-b289-625a6152bcc7 tempest-ProjectReaderTests-1026512592 None] Lock "cinder-3a2a1d0f-974a-4a52-9081-ea1c850b1653-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:28:45 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-83f6b057-eddc-4862-b289-625a6152bcc7 tempest-ProjectReaderTests-1026512592 None] Acquiring lock "cinder-quobyte-3a2a1d0f-974a-4a52-9081-ea1c850b1653" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:28:45 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-83f6b057-eddc-4862-b289-625a6152bcc7 tempest-ProjectReaderTests-1026512592 None] Lock "cinder-quobyte-3a2a1d0f-974a-4a52-9081-ea1c850b1653" acquired by "delete_volume" :: waited 0.024s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:28:45 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[06276cea-49db-4048-9759-94fd8fdceba5]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:28:45 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-83f6b057-eddc-4862-b289-625a6152bcc7 tempest-ProjectReaderTests-1026512592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3a2a1d0f-974a-4a52-9081-ea1c850b1653 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:45 devstack sudo[105382]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:45 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-1721cbd2-478a-4907-a7ea-ea24089ab01b tempest-ProjectReaderTests-1698516188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-92339296-323e-4b99-b174-9e8a85b13b7b" returned: 0 in 0.311s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:45 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-1721cbd2-478a-4907-a7ea-ea24089ab01b tempest-ProjectReaderTests-1698516188 None] Lock "cinder-quobyte-92339296-323e-4b99-b174-9e8a85b13b7b" released by "delete_volume" :: held 0.778s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:28:45 devstack sudo[105381]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:45 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-623e516b-856f-4e69-a0b6-dfb461fb408c tempest-ProjectMemberTests-1570638723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a3cad99-b6cb-45cd-b5e0-72b2221ed88e -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-4a3cad99-b6cb-45cd-b5e0-72b2221ed88e.99c2e4dc-4845-4bf4-afd1-d908c17d3091" returned: 0 in 0.369s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:45 devstack cinder-volume[86111]: WARNING cinder.volume.drivers.remotefs [None req-623e516b-856f-4e69-a0b6-dfb461fb408c tempest-ProjectMemberTests-1570638723 None] /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-4a3cad99-b6cb-45cd-b5e0-72b2221ed88e.99c2e4dc-4845-4bf4-afd1-d908c17d3091 is being set with open permissions: ugo+rw Aug 29 01:28:45 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-623e516b-856f-4e69-a0b6-dfb461fb408c tempest-ProjectMemberTests-1570638723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-4a3cad99-b6cb-45cd-b5e0-72b2221ed88e.99c2e4dc-4845-4bf4-afd1-d908c17d3091 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:45 devstack sudo[105385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3a2a1d0f-974a-4a52-9081-ea1c850b1653 Aug 29 01:28:45 devstack sudo[105385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:45 devstack sudo[105391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-4a3cad99-b6cb-45cd-b5e0-72b2221ed88e.99c2e4dc-4845-4bf4-afd1-d908c17d3091 Aug 29 01:28:45 devstack sudo[105391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:45 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-1721cbd2-478a-4907-a7ea-ea24089ab01b tempest-ProjectReaderTests-1698516188 None] Created reservations ['3d13bd60-00a4-44d1-ae71-39c3c8b70583', '93ce2548-a19c-4cc5-a659-0c7e8337e371', '96dfe22d-2177-4868-a7a0-3e195b24525b', '51517b96-9c6b-4f89-ac72-59e83e9142e1'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:28:45 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-1721cbd2-478a-4907-a7ea-ea24089ab01b tempest-ProjectReaderTests-1698516188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:28:45 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-1721cbd2-478a-4907-a7ea-ea24089ab01b tempest-ProjectReaderTests-1698516188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:28:45 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-1721cbd2-478a-4907-a7ea-ea24089ab01b tempest-ProjectReaderTests-1698516188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:28:45 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-1721cbd2-478a-4907-a7ea-ea24089ab01b tempest-ProjectReaderTests-1698516188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:28:45 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-1721cbd2-478a-4907-a7ea-ea24089ab01b tempest-ProjectReaderTests-1698516188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:28:45 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-1721cbd2-478a-4907-a7ea-ea24089ab01b tempest-ProjectReaderTests-1698516188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:45 devstack sudo[105394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:28:45 devstack sudo[105394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:45 devstack sudo[105391]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:45 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-623e516b-856f-4e69-a0b6-dfb461fb408c tempest-ProjectMemberTests-1570638723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-4a3cad99-b6cb-45cd-b5e0-72b2221ed88e.99c2e4dc-4845-4bf4-afd1-d908c17d3091" returned: 0 in 0.260s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:45 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-623e516b-856f-4e69-a0b6-dfb461fb408c tempest-ProjectMemberTests-1570638723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-4a3cad99-b6cb-45cd-b5e0-72b2221ed88e.info {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:45 devstack sudo[105385]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:45 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-83f6b057-eddc-4862-b289-625a6152bcc7 tempest-ProjectReaderTests-1026512592 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3a2a1d0f-974a-4a52-9081-ea1c850b1653" returned: 0 in 0.421s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:45 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-83f6b057-eddc-4862-b289-625a6152bcc7 tempest-ProjectReaderTests-1026512592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3a2a1d0f-974a-4a52-9081-ea1c850b1653 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:45 devstack sudo[105401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-4a3cad99-b6cb-45cd-b5e0-72b2221ed88e.info Aug 29 01:28:45 devstack sudo[105401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:45 devstack sudo[105402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3a2a1d0f-974a-4a52-9081-ea1c850b1653 Aug 29 01:28:45 devstack sudo[105402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:45 devstack sudo[105394]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:45 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-1721cbd2-478a-4907-a7ea-ea24089ab01b tempest-ProjectReaderTests-1698516188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.273s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:45 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-1721cbd2-478a-4907-a7ea-ea24089ab01b tempest-ProjectReaderTests-1698516188 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:28:45 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-1721cbd2-478a-4907-a7ea-ea24089ab01b tempest-ProjectReaderTests-1698516188 None] Deleted volume successfully. Aug 29 01:28:45 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-1721cbd2-478a-4907-a7ea-ea24089ab01b tempest-ProjectReaderTests-1698516188 None] Lock "cinder-92339296-323e-4b99-b174-9e8a85b13b7b-delete_volume" released by "delete_volume" :: held 1.286s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:28:46 devstack sudo[105402]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:46 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-83f6b057-eddc-4862-b289-625a6152bcc7 tempest-ProjectReaderTests-1026512592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-3a2a1d0f-974a-4a52-9081-ea1c850b1653" returned: 0 in 0.270s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:46 devstack sudo[105401]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:46 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-623e516b-856f-4e69-a0b6-dfb461fb408c tempest-ProjectMemberTests-1570638723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-4a3cad99-b6cb-45cd-b5e0-72b2221ed88e.info" returned: 0 in 0.305s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:46 devstack cinder-volume[86111]: WARNING cinder.volume.drivers.remotefs [None req-623e516b-856f-4e69-a0b6-dfb461fb408c tempest-ProjectMemberTests-1570638723 None] /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-4a3cad99-b6cb-45cd-b5e0-72b2221ed88e.info is being set with open permissions: ugo+rw Aug 29 01:28:46 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-623e516b-856f-4e69-a0b6-dfb461fb408c tempest-ProjectMemberTests-1570638723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-4a3cad99-b6cb-45cd-b5e0-72b2221ed88e.info {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:46 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-83f6b057-eddc-4862-b289-625a6152bcc7 tempest-ProjectReaderTests-1026512592 None] Lock "cinder-quobyte-3a2a1d0f-974a-4a52-9081-ea1c850b1653" released by "delete_volume" :: held 0.768s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:28:46 devstack sudo[105408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-4a3cad99-b6cb-45cd-b5e0-72b2221ed88e.info Aug 29 01:28:46 devstack sudo[105408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:46 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-83f6b057-eddc-4862-b289-625a6152bcc7 tempest-ProjectReaderTests-1026512592 None] Created reservations ['cb07618b-1083-4b16-ad70-10b9df9d2976', '82d5c0e9-d71e-4ba4-9298-4d341fee42b3', '78bc6216-28ce-445a-9680-b453c7f0c58b', '13773bda-b690-4881-829a-134a87283c18'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:28:46 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-83f6b057-eddc-4862-b289-625a6152bcc7 tempest-ProjectReaderTests-1026512592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:28:46 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-83f6b057-eddc-4862-b289-625a6152bcc7 tempest-ProjectReaderTests-1026512592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:28:46 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-83f6b057-eddc-4862-b289-625a6152bcc7 tempest-ProjectReaderTests-1026512592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:28:46 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-83f6b057-eddc-4862-b289-625a6152bcc7 tempest-ProjectReaderTests-1026512592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:28:46 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-83f6b057-eddc-4862-b289-625a6152bcc7 tempest-ProjectReaderTests-1026512592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:28:46 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-83f6b057-eddc-4862-b289-625a6152bcc7 tempest-ProjectReaderTests-1026512592 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:46 devstack sudo[105410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:28:46 devstack sudo[105410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:46 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5ce8393-153a-4a32-bbf4-289db833e587 tempest-ProjectReaderTests-1698516188 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:28:46 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-a5ce8393-153a-4a32-bbf4-289db833e587 tempest-ProjectReaderTests-1698516188 None] Flow 'volume_create_manager' (67585cbe-9ecd-49e0-b802-626e7839581a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:28:46 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-a5ce8393-153a-4a32-bbf4-289db833e587 tempest-ProjectReaderTests-1698516188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f471a5e-733f-4ba6-8336-c2908fe91d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:28:46 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-a5ce8393-153a-4a32-bbf4-289db833e587 tempest-ProjectReaderTests-1698516188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f471a5e-733f-4ba6-8336-c2908fe91d55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:28:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1664750090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78db2eb2-e3be-4a60-bd23-7cb1bd13f8b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f049b4b9de194d0bb816e863c7740f77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:28:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:28:46Z,use_quota=True,user_id='168ab677c6ef4d8f93d853c32c291481',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:28:46 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-a5ce8393-153a-4a32-bbf4-289db833e587 tempest-ProjectReaderTests-1698516188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d0dd7ce-9ed7-4fdc-a1c1-e120414c3984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:28:46 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-a5ce8393-153a-4a32-bbf4-289db833e587 tempest-ProjectReaderTests-1698516188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d0dd7ce-9ed7-4fdc-a1c1-e120414c3984) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:28:46 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-a5ce8393-153a-4a32-bbf4-289db833e587 tempest-ProjectReaderTests-1698516188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c6def5e-23b7-4861-af23-b62576cb93b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:28:46 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-a5ce8393-153a-4a32-bbf4-289db833e587 tempest-ProjectReaderTests-1698516188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c6def5e-23b7-4861-af23-b62576cb93b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78db2eb2-e3be-4a60-bd23-7cb1bd13f8b4', 'volume_name': 'volume-78db2eb2-e3be-4a60-bd23-7cb1bd13f8b4', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:28:46 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-a5ce8393-153a-4a32-bbf4-289db833e587 tempest-ProjectReaderTests-1698516188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e299cca-e274-4c63-a64e-72c0fb7f4fa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:28:46 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-a5ce8393-153a-4a32-bbf4-289db833e587 tempest-ProjectReaderTests-1698516188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e299cca-e274-4c63-a64e-72c0fb7f4fa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:28:46 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-a5ce8393-153a-4a32-bbf4-289db833e587 tempest-ProjectReaderTests-1698516188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a555058c-08ca-4692-a4c3-1c28924cd01e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:28:46 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-a5ce8393-153a-4a32-bbf4-289db833e587 tempest-ProjectReaderTests-1698516188 None] Volume 78db2eb2-e3be-4a60-bd23-7cb1bd13f8b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78db2eb2-e3be-4a60-bd23-7cb1bd13f8b4', 'volume_size': 1} Aug 29 01:28:46 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-a5ce8393-153a-4a32-bbf4-289db833e587 tempest-ProjectReaderTests-1698516188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:28:46 devstack sudo[105408]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:46 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-623e516b-856f-4e69-a0b6-dfb461fb408c tempest-ProjectMemberTests-1570638723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-4a3cad99-b6cb-45cd-b5e0-72b2221ed88e.info" returned: 0 in 0.436s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:46 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-623e516b-856f-4e69-a0b6-dfb461fb408c tempest-ProjectMemberTests-1570638723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.432s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:28:46 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-a5ce8393-153a-4a32-bbf4-289db833e587 tempest-ProjectReaderTests-1698516188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.046s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:28:46 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-a5ce8393-153a-4a32-bbf4-289db833e587 tempest-ProjectReaderTests-1698516188 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:28:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1664750090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78db2eb2-e3be-4a60-bd23-7cb1bd13f8b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f049b4b9de194d0bb816e863c7740f77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:28:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:28:46Z,use_quota=True,user_id='168ab677c6ef4d8f93d853c32c291481',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:28:46 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-a5ce8393-153a-4a32-bbf4-289db833e587 tempest-ProjectReaderTests-1698516188 None] Creating volume 78db2eb2-e3be-4a60-bd23-7cb1bd13f8b4 {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:28:46 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-a5ce8393-153a-4a32-bbf4-289db833e587 tempest-ProjectReaderTests-1698516188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:28:46 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-a5ce8393-153a-4a32-bbf4-289db833e587 tempest-ProjectReaderTests-1698516188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:28:46 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-a5ce8393-153a-4a32-bbf4-289db833e587 tempest-ProjectReaderTests-1698516188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:28:46 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-a5ce8393-153a-4a32-bbf4-289db833e587 tempest-ProjectReaderTests-1698516188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:28:46 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-a5ce8393-153a-4a32-bbf4-289db833e587 tempest-ProjectReaderTests-1698516188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:28:46 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-a5ce8393-153a-4a32-bbf4-289db833e587 tempest-ProjectReaderTests-1698516188 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:28:46 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-a5ce8393-153a-4a32-bbf4-289db833e587 tempest-ProjectReaderTests-1698516188 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:28:46 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-a5ce8393-153a-4a32-bbf4-289db833e587 tempest-ProjectReaderTests-1698516188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-78db2eb2-e3be-4a60-bd23-7cb1bd13f8b4 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:46 devstack sudo[105413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-78db2eb2-e3be-4a60-bd23-7cb1bd13f8b4 1073741824 Aug 29 01:28:46 devstack sudo[105413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:46 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-623e516b-856f-4e69-a0b6-dfb461fb408c tempest-ProjectMemberTests-1570638723 None] Create snapshot completed successfully Aug 29 01:28:46 devstack sudo[105410]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:46 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-83f6b057-eddc-4862-b289-625a6152bcc7 tempest-ProjectReaderTests-1026512592 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.352s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:46 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-83f6b057-eddc-4862-b289-625a6152bcc7 tempest-ProjectReaderTests-1026512592 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:28:46 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-83f6b057-eddc-4862-b289-625a6152bcc7 tempest-ProjectReaderTests-1026512592 None] Deleted volume successfully. Aug 29 01:28:46 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-83f6b057-eddc-4862-b289-625a6152bcc7 tempest-ProjectReaderTests-1026512592 None] Lock "cinder-3a2a1d0f-974a-4a52-9081-ea1c850b1653-delete_volume" released by "delete_volume" :: held 1.406s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:28:47 devstack sudo[105413]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:47 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-a5ce8393-153a-4a32-bbf4-289db833e587 tempest-ProjectReaderTests-1698516188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-78db2eb2-e3be-4a60-bd23-7cb1bd13f8b4 1073741824" returned: 0 in 0.535s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:47 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-a5ce8393-153a-4a32-bbf4-289db833e587 tempest-ProjectReaderTests-1698516188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-78db2eb2-e3be-4a60-bd23-7cb1bd13f8b4 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:47 devstack sudo[105420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-78db2eb2-e3be-4a60-bd23-7cb1bd13f8b4 Aug 29 01:28:47 devstack sudo[105420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:47 devstack sudo[105420]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:47 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-a5ce8393-153a-4a32-bbf4-289db833e587 tempest-ProjectReaderTests-1698516188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-78db2eb2-e3be-4a60-bd23-7cb1bd13f8b4" returned: 0 in 0.289s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:47 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-a5ce8393-153a-4a32-bbf4-289db833e587 tempest-ProjectReaderTests-1698516188 None] <== create_volume: return (865ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:28:47 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-a5ce8393-153a-4a32-bbf4-289db833e587 tempest-ProjectReaderTests-1698516188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.869s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:28:47 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-a5ce8393-153a-4a32-bbf4-289db833e587 tempest-ProjectReaderTests-1698516188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a555058c-08ca-4692-a4c3-1c28924cd01e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78db2eb2-e3be-4a60-bd23-7cb1bd13f8b4', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:28:47 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-a5ce8393-153a-4a32-bbf4-289db833e587 tempest-ProjectReaderTests-1698516188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a841f92a-a415-4527-9201-400193ed10dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:28:47 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-a5ce8393-153a-4a32-bbf4-289db833e587 tempest-ProjectReaderTests-1698516188 None] Volume volume-78db2eb2-e3be-4a60-bd23-7cb1bd13f8b4 (78db2eb2-e3be-4a60-bd23-7cb1bd13f8b4): created successfully Aug 29 01:28:47 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-a5ce8393-153a-4a32-bbf4-289db833e587 tempest-ProjectReaderTests-1698516188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a841f92a-a415-4527-9201-400193ed10dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:28:47 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-a5ce8393-153a-4a32-bbf4-289db833e587 tempest-ProjectReaderTests-1698516188 None] Flow 'volume_create_manager' (67585cbe-9ecd-49e0-b802-626e7839581a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:28:47 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-a5ce8393-153a-4a32-bbf4-289db833e587 tempest-ProjectReaderTests-1698516188 None] Created volume successfully. Aug 29 01:28:47 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-f763d59b-d51c-486b-bfb6-251b02d1f061 tempest-ProjectMemberTests-1570638723 None] Acquiring lock "cinder-99c2e4dc-4845-4bf4-afd1-d908c17d3091-delete_snapshot" by "delete_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:28:47 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-f763d59b-d51c-486b-bfb6-251b02d1f061 tempest-ProjectMemberTests-1570638723 None] Lock "cinder-99c2e4dc-4845-4bf4-afd1-d908c17d3091-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:28:47 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-f763d59b-d51c-486b-bfb6-251b02d1f061 tempest-ProjectMemberTests-1570638723 None] Acquiring lock "cinder-quobyte-4a3cad99-b6cb-45cd-b5e0-72b2221ed88e" by "delete_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:28:47 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-f763d59b-d51c-486b-bfb6-251b02d1f061 tempest-ProjectMemberTests-1570638723 None] Lock "cinder-quobyte-4a3cad99-b6cb-45cd-b5e0-72b2221ed88e" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:28:47 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-f763d59b-d51c-486b-bfb6-251b02d1f061 tempest-ProjectMemberTests-1570638723 None] Acquiring lock "cinder-quobyte-99c2e4dc-4845-4bf4-afd1-d908c17d3091" by "_delete_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:28:47 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-f763d59b-d51c-486b-bfb6-251b02d1f061 tempest-ProjectMemberTests-1570638723 None] Lock "cinder-quobyte-99c2e4dc-4845-4bf4-afd1-d908c17d3091" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:28:47 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-f763d59b-d51c-486b-bfb6-251b02d1f061 tempest-ProjectMemberTests-1570638723 None] Deleting offline snapshot 99c2e4dc-4845-4bf4-afd1-d908c17d3091 of volume 4a3cad99-b6cb-45cd-b5e0-72b2221ed88e {{(pid=86111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 29 01:28:47 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-f763d59b-d51c-486b-bfb6-251b02d1f061 tempest-ProjectMemberTests-1570638723 None] snapshot_file for this snap is: volume-4a3cad99-b6cb-45cd-b5e0-72b2221ed88e.99c2e4dc-4845-4bf4-afd1-d908c17d3091 {{(pid=86111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 29 01:28:47 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0e4ae98-f597-4a20-a12a-69ad940b0168]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:28:47 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-f763d59b-d51c-486b-bfb6-251b02d1f061 tempest-ProjectMemberTests-1570638723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-4a3cad99-b6cb-45cd-b5e0-72b2221ed88e.99c2e4dc-4845-4bf4-afd1-d908c17d3091 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:47 devstack sudo[105423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-4a3cad99-b6cb-45cd-b5e0-72b2221ed88e.99c2e4dc-4845-4bf4-afd1-d908c17d3091 Aug 29 01:28:47 devstack sudo[105423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:48 devstack sudo[105423]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:48 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-f763d59b-d51c-486b-bfb6-251b02d1f061 tempest-ProjectMemberTests-1570638723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-4a3cad99-b6cb-45cd-b5e0-72b2221ed88e.99c2e4dc-4845-4bf4-afd1-d908c17d3091" returned: 0 in 0.388s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:48 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-f763d59b-d51c-486b-bfb6-251b02d1f061 tempest-ProjectMemberTests-1570638723 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4a3cad99-b6cb-45cd-b5e0-72b2221ed88e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 29 01:28:48 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[f02c133f-3b2e-4efe-ba1e-d77eae5ff773]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:28:48 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-f763d59b-d51c-486b-bfb6-251b02d1f061 tempest-ProjectMemberTests-1570638723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-4a3cad99-b6cb-45cd-b5e0-72b2221ed88e {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:48 devstack sudo[105428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-4a3cad99-b6cb-45cd-b5e0-72b2221ed88e Aug 29 01:28:48 devstack sudo[105428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:48 devstack sudo[105428]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:48 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-f763d59b-d51c-486b-bfb6-251b02d1f061 tempest-ProjectMemberTests-1570638723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-4a3cad99-b6cb-45cd-b5e0-72b2221ed88e" returned: 0 in 0.453s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:48 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-f763d59b-d51c-486b-bfb6-251b02d1f061 tempest-ProjectMemberTests-1570638723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-4a3cad99-b6cb-45cd-b5e0-72b2221ed88e.99c2e4dc-4845-4bf4-afd1-d908c17d3091 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:48 devstack sudo[105433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-4a3cad99-b6cb-45cd-b5e0-72b2221ed88e.99c2e4dc-4845-4bf4-afd1-d908c17d3091 Aug 29 01:28:48 devstack sudo[105433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:48 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-c63b0c34-c41a-4120-a261-fd8fde451106 tempest-ProjectReaderTests-1698516188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:28:48 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-c63b0c34-c41a-4120-a261-fd8fde451106 tempest-ProjectReaderTests-1698516188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:28:48 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-c63b0c34-c41a-4120-a261-fd8fde451106 tempest-ProjectReaderTests-1698516188 None] Creating offline snapshot 8feb5604-e9ac-40c3-a4f2-e61619f86648 of volume 78db2eb2-e3be-4a60-bd23-7cb1bd13f8b4 {{(pid=86111) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 29 01:28:48 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[5512840e-6b5e-41ab-bc18-8226813c12cf]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:28:48 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c63b0c34-c41a-4120-a261-fd8fde451106 tempest-ProjectReaderTests-1698516188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-78db2eb2-e3be-4a60-bd23-7cb1bd13f8b4 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:48 devstack sudo[105433]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:48 devstack sudo[105437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-78db2eb2-e3be-4a60-bd23-7cb1bd13f8b4 Aug 29 01:28:48 devstack sudo[105437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:48 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-f763d59b-d51c-486b-bfb6-251b02d1f061 tempest-ProjectMemberTests-1570638723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-4a3cad99-b6cb-45cd-b5e0-72b2221ed88e.99c2e4dc-4845-4bf4-afd1-d908c17d3091" returned: 0 in 0.427s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:48 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-f763d59b-d51c-486b-bfb6-251b02d1f061 tempest-ProjectMemberTests-1570638723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-4a3cad99-b6cb-45cd-b5e0-72b2221ed88e.99c2e4dc-4845-4bf4-afd1-d908c17d3091 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:48 devstack sudo[105441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-4a3cad99-b6cb-45cd-b5e0-72b2221ed88e.99c2e4dc-4845-4bf4-afd1-d908c17d3091 Aug 29 01:28:48 devstack sudo[105441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:49 devstack sudo[105437]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:49 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c63b0c34-c41a-4120-a261-fd8fde451106 tempest-ProjectReaderTests-1698516188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-78db2eb2-e3be-4a60-bd23-7cb1bd13f8b4" returned: 0 in 0.406s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:49 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c63b0c34-c41a-4120-a261-fd8fde451106 tempest-ProjectReaderTests-1698516188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-78db2eb2-e3be-4a60-bd23-7cb1bd13f8b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-78db2eb2-e3be-4a60-bd23-7cb1bd13f8b4.8feb5604-e9ac-40c3-a4f2-e61619f86648 1G {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:49 devstack sudo[105441]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:49 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-f763d59b-d51c-486b-bfb6-251b02d1f061 tempest-ProjectMemberTests-1570638723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-4a3cad99-b6cb-45cd-b5e0-72b2221ed88e.99c2e4dc-4845-4bf4-afd1-d908c17d3091" returned: 0 in 0.304s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:49 devstack sudo[105447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-78db2eb2-e3be-4a60-bd23-7cb1bd13f8b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-78db2eb2-e3be-4a60-bd23-7cb1bd13f8b4.8feb5604-e9ac-40c3-a4f2-e61619f86648 1G Aug 29 01:28:49 devstack sudo[105447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:49 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-f763d59b-d51c-486b-bfb6-251b02d1f061 tempest-ProjectMemberTests-1570638723 None] Lock "cinder-quobyte-99c2e4dc-4845-4bf4-afd1-d908c17d3091" released by "_delete_snapshot" :: held 1.696s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:28:49 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-f763d59b-d51c-486b-bfb6-251b02d1f061 tempest-ProjectMemberTests-1570638723 None] Lock "cinder-quobyte-4a3cad99-b6cb-45cd-b5e0-72b2221ed88e" released by "delete_snapshot" :: held 1.719s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:28:49 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-f763d59b-d51c-486b-bfb6-251b02d1f061 tempest-ProjectMemberTests-1570638723 None] Created reservations ['446a6dcb-cb8e-42b2-a6ed-ab22fe72595e', 'a4caab13-7f64-4da9-85a6-1eb561ba9765', 'c810f264-8676-43ac-9049-9e327099c971', '9854722f-a132-4217-9549-3b47f8e5b0f9'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:28:49 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-f763d59b-d51c-486b-bfb6-251b02d1f061 tempest-ProjectMemberTests-1570638723 None] Delete snapshot completed successfully. Aug 29 01:28:49 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-f763d59b-d51c-486b-bfb6-251b02d1f061 tempest-ProjectMemberTests-1570638723 None] Lock "cinder-99c2e4dc-4845-4bf4-afd1-d908c17d3091-delete_snapshot" released by "delete_snapshot" :: held 1.890s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:28:49 devstack sudo[105447]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:49 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c63b0c34-c41a-4120-a261-fd8fde451106 tempest-ProjectReaderTests-1698516188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-78db2eb2-e3be-4a60-bd23-7cb1bd13f8b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-78db2eb2-e3be-4a60-bd23-7cb1bd13f8b4.8feb5604-e9ac-40c3-a4f2-e61619f86648 1G" returned: 0 in 0.488s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:49 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c63b0c34-c41a-4120-a261-fd8fde451106 tempest-ProjectReaderTests-1698516188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78db2eb2-e3be-4a60-bd23-7cb1bd13f8b4 -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-78db2eb2-e3be-4a60-bd23-7cb1bd13f8b4.8feb5604-e9ac-40c3-a4f2-e61619f86648 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:49 devstack sudo[105454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78db2eb2-e3be-4a60-bd23-7cb1bd13f8b4 -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-78db2eb2-e3be-4a60-bd23-7cb1bd13f8b4.8feb5604-e9ac-40c3-a4f2-e61619f86648 Aug 29 01:28:49 devstack sudo[105454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:49 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-10c40b98-15e8-48a9-b0e6-7109177c8952 tempest-ProjectMemberTests-1570638723 None] Acquiring lock "cinder-4a3cad99-b6cb-45cd-b5e0-72b2221ed88e-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:28:49 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-10c40b98-15e8-48a9-b0e6-7109177c8952 tempest-ProjectMemberTests-1570638723 None] Lock "cinder-4a3cad99-b6cb-45cd-b5e0-72b2221ed88e-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:28:49 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-10c40b98-15e8-48a9-b0e6-7109177c8952 tempest-ProjectMemberTests-1570638723 None] Acquiring lock "cinder-quobyte-4a3cad99-b6cb-45cd-b5e0-72b2221ed88e" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:28:49 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-10c40b98-15e8-48a9-b0e6-7109177c8952 tempest-ProjectMemberTests-1570638723 None] Lock "cinder-quobyte-4a3cad99-b6cb-45cd-b5e0-72b2221ed88e" acquired by "delete_volume" :: waited 0.027s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:28:50 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[15a37f86-d372-4b39-8abf-0004a0b5bf58]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:28:50 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-10c40b98-15e8-48a9-b0e6-7109177c8952 tempest-ProjectMemberTests-1570638723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-4a3cad99-b6cb-45cd-b5e0-72b2221ed88e {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:50 devstack sudo[105454]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:50 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c63b0c34-c41a-4120-a261-fd8fde451106 tempest-ProjectReaderTests-1698516188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78db2eb2-e3be-4a60-bd23-7cb1bd13f8b4 -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-78db2eb2-e3be-4a60-bd23-7cb1bd13f8b4.8feb5604-e9ac-40c3-a4f2-e61619f86648" returned: 0 in 0.412s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:50 devstack cinder-volume[86111]: WARNING cinder.volume.drivers.remotefs [None req-c63b0c34-c41a-4120-a261-fd8fde451106 tempest-ProjectReaderTests-1698516188 None] /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-78db2eb2-e3be-4a60-bd23-7cb1bd13f8b4.8feb5604-e9ac-40c3-a4f2-e61619f86648 is being set with open permissions: ugo+rw Aug 29 01:28:50 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c63b0c34-c41a-4120-a261-fd8fde451106 tempest-ProjectReaderTests-1698516188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-78db2eb2-e3be-4a60-bd23-7cb1bd13f8b4.8feb5604-e9ac-40c3-a4f2-e61619f86648 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:50 devstack sudo[105457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-4a3cad99-b6cb-45cd-b5e0-72b2221ed88e Aug 29 01:28:50 devstack sudo[105457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:50 devstack sudo[105460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-78db2eb2-e3be-4a60-bd23-7cb1bd13f8b4.8feb5604-e9ac-40c3-a4f2-e61619f86648 Aug 29 01:28:50 devstack sudo[105460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:50 devstack sudo[105460]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:50 devstack sudo[105457]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:50 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c63b0c34-c41a-4120-a261-fd8fde451106 tempest-ProjectReaderTests-1698516188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-78db2eb2-e3be-4a60-bd23-7cb1bd13f8b4.8feb5604-e9ac-40c3-a4f2-e61619f86648" returned: 0 in 0.334s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:50 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-10c40b98-15e8-48a9-b0e6-7109177c8952 tempest-ProjectMemberTests-1570638723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-4a3cad99-b6cb-45cd-b5e0-72b2221ed88e" returned: 0 in 0.470s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:50 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-10c40b98-15e8-48a9-b0e6-7109177c8952 tempest-ProjectMemberTests-1570638723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-4a3cad99-b6cb-45cd-b5e0-72b2221ed88e {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:50 devstack sudo[105467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-4a3cad99-b6cb-45cd-b5e0-72b2221ed88e Aug 29 01:28:50 devstack sudo[105467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:50 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c63b0c34-c41a-4120-a261-fd8fde451106 tempest-ProjectReaderTests-1698516188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-78db2eb2-e3be-4a60-bd23-7cb1bd13f8b4.info {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:50 devstack sudo[105469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-78db2eb2-e3be-4a60-bd23-7cb1bd13f8b4.info Aug 29 01:28:50 devstack sudo[105469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:50 devstack sudo[105469]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:50 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c63b0c34-c41a-4120-a261-fd8fde451106 tempest-ProjectReaderTests-1698516188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-78db2eb2-e3be-4a60-bd23-7cb1bd13f8b4.info" returned: 0 in 0.328s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:50 devstack cinder-volume[86111]: WARNING cinder.volume.drivers.remotefs [None req-c63b0c34-c41a-4120-a261-fd8fde451106 tempest-ProjectReaderTests-1698516188 None] /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-78db2eb2-e3be-4a60-bd23-7cb1bd13f8b4.info is being set with open permissions: ugo+rw Aug 29 01:28:50 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c63b0c34-c41a-4120-a261-fd8fde451106 tempest-ProjectReaderTests-1698516188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-78db2eb2-e3be-4a60-bd23-7cb1bd13f8b4.info {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:50 devstack sudo[105467]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:50 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-10c40b98-15e8-48a9-b0e6-7109177c8952 tempest-ProjectMemberTests-1570638723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-4a3cad99-b6cb-45cd-b5e0-72b2221ed88e" returned: 0 in 0.401s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:50 devstack sudo[105473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-78db2eb2-e3be-4a60-bd23-7cb1bd13f8b4.info Aug 29 01:28:50 devstack sudo[105473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:50 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-10c40b98-15e8-48a9-b0e6-7109177c8952 tempest-ProjectMemberTests-1570638723 None] Lock "cinder-quobyte-4a3cad99-b6cb-45cd-b5e0-72b2221ed88e" released by "delete_volume" :: held 0.957s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:28:50 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-10c40b98-15e8-48a9-b0e6-7109177c8952 tempest-ProjectMemberTests-1570638723 None] Created reservations ['c59c419f-200b-417e-8772-e9236d7e08d2', 'c315e9f6-b262-434e-b863-5987f0a6180e', '06750a9d-2dff-48aa-9ae7-8d155fe9d8c6', 'd674c568-41d7-40b1-985d-0d28950b7ecd'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:28:51 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-10c40b98-15e8-48a9-b0e6-7109177c8952 tempest-ProjectMemberTests-1570638723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:28:51 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-10c40b98-15e8-48a9-b0e6-7109177c8952 tempest-ProjectMemberTests-1570638723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:28:51 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-10c40b98-15e8-48a9-b0e6-7109177c8952 tempest-ProjectMemberTests-1570638723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:28:51 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-10c40b98-15e8-48a9-b0e6-7109177c8952 tempest-ProjectMemberTests-1570638723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:28:51 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-10c40b98-15e8-48a9-b0e6-7109177c8952 tempest-ProjectMemberTests-1570638723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:28:51 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-10c40b98-15e8-48a9-b0e6-7109177c8952 tempest-ProjectMemberTests-1570638723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:51 devstack sudo[105475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:28:51 devstack sudo[105475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:51 devstack sudo[105473]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:51 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c63b0c34-c41a-4120-a261-fd8fde451106 tempest-ProjectReaderTests-1698516188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-78db2eb2-e3be-4a60-bd23-7cb1bd13f8b4.info" returned: 0 in 0.295s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:51 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-c63b0c34-c41a-4120-a261-fd8fde451106 tempest-ProjectReaderTests-1698516188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.414s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:28:51 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-c63b0c34-c41a-4120-a261-fd8fde451106 tempest-ProjectReaderTests-1698516188 None] Create snapshot completed successfully Aug 29 01:28:51 devstack sudo[105475]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:51 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-10c40b98-15e8-48a9-b0e6-7109177c8952 tempest-ProjectMemberTests-1570638723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.367s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:51 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-10c40b98-15e8-48a9-b0e6-7109177c8952 tempest-ProjectMemberTests-1570638723 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:28:51 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-10c40b98-15e8-48a9-b0e6-7109177c8952 tempest-ProjectMemberTests-1570638723 None] Deleted volume successfully. Aug 29 01:28:51 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-10c40b98-15e8-48a9-b0e6-7109177c8952 tempest-ProjectMemberTests-1570638723 None] Lock "cinder-4a3cad99-b6cb-45cd-b5e0-72b2221ed88e-delete_volume" released by "delete_volume" :: held 1.661s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:28:51 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-d4f4ccd4-ac12-4520-ac58-ee7154a86163 tempest-ProjectReaderTests-1698516188 None] Acquiring lock "cinder-8feb5604-e9ac-40c3-a4f2-e61619f86648-delete_snapshot" by "delete_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:28:51 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-d4f4ccd4-ac12-4520-ac58-ee7154a86163 tempest-ProjectReaderTests-1698516188 None] Lock "cinder-8feb5604-e9ac-40c3-a4f2-e61619f86648-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:28:51 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-d4f4ccd4-ac12-4520-ac58-ee7154a86163 tempest-ProjectReaderTests-1698516188 None] Acquiring lock "cinder-quobyte-78db2eb2-e3be-4a60-bd23-7cb1bd13f8b4" by "delete_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:28:52 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-d4f4ccd4-ac12-4520-ac58-ee7154a86163 tempest-ProjectReaderTests-1698516188 None] Lock "cinder-quobyte-78db2eb2-e3be-4a60-bd23-7cb1bd13f8b4" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:28:52 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-d4f4ccd4-ac12-4520-ac58-ee7154a86163 tempest-ProjectReaderTests-1698516188 None] Acquiring lock "cinder-quobyte-8feb5604-e9ac-40c3-a4f2-e61619f86648" by "_delete_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:28:52 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-d4f4ccd4-ac12-4520-ac58-ee7154a86163 tempest-ProjectReaderTests-1698516188 None] Lock "cinder-quobyte-8feb5604-e9ac-40c3-a4f2-e61619f86648" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:28:52 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-d4f4ccd4-ac12-4520-ac58-ee7154a86163 tempest-ProjectReaderTests-1698516188 None] Deleting offline snapshot 8feb5604-e9ac-40c3-a4f2-e61619f86648 of volume 78db2eb2-e3be-4a60-bd23-7cb1bd13f8b4 {{(pid=86111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 29 01:28:52 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-d4f4ccd4-ac12-4520-ac58-ee7154a86163 tempest-ProjectReaderTests-1698516188 None] snapshot_file for this snap is: volume-78db2eb2-e3be-4a60-bd23-7cb1bd13f8b4.8feb5604-e9ac-40c3-a4f2-e61619f86648 {{(pid=86111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 29 01:28:52 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f75dd60-71d1-4103-b886-ed1ef2173e23]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:28:52 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d4f4ccd4-ac12-4520-ac58-ee7154a86163 tempest-ProjectReaderTests-1698516188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-78db2eb2-e3be-4a60-bd23-7cb1bd13f8b4.8feb5604-e9ac-40c3-a4f2-e61619f86648 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:52 devstack sudo[105479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-78db2eb2-e3be-4a60-bd23-7cb1bd13f8b4.8feb5604-e9ac-40c3-a4f2-e61619f86648 Aug 29 01:28:52 devstack sudo[105479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:52 devstack sudo[105479]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:52 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d4f4ccd4-ac12-4520-ac58-ee7154a86163 tempest-ProjectReaderTests-1698516188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-78db2eb2-e3be-4a60-bd23-7cb1bd13f8b4.8feb5604-e9ac-40c3-a4f2-e61619f86648" returned: 0 in 0.495s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:52 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-d4f4ccd4-ac12-4520-ac58-ee7154a86163 tempest-ProjectReaderTests-1698516188 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-78db2eb2-e3be-4a60-bd23-7cb1bd13f8b4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 29 01:28:52 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e61b657-f23e-49d2-89ac-407e0e77cd5d]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:28:52 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d4f4ccd4-ac12-4520-ac58-ee7154a86163 tempest-ProjectReaderTests-1698516188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-78db2eb2-e3be-4a60-bd23-7cb1bd13f8b4 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:52 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec53d5ab-9ad9-4947-9a92-4524508a3c55 tempest-ProjectMemberTests-1570638723 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:28:52 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-ec53d5ab-9ad9-4947-9a92-4524508a3c55 tempest-ProjectMemberTests-1570638723 None] Flow 'volume_create_manager' (be257fe8-997c-475d-8ccd-edcb533db0e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:28:52 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-ec53d5ab-9ad9-4947-9a92-4524508a3c55 tempest-ProjectMemberTests-1570638723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7ce3706-6770-4c23-85d4-fad339409062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:28:52 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-ec53d5ab-9ad9-4947-9a92-4524508a3c55 tempest-ProjectMemberTests-1570638723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7ce3706-6770-4c23-85d4-fad339409062) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:28:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-351233060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f1fa702-973e-41fb-b9f1-cf7cf9446407,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc3e18b86dee456398aada5b169dc198',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:28:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:28:53Z,use_quota=True,user_id='ea18f1190bab494589a803742a7eb22a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:28:52 devstack sudo[105485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-78db2eb2-e3be-4a60-bd23-7cb1bd13f8b4 Aug 29 01:28:52 devstack sudo[105485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:52 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-ec53d5ab-9ad9-4947-9a92-4524508a3c55 tempest-ProjectMemberTests-1570638723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f8f7e1e-bde3-49c2-8068-ba5031c405ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:28:52 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-ec53d5ab-9ad9-4947-9a92-4524508a3c55 tempest-ProjectMemberTests-1570638723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f8f7e1e-bde3-49c2-8068-ba5031c405ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:28:52 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-ec53d5ab-9ad9-4947-9a92-4524508a3c55 tempest-ProjectMemberTests-1570638723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91f97e30-0e32-4ff0-8a96-7859178512e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:28:52 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-ec53d5ab-9ad9-4947-9a92-4524508a3c55 tempest-ProjectMemberTests-1570638723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91f97e30-0e32-4ff0-8a96-7859178512e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f1fa702-973e-41fb-b9f1-cf7cf9446407', 'volume_name': 'volume-0f1fa702-973e-41fb-b9f1-cf7cf9446407', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:28:52 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-ec53d5ab-9ad9-4947-9a92-4524508a3c55 tempest-ProjectMemberTests-1570638723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f01b3c3a-7ec0-4225-9bd2-289c2822b9cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:28:52 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-ec53d5ab-9ad9-4947-9a92-4524508a3c55 tempest-ProjectMemberTests-1570638723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f01b3c3a-7ec0-4225-9bd2-289c2822b9cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:28:52 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-ec53d5ab-9ad9-4947-9a92-4524508a3c55 tempest-ProjectMemberTests-1570638723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1304715-4590-468c-ae13-70315bcdf383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:28:52 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-ec53d5ab-9ad9-4947-9a92-4524508a3c55 tempest-ProjectMemberTests-1570638723 None] Volume 0f1fa702-973e-41fb-b9f1-cf7cf9446407: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f1fa702-973e-41fb-b9f1-cf7cf9446407', 'volume_size': 1} Aug 29 01:28:52 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-ec53d5ab-9ad9-4947-9a92-4524508a3c55 tempest-ProjectMemberTests-1570638723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:28:52 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-ec53d5ab-9ad9-4947-9a92-4524508a3c55 tempest-ProjectMemberTests-1570638723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:28:52 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-ec53d5ab-9ad9-4947-9a92-4524508a3c55 tempest-ProjectMemberTests-1570638723 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:28:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-351233060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f1fa702-973e-41fb-b9f1-cf7cf9446407,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc3e18b86dee456398aada5b169dc198',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:28:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:28:53Z,use_quota=True,user_id='ea18f1190bab494589a803742a7eb22a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:28:52 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-ec53d5ab-9ad9-4947-9a92-4524508a3c55 tempest-ProjectMemberTests-1570638723 None] Creating volume 0f1fa702-973e-41fb-b9f1-cf7cf9446407 {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:28:52 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-ec53d5ab-9ad9-4947-9a92-4524508a3c55 tempest-ProjectMemberTests-1570638723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:28:52 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-ec53d5ab-9ad9-4947-9a92-4524508a3c55 tempest-ProjectMemberTests-1570638723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:28:52 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-ec53d5ab-9ad9-4947-9a92-4524508a3c55 tempest-ProjectMemberTests-1570638723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:28:52 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-ec53d5ab-9ad9-4947-9a92-4524508a3c55 tempest-ProjectMemberTests-1570638723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:28:52 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-ec53d5ab-9ad9-4947-9a92-4524508a3c55 tempest-ProjectMemberTests-1570638723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:28:52 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-ec53d5ab-9ad9-4947-9a92-4524508a3c55 tempest-ProjectMemberTests-1570638723 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:28:52 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-ec53d5ab-9ad9-4947-9a92-4524508a3c55 tempest-ProjectMemberTests-1570638723 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:28:52 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-ec53d5ab-9ad9-4947-9a92-4524508a3c55 tempest-ProjectMemberTests-1570638723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-0f1fa702-973e-41fb-b9f1-cf7cf9446407 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:52 devstack sudo[105487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-0f1fa702-973e-41fb-b9f1-cf7cf9446407 1073741824 Aug 29 01:28:52 devstack sudo[105487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:53 devstack sudo[105485]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:53 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d4f4ccd4-ac12-4520-ac58-ee7154a86163 tempest-ProjectReaderTests-1698516188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-78db2eb2-e3be-4a60-bd23-7cb1bd13f8b4" returned: 0 in 0.440s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:53 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d4f4ccd4-ac12-4520-ac58-ee7154a86163 tempest-ProjectReaderTests-1698516188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-78db2eb2-e3be-4a60-bd23-7cb1bd13f8b4.8feb5604-e9ac-40c3-a4f2-e61619f86648 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:53 devstack sudo[105492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-78db2eb2-e3be-4a60-bd23-7cb1bd13f8b4.8feb5604-e9ac-40c3-a4f2-e61619f86648 Aug 29 01:28:53 devstack sudo[105492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:53 devstack sudo[105487]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:53 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-ec53d5ab-9ad9-4947-9a92-4524508a3c55 tempest-ProjectMemberTests-1570638723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-0f1fa702-973e-41fb-b9f1-cf7cf9446407 1073741824" returned: 0 in 0.565s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:53 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-ec53d5ab-9ad9-4947-9a92-4524508a3c55 tempest-ProjectMemberTests-1570638723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-0f1fa702-973e-41fb-b9f1-cf7cf9446407 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:53 devstack sudo[105501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-0f1fa702-973e-41fb-b9f1-cf7cf9446407 Aug 29 01:28:53 devstack sudo[105501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:53 devstack sudo[105492]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:53 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d4f4ccd4-ac12-4520-ac58-ee7154a86163 tempest-ProjectReaderTests-1698516188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-78db2eb2-e3be-4a60-bd23-7cb1bd13f8b4.8feb5604-e9ac-40c3-a4f2-e61619f86648" returned: 0 in 0.448s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:53 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d4f4ccd4-ac12-4520-ac58-ee7154a86163 tempest-ProjectReaderTests-1698516188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-78db2eb2-e3be-4a60-bd23-7cb1bd13f8b4.8feb5604-e9ac-40c3-a4f2-e61619f86648 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:53 devstack sudo[105503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-78db2eb2-e3be-4a60-bd23-7cb1bd13f8b4.8feb5604-e9ac-40c3-a4f2-e61619f86648 Aug 29 01:28:53 devstack sudo[105503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:53 devstack sudo[105501]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:53 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-ec53d5ab-9ad9-4947-9a92-4524508a3c55 tempest-ProjectMemberTests-1570638723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-0f1fa702-973e-41fb-b9f1-cf7cf9446407" returned: 0 in 0.382s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:53 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-ec53d5ab-9ad9-4947-9a92-4524508a3c55 tempest-ProjectMemberTests-1570638723 None] <== create_volume: return (1004ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:28:53 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-ec53d5ab-9ad9-4947-9a92-4524508a3c55 tempest-ProjectMemberTests-1570638723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.006s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:28:53 devstack sudo[105503]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:53 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-ec53d5ab-9ad9-4947-9a92-4524508a3c55 tempest-ProjectMemberTests-1570638723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1304715-4590-468c-ae13-70315bcdf383) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f1fa702-973e-41fb-b9f1-cf7cf9446407', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:28:53 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-ec53d5ab-9ad9-4947-9a92-4524508a3c55 tempest-ProjectMemberTests-1570638723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91e6b53d-0ba4-4236-8989-cc9a80e42136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:28:53 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d4f4ccd4-ac12-4520-ac58-ee7154a86163 tempest-ProjectReaderTests-1698516188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-78db2eb2-e3be-4a60-bd23-7cb1bd13f8b4.8feb5604-e9ac-40c3-a4f2-e61619f86648" returned: 0 in 0.336s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:53 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-d4f4ccd4-ac12-4520-ac58-ee7154a86163 tempest-ProjectReaderTests-1698516188 None] Lock "cinder-quobyte-8feb5604-e9ac-40c3-a4f2-e61619f86648" released by "_delete_snapshot" :: held 1.907s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:28:53 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-ec53d5ab-9ad9-4947-9a92-4524508a3c55 tempest-ProjectMemberTests-1570638723 None] Volume volume-0f1fa702-973e-41fb-b9f1-cf7cf9446407 (0f1fa702-973e-41fb-b9f1-cf7cf9446407): created successfully Aug 29 01:28:53 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-ec53d5ab-9ad9-4947-9a92-4524508a3c55 tempest-ProjectMemberTests-1570638723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91e6b53d-0ba4-4236-8989-cc9a80e42136) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:28:53 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-ec53d5ab-9ad9-4947-9a92-4524508a3c55 tempest-ProjectMemberTests-1570638723 None] Flow 'volume_create_manager' (be257fe8-997c-475d-8ccd-edcb533db0e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:28:53 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-d4f4ccd4-ac12-4520-ac58-ee7154a86163 tempest-ProjectReaderTests-1698516188 None] Lock "cinder-quobyte-78db2eb2-e3be-4a60-bd23-7cb1bd13f8b4" released by "delete_snapshot" :: held 1.958s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:28:53 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-ec53d5ab-9ad9-4947-9a92-4524508a3c55 tempest-ProjectMemberTests-1570638723 None] Created volume successfully. Aug 29 01:28:54 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-d4f4ccd4-ac12-4520-ac58-ee7154a86163 tempest-ProjectReaderTests-1698516188 None] Created reservations ['0fd5c845-7731-4a95-a1bb-8a4bdb587ecb', 'ab70c981-5476-42cd-91f9-5806e22020e1', 'a60bc098-ddcb-4e13-8544-c51fbe8ba742', '3b14a4b1-7174-484f-916b-d5caf4b4bb0b'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:28:54 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-d4f4ccd4-ac12-4520-ac58-ee7154a86163 tempest-ProjectReaderTests-1698516188 None] Delete snapshot completed successfully. Aug 29 01:28:54 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-d4f4ccd4-ac12-4520-ac58-ee7154a86163 tempest-ProjectReaderTests-1698516188 None] Lock "cinder-8feb5604-e9ac-40c3-a4f2-e61619f86648-delete_snapshot" released by "delete_snapshot" :: held 2.143s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:28:54 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-ff3603d5-c9f2-4540-9baf-5e64bd536ced tempest-ProjectReaderTests-1698516188 None] Acquiring lock "cinder-78db2eb2-e3be-4a60-bd23-7cb1bd13f8b4-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:28:54 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-ff3603d5-c9f2-4540-9baf-5e64bd536ced tempest-ProjectReaderTests-1698516188 None] Lock "cinder-78db2eb2-e3be-4a60-bd23-7cb1bd13f8b4-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:28:54 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-ff3603d5-c9f2-4540-9baf-5e64bd536ced tempest-ProjectReaderTests-1698516188 None] Acquiring lock "cinder-quobyte-78db2eb2-e3be-4a60-bd23-7cb1bd13f8b4" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:28:54 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-ff3603d5-c9f2-4540-9baf-5e64bd536ced tempest-ProjectReaderTests-1698516188 None] Lock "cinder-quobyte-78db2eb2-e3be-4a60-bd23-7cb1bd13f8b4" acquired by "delete_volume" :: waited 0.019s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:28:54 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[569b98dc-a503-402b-a073-c73d5484e95e]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:28:54 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-ff3603d5-c9f2-4540-9baf-5e64bd536ced tempest-ProjectReaderTests-1698516188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-78db2eb2-e3be-4a60-bd23-7cb1bd13f8b4 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:54 devstack sudo[105507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-78db2eb2-e3be-4a60-bd23-7cb1bd13f8b4 Aug 29 01:28:54 devstack sudo[105507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:54 devstack sudo[105507]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:54 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-ff3603d5-c9f2-4540-9baf-5e64bd536ced tempest-ProjectReaderTests-1698516188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-78db2eb2-e3be-4a60-bd23-7cb1bd13f8b4" returned: 0 in 0.445s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:54 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-ff3603d5-c9f2-4540-9baf-5e64bd536ced tempest-ProjectReaderTests-1698516188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-78db2eb2-e3be-4a60-bd23-7cb1bd13f8b4 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:54 devstack sudo[105512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-78db2eb2-e3be-4a60-bd23-7cb1bd13f8b4 Aug 29 01:28:54 devstack sudo[105512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:55 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-92a76a09-f4d8-4fd6-9768-64b0d8814438 tempest-ProjectMemberTests-1570638723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:28:55 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-92a76a09-f4d8-4fd6-9768-64b0d8814438 tempest-ProjectMemberTests-1570638723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:28:55 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-92a76a09-f4d8-4fd6-9768-64b0d8814438 tempest-ProjectMemberTests-1570638723 None] Creating offline snapshot ac0f2a69-008e-4d9a-9996-730e2d804117 of volume 0f1fa702-973e-41fb-b9f1-cf7cf9446407 {{(pid=86111) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 29 01:28:55 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[11842a2a-8450-4393-8050-f61025406bb0]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:28:55 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-92a76a09-f4d8-4fd6-9768-64b0d8814438 tempest-ProjectMemberTests-1570638723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-0f1fa702-973e-41fb-b9f1-cf7cf9446407 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:55 devstack sudo[105512]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:55 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-ff3603d5-c9f2-4540-9baf-5e64bd536ced tempest-ProjectReaderTests-1698516188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-78db2eb2-e3be-4a60-bd23-7cb1bd13f8b4" returned: 0 in 0.323s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:55 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-ff3603d5-c9f2-4540-9baf-5e64bd536ced tempest-ProjectReaderTests-1698516188 None] Lock "cinder-quobyte-78db2eb2-e3be-4a60-bd23-7cb1bd13f8b4" released by "delete_volume" :: held 0.862s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:28:55 devstack sudo[105514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-0f1fa702-973e-41fb-b9f1-cf7cf9446407 Aug 29 01:28:55 devstack sudo[105514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:55 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-ff3603d5-c9f2-4540-9baf-5e64bd536ced tempest-ProjectReaderTests-1698516188 None] Created reservations ['2e8e3f38-13ec-4500-b0c4-50c53c096eef', 'daf03497-5c03-4ff3-98f6-bccf90b27923', '063fe7dd-a653-4dae-8aa0-6f81fa01960e', '88164d83-c165-4b67-9d8f-2f3e9b469513'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:28:55 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-ff3603d5-c9f2-4540-9baf-5e64bd536ced tempest-ProjectReaderTests-1698516188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:28:55 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-ff3603d5-c9f2-4540-9baf-5e64bd536ced tempest-ProjectReaderTests-1698516188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:28:55 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-ff3603d5-c9f2-4540-9baf-5e64bd536ced tempest-ProjectReaderTests-1698516188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:28:55 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-ff3603d5-c9f2-4540-9baf-5e64bd536ced tempest-ProjectReaderTests-1698516188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:28:55 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-ff3603d5-c9f2-4540-9baf-5e64bd536ced tempest-ProjectReaderTests-1698516188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:28:55 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-ff3603d5-c9f2-4540-9baf-5e64bd536ced tempest-ProjectReaderTests-1698516188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:55 devstack sudo[105517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:28:55 devstack sudo[105517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:55 devstack sudo[105514]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:55 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-92a76a09-f4d8-4fd6-9768-64b0d8814438 tempest-ProjectMemberTests-1570638723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-0f1fa702-973e-41fb-b9f1-cf7cf9446407" returned: 0 in 0.474s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:55 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-92a76a09-f4d8-4fd6-9768-64b0d8814438 tempest-ProjectMemberTests-1570638723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-0f1fa702-973e-41fb-b9f1-cf7cf9446407,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-0f1fa702-973e-41fb-b9f1-cf7cf9446407.ac0f2a69-008e-4d9a-9996-730e2d804117 1G {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:55 devstack sudo[105522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-0f1fa702-973e-41fb-b9f1-cf7cf9446407,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-0f1fa702-973e-41fb-b9f1-cf7cf9446407.ac0f2a69-008e-4d9a-9996-730e2d804117 1G Aug 29 01:28:55 devstack sudo[105522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:55 devstack sudo[105517]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:55 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-ff3603d5-c9f2-4540-9baf-5e64bd536ced tempest-ProjectReaderTests-1698516188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.328s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:55 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-ff3603d5-c9f2-4540-9baf-5e64bd536ced tempest-ProjectReaderTests-1698516188 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:28:55 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-ff3603d5-c9f2-4540-9baf-5e64bd536ced tempest-ProjectReaderTests-1698516188 None] Deleted volume successfully. Aug 29 01:28:55 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-ff3603d5-c9f2-4540-9baf-5e64bd536ced tempest-ProjectReaderTests-1698516188 None] Lock "cinder-78db2eb2-e3be-4a60-bd23-7cb1bd13f8b4-delete_volume" released by "delete_volume" :: held 1.481s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:28:56 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b3dbaad-289f-4e32-98c5-3edd8d93445d tempest-ProjectReaderTests-1698516188 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:28:56 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-9b3dbaad-289f-4e32-98c5-3edd8d93445d tempest-ProjectReaderTests-1698516188 None] Flow 'volume_create_manager' (152ab126-b73f-46b3-a31a-2076b352af1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:28:56 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-9b3dbaad-289f-4e32-98c5-3edd8d93445d tempest-ProjectReaderTests-1698516188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86a8ae90-3751-4266-a24b-8d6dcc10981e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:28:56 devstack sudo[105522]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:56 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-92a76a09-f4d8-4fd6-9768-64b0d8814438 tempest-ProjectMemberTests-1570638723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-0f1fa702-973e-41fb-b9f1-cf7cf9446407,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-0f1fa702-973e-41fb-b9f1-cf7cf9446407.ac0f2a69-008e-4d9a-9996-730e2d804117 1G" returned: 0 in 0.601s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:56 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-92a76a09-f4d8-4fd6-9768-64b0d8814438 tempest-ProjectMemberTests-1570638723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f1fa702-973e-41fb-b9f1-cf7cf9446407 -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-0f1fa702-973e-41fb-b9f1-cf7cf9446407.ac0f2a69-008e-4d9a-9996-730e2d804117 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:56 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-9b3dbaad-289f-4e32-98c5-3edd8d93445d tempest-ProjectReaderTests-1698516188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86a8ae90-3751-4266-a24b-8d6dcc10981e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:28:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1225926198',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbc73c0f-7c1c-444b-82b9-057aac301577,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f049b4b9de194d0bb816e863c7740f77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:28:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:28:56Z,use_quota=True,user_id='168ab677c6ef4d8f93d853c32c291481',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:28:56 devstack sudo[105528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f1fa702-973e-41fb-b9f1-cf7cf9446407 -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-0f1fa702-973e-41fb-b9f1-cf7cf9446407.ac0f2a69-008e-4d9a-9996-730e2d804117 Aug 29 01:28:56 devstack sudo[105528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:56 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-9b3dbaad-289f-4e32-98c5-3edd8d93445d tempest-ProjectReaderTests-1698516188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bcfb749-abf9-423d-a484-29bbc4d06b7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:28:56 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-9b3dbaad-289f-4e32-98c5-3edd8d93445d tempest-ProjectReaderTests-1698516188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bcfb749-abf9-423d-a484-29bbc4d06b7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:28:56 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-9b3dbaad-289f-4e32-98c5-3edd8d93445d tempest-ProjectReaderTests-1698516188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e90f2f6-e3f0-46e0-b32c-a63adec93705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:28:56 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-9b3dbaad-289f-4e32-98c5-3edd8d93445d tempest-ProjectReaderTests-1698516188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e90f2f6-e3f0-46e0-b32c-a63adec93705) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bbc73c0f-7c1c-444b-82b9-057aac301577', 'volume_name': 'volume-bbc73c0f-7c1c-444b-82b9-057aac301577', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:28:56 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-9b3dbaad-289f-4e32-98c5-3edd8d93445d tempest-ProjectReaderTests-1698516188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b5636dc-c25f-4403-8efa-1b6ea7df70a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:28:56 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-9b3dbaad-289f-4e32-98c5-3edd8d93445d tempest-ProjectReaderTests-1698516188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b5636dc-c25f-4403-8efa-1b6ea7df70a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:28:56 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-9b3dbaad-289f-4e32-98c5-3edd8d93445d tempest-ProjectReaderTests-1698516188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (524ad689-799b-4909-b22a-539522bdaa47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:28:56 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-9b3dbaad-289f-4e32-98c5-3edd8d93445d tempest-ProjectReaderTests-1698516188 None] Volume bbc73c0f-7c1c-444b-82b9-057aac301577: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bbc73c0f-7c1c-444b-82b9-057aac301577', 'volume_size': 1} Aug 29 01:28:56 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-9b3dbaad-289f-4e32-98c5-3edd8d93445d tempest-ProjectReaderTests-1698516188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:28:56 devstack sudo[105528]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:56 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-92a76a09-f4d8-4fd6-9768-64b0d8814438 tempest-ProjectMemberTests-1570638723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f1fa702-973e-41fb-b9f1-cf7cf9446407 -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-0f1fa702-973e-41fb-b9f1-cf7cf9446407.ac0f2a69-008e-4d9a-9996-730e2d804117" returned: 0 in 0.355s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:56 devstack cinder-volume[86111]: WARNING cinder.volume.drivers.remotefs [None req-92a76a09-f4d8-4fd6-9768-64b0d8814438 tempest-ProjectMemberTests-1570638723 None] /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-0f1fa702-973e-41fb-b9f1-cf7cf9446407.ac0f2a69-008e-4d9a-9996-730e2d804117 is being set with open permissions: ugo+rw Aug 29 01:28:56 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-92a76a09-f4d8-4fd6-9768-64b0d8814438 tempest-ProjectMemberTests-1570638723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-0f1fa702-973e-41fb-b9f1-cf7cf9446407.ac0f2a69-008e-4d9a-9996-730e2d804117 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:56 devstack sudo[105533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-0f1fa702-973e-41fb-b9f1-cf7cf9446407.ac0f2a69-008e-4d9a-9996-730e2d804117 Aug 29 01:28:56 devstack sudo[105533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:56 devstack sudo[105533]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:56 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-92a76a09-f4d8-4fd6-9768-64b0d8814438 tempest-ProjectMemberTests-1570638723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-0f1fa702-973e-41fb-b9f1-cf7cf9446407.ac0f2a69-008e-4d9a-9996-730e2d804117" returned: 0 in 0.430s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:56 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-92a76a09-f4d8-4fd6-9768-64b0d8814438 tempest-ProjectMemberTests-1570638723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-0f1fa702-973e-41fb-b9f1-cf7cf9446407.info {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:57 devstack sudo[105538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-0f1fa702-973e-41fb-b9f1-cf7cf9446407.info Aug 29 01:28:57 devstack sudo[105538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:57 devstack sudo[105538]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:57 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-92a76a09-f4d8-4fd6-9768-64b0d8814438 tempest-ProjectMemberTests-1570638723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-0f1fa702-973e-41fb-b9f1-cf7cf9446407.info" returned: 0 in 0.317s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:57 devstack cinder-volume[86111]: WARNING cinder.volume.drivers.remotefs [None req-92a76a09-f4d8-4fd6-9768-64b0d8814438 tempest-ProjectMemberTests-1570638723 None] /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-0f1fa702-973e-41fb-b9f1-cf7cf9446407.info is being set with open permissions: ugo+rw Aug 29 01:28:57 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-92a76a09-f4d8-4fd6-9768-64b0d8814438 tempest-ProjectMemberTests-1570638723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-0f1fa702-973e-41fb-b9f1-cf7cf9446407.info {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:57 devstack sudo[105541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-0f1fa702-973e-41fb-b9f1-cf7cf9446407.info Aug 29 01:28:57 devstack sudo[105541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:57 devstack sudo[105541]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:57 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-92a76a09-f4d8-4fd6-9768-64b0d8814438 tempest-ProjectMemberTests-1570638723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-0f1fa702-973e-41fb-b9f1-cf7cf9446407.info" returned: 0 in 0.302s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:57 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-92a76a09-f4d8-4fd6-9768-64b0d8814438 tempest-ProjectMemberTests-1570638723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.607s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:28:57 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-9b3dbaad-289f-4e32-98c5-3edd8d93445d tempest-ProjectReaderTests-1698516188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.422s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:28:57 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-9b3dbaad-289f-4e32-98c5-3edd8d93445d tempest-ProjectReaderTests-1698516188 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:28:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1225926198',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbc73c0f-7c1c-444b-82b9-057aac301577,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f049b4b9de194d0bb816e863c7740f77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:28:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:28:56Z,use_quota=True,user_id='168ab677c6ef4d8f93d853c32c291481',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:28:57 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-9b3dbaad-289f-4e32-98c5-3edd8d93445d tempest-ProjectReaderTests-1698516188 None] Creating volume bbc73c0f-7c1c-444b-82b9-057aac301577 {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:28:57 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-9b3dbaad-289f-4e32-98c5-3edd8d93445d tempest-ProjectReaderTests-1698516188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:28:57 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-9b3dbaad-289f-4e32-98c5-3edd8d93445d tempest-ProjectReaderTests-1698516188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:28:57 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-9b3dbaad-289f-4e32-98c5-3edd8d93445d tempest-ProjectReaderTests-1698516188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:28:57 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-9b3dbaad-289f-4e32-98c5-3edd8d93445d tempest-ProjectReaderTests-1698516188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:28:57 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-9b3dbaad-289f-4e32-98c5-3edd8d93445d tempest-ProjectReaderTests-1698516188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:28:57 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-9b3dbaad-289f-4e32-98c5-3edd8d93445d tempest-ProjectReaderTests-1698516188 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:28:57 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-9b3dbaad-289f-4e32-98c5-3edd8d93445d tempest-ProjectReaderTests-1698516188 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:28:57 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-9b3dbaad-289f-4e32-98c5-3edd8d93445d tempest-ProjectReaderTests-1698516188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-bbc73c0f-7c1c-444b-82b9-057aac301577 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:57 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-92a76a09-f4d8-4fd6-9768-64b0d8814438 tempest-ProjectMemberTests-1570638723 None] Create snapshot completed successfully Aug 29 01:28:57 devstack sudo[105544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-bbc73c0f-7c1c-444b-82b9-057aac301577 1073741824 Aug 29 01:28:57 devstack sudo[105544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:58 devstack sudo[105544]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:58 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-9b3dbaad-289f-4e32-98c5-3edd8d93445d tempest-ProjectReaderTests-1698516188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-bbc73c0f-7c1c-444b-82b9-057aac301577 1073741824" returned: 0 in 0.612s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:58 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-a6de79fe-edb5-4460-976e-9fcd0073ef17 tempest-ProjectMemberTests-1570638723 None] Acquiring lock "cinder-ac0f2a69-008e-4d9a-9996-730e2d804117-delete_snapshot" by "delete_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:28:58 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-a6de79fe-edb5-4460-976e-9fcd0073ef17 tempest-ProjectMemberTests-1570638723 None] Lock "cinder-ac0f2a69-008e-4d9a-9996-730e2d804117-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:28:58 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-a6de79fe-edb5-4460-976e-9fcd0073ef17 tempest-ProjectMemberTests-1570638723 None] Acquiring lock "cinder-quobyte-0f1fa702-973e-41fb-b9f1-cf7cf9446407" by "delete_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:28:58 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-9b3dbaad-289f-4e32-98c5-3edd8d93445d tempest-ProjectReaderTests-1698516188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-bbc73c0f-7c1c-444b-82b9-057aac301577 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:58 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-a6de79fe-edb5-4460-976e-9fcd0073ef17 tempest-ProjectMemberTests-1570638723 None] Lock "cinder-quobyte-0f1fa702-973e-41fb-b9f1-cf7cf9446407" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:28:58 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-a6de79fe-edb5-4460-976e-9fcd0073ef17 tempest-ProjectMemberTests-1570638723 None] Acquiring lock "cinder-quobyte-ac0f2a69-008e-4d9a-9996-730e2d804117" by "_delete_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:28:58 devstack sudo[105550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-bbc73c0f-7c1c-444b-82b9-057aac301577 Aug 29 01:28:58 devstack sudo[105550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:58 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-a6de79fe-edb5-4460-976e-9fcd0073ef17 tempest-ProjectMemberTests-1570638723 None] Lock "cinder-quobyte-ac0f2a69-008e-4d9a-9996-730e2d804117" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:28:58 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-a6de79fe-edb5-4460-976e-9fcd0073ef17 tempest-ProjectMemberTests-1570638723 None] Deleting offline snapshot ac0f2a69-008e-4d9a-9996-730e2d804117 of volume 0f1fa702-973e-41fb-b9f1-cf7cf9446407 {{(pid=86111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 29 01:28:58 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-a6de79fe-edb5-4460-976e-9fcd0073ef17 tempest-ProjectMemberTests-1570638723 None] snapshot_file for this snap is: volume-0f1fa702-973e-41fb-b9f1-cf7cf9446407.ac0f2a69-008e-4d9a-9996-730e2d804117 {{(pid=86111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 29 01:28:58 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c2f577f-2e9e-4b2e-9cd1-0f9aec1dd0c2]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:28:58 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-a6de79fe-edb5-4460-976e-9fcd0073ef17 tempest-ProjectMemberTests-1570638723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-0f1fa702-973e-41fb-b9f1-cf7cf9446407.ac0f2a69-008e-4d9a-9996-730e2d804117 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:58 devstack sudo[105552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-0f1fa702-973e-41fb-b9f1-cf7cf9446407.ac0f2a69-008e-4d9a-9996-730e2d804117 Aug 29 01:28:58 devstack sudo[105552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:58 devstack sudo[105550]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:58 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-9b3dbaad-289f-4e32-98c5-3edd8d93445d tempest-ProjectReaderTests-1698516188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-bbc73c0f-7c1c-444b-82b9-057aac301577" returned: 0 in 0.367s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:58 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-9b3dbaad-289f-4e32-98c5-3edd8d93445d tempest-ProjectReaderTests-1698516188 None] <== create_volume: return (1057ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:28:58 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-9b3dbaad-289f-4e32-98c5-3edd8d93445d tempest-ProjectReaderTests-1698516188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.062s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:28:58 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-9b3dbaad-289f-4e32-98c5-3edd8d93445d tempest-ProjectReaderTests-1698516188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (524ad689-799b-4909-b22a-539522bdaa47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bbc73c0f-7c1c-444b-82b9-057aac301577', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:28:58 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-9b3dbaad-289f-4e32-98c5-3edd8d93445d tempest-ProjectReaderTests-1698516188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cc0f5c7-edfd-4b1a-a512-7a443b873298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:28:58 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-9b3dbaad-289f-4e32-98c5-3edd8d93445d tempest-ProjectReaderTests-1698516188 None] Volume volume-bbc73c0f-7c1c-444b-82b9-057aac301577 (bbc73c0f-7c1c-444b-82b9-057aac301577): created successfully Aug 29 01:28:58 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-9b3dbaad-289f-4e32-98c5-3edd8d93445d tempest-ProjectReaderTests-1698516188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cc0f5c7-edfd-4b1a-a512-7a443b873298) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:28:58 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-9b3dbaad-289f-4e32-98c5-3edd8d93445d tempest-ProjectReaderTests-1698516188 None] Flow 'volume_create_manager' (152ab126-b73f-46b3-a31a-2076b352af1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:28:58 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-9b3dbaad-289f-4e32-98c5-3edd8d93445d tempest-ProjectReaderTests-1698516188 None] Created volume successfully. Aug 29 01:28:58 devstack sudo[105552]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:58 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-a6de79fe-edb5-4460-976e-9fcd0073ef17 tempest-ProjectMemberTests-1570638723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-0f1fa702-973e-41fb-b9f1-cf7cf9446407.ac0f2a69-008e-4d9a-9996-730e2d804117" returned: 0 in 0.437s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:58 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-a6de79fe-edb5-4460-976e-9fcd0073ef17 tempest-ProjectMemberTests-1570638723 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0f1fa702-973e-41fb-b9f1-cf7cf9446407(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 29 01:28:58 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[32318eff-0bfb-45ba-ae22-60f95a3f09d5]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:28:58 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-a6de79fe-edb5-4460-976e-9fcd0073ef17 tempest-ProjectMemberTests-1570638723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-0f1fa702-973e-41fb-b9f1-cf7cf9446407 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:59 devstack sudo[105559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-0f1fa702-973e-41fb-b9f1-cf7cf9446407 Aug 29 01:28:59 devstack sudo[105559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:59 devstack sudo[105559]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:59 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-a6de79fe-edb5-4460-976e-9fcd0073ef17 tempest-ProjectMemberTests-1570638723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-0f1fa702-973e-41fb-b9f1-cf7cf9446407" returned: 0 in 0.404s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:59 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-a6de79fe-edb5-4460-976e-9fcd0073ef17 tempest-ProjectMemberTests-1570638723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-0f1fa702-973e-41fb-b9f1-cf7cf9446407.ac0f2a69-008e-4d9a-9996-730e2d804117 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:59 devstack sudo[105564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-0f1fa702-973e-41fb-b9f1-cf7cf9446407.ac0f2a69-008e-4d9a-9996-730e2d804117 Aug 29 01:28:59 devstack sudo[105564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:59 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-c19e3755-5e5a-428a-a2c6-1891598910ac tempest-ProjectReaderTests-1698516188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:28:59 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-c19e3755-5e5a-428a-a2c6-1891598910ac tempest-ProjectReaderTests-1698516188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:28:59 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-c19e3755-5e5a-428a-a2c6-1891598910ac tempest-ProjectReaderTests-1698516188 None] Creating offline snapshot 0686ed93-bea4-458d-ad44-e883ca85a545 of volume bbc73c0f-7c1c-444b-82b9-057aac301577 {{(pid=86111) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 29 01:28:59 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4e4cec0-80b1-4498-90fa-febd1864573b]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:28:59 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c19e3755-5e5a-428a-a2c6-1891598910ac tempest-ProjectReaderTests-1698516188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-bbc73c0f-7c1c-444b-82b9-057aac301577 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:59 devstack sudo[105564]: pam_unix(sudo:session): session closed for user root Aug 29 01:28:59 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-a6de79fe-edb5-4460-976e-9fcd0073ef17 tempest-ProjectMemberTests-1570638723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-0f1fa702-973e-41fb-b9f1-cf7cf9446407.ac0f2a69-008e-4d9a-9996-730e2d804117" returned: 0 in 0.475s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:28:59 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-a6de79fe-edb5-4460-976e-9fcd0073ef17 tempest-ProjectMemberTests-1570638723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-0f1fa702-973e-41fb-b9f1-cf7cf9446407.ac0f2a69-008e-4d9a-9996-730e2d804117 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:28:59 devstack sudo[105570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-bbc73c0f-7c1c-444b-82b9-057aac301577 Aug 29 01:28:59 devstack sudo[105570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:28:59 devstack sudo[105571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-0f1fa702-973e-41fb-b9f1-cf7cf9446407.ac0f2a69-008e-4d9a-9996-730e2d804117 Aug 29 01:28:59 devstack sudo[105571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:00 devstack sudo[105571]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:00 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-a6de79fe-edb5-4460-976e-9fcd0073ef17 tempest-ProjectMemberTests-1570638723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-0f1fa702-973e-41fb-b9f1-cf7cf9446407.ac0f2a69-008e-4d9a-9996-730e2d804117" returned: 0 in 0.264s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:00 devstack sudo[105570]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:00 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c19e3755-5e5a-428a-a2c6-1891598910ac tempest-ProjectReaderTests-1698516188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-bbc73c0f-7c1c-444b-82b9-057aac301577" returned: 0 in 0.406s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:00 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c19e3755-5e5a-428a-a2c6-1891598910ac tempest-ProjectReaderTests-1698516188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-bbc73c0f-7c1c-444b-82b9-057aac301577,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-bbc73c0f-7c1c-444b-82b9-057aac301577.0686ed93-bea4-458d-ad44-e883ca85a545 1G {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:00 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-a6de79fe-edb5-4460-976e-9fcd0073ef17 tempest-ProjectMemberTests-1570638723 None] Lock "cinder-quobyte-ac0f2a69-008e-4d9a-9996-730e2d804117" released by "_delete_snapshot" :: held 1.716s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:29:00 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-a6de79fe-edb5-4460-976e-9fcd0073ef17 tempest-ProjectMemberTests-1570638723 None] Lock "cinder-quobyte-0f1fa702-973e-41fb-b9f1-cf7cf9446407" released by "delete_snapshot" :: held 1.765s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:29:00 devstack sudo[105578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-bbc73c0f-7c1c-444b-82b9-057aac301577,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-bbc73c0f-7c1c-444b-82b9-057aac301577.0686ed93-bea4-458d-ad44-e883ca85a545 1G Aug 29 01:29:00 devstack sudo[105578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:00 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-a6de79fe-edb5-4460-976e-9fcd0073ef17 tempest-ProjectMemberTests-1570638723 None] Created reservations ['9d2d36e0-5c35-4a56-9dbf-3e553b2d71ef', '1e2306f3-46a2-4069-a09a-a21eca6302bd', '863fa6a7-f3fe-4ce4-a124-d53574a91f20', 'bfc09500-2168-4f9f-99f4-061c0869c6f1'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:29:00 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-a6de79fe-edb5-4460-976e-9fcd0073ef17 tempest-ProjectMemberTests-1570638723 None] Delete snapshot completed successfully. Aug 29 01:29:00 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-a6de79fe-edb5-4460-976e-9fcd0073ef17 tempest-ProjectMemberTests-1570638723 None] Lock "cinder-ac0f2a69-008e-4d9a-9996-730e2d804117-delete_snapshot" released by "delete_snapshot" :: held 1.959s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:29:00 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-e9b02422-2d3f-490d-b1e9-03d24fa9feb2 tempest-ProjectMemberTests-1570638723 None] Acquiring lock "cinder-0f1fa702-973e-41fb-b9f1-cf7cf9446407-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:29:00 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-e9b02422-2d3f-490d-b1e9-03d24fa9feb2 tempest-ProjectMemberTests-1570638723 None] Lock "cinder-0f1fa702-973e-41fb-b9f1-cf7cf9446407-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:29:00 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-e9b02422-2d3f-490d-b1e9-03d24fa9feb2 tempest-ProjectMemberTests-1570638723 None] Acquiring lock "cinder-quobyte-0f1fa702-973e-41fb-b9f1-cf7cf9446407" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:29:00 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-e9b02422-2d3f-490d-b1e9-03d24fa9feb2 tempest-ProjectMemberTests-1570638723 None] Lock "cinder-quobyte-0f1fa702-973e-41fb-b9f1-cf7cf9446407" acquired by "delete_volume" :: waited 0.019s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:29:00 devstack sudo[105578]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:00 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c19e3755-5e5a-428a-a2c6-1891598910ac tempest-ProjectReaderTests-1698516188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-bbc73c0f-7c1c-444b-82b9-057aac301577,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-bbc73c0f-7c1c-444b-82b9-057aac301577.0686ed93-bea4-458d-ad44-e883ca85a545 1G" returned: 0 in 0.539s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:00 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c19e3755-5e5a-428a-a2c6-1891598910ac tempest-ProjectReaderTests-1698516188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bbc73c0f-7c1c-444b-82b9-057aac301577 -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-bbc73c0f-7c1c-444b-82b9-057aac301577.0686ed93-bea4-458d-ad44-e883ca85a545 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:00 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e331b8c-5624-4d86-bab2-9be9155f233b]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:29:00 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-e9b02422-2d3f-490d-b1e9-03d24fa9feb2 tempest-ProjectMemberTests-1570638723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-0f1fa702-973e-41fb-b9f1-cf7cf9446407 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:00 devstack sudo[105583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bbc73c0f-7c1c-444b-82b9-057aac301577 -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-bbc73c0f-7c1c-444b-82b9-057aac301577.0686ed93-bea4-458d-ad44-e883ca85a545 Aug 29 01:29:00 devstack sudo[105583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:00 devstack sudo[105584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-0f1fa702-973e-41fb-b9f1-cf7cf9446407 Aug 29 01:29:00 devstack sudo[105584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:00 devstack sudo[105583]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:00 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c19e3755-5e5a-428a-a2c6-1891598910ac tempest-ProjectReaderTests-1698516188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bbc73c0f-7c1c-444b-82b9-057aac301577 -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-bbc73c0f-7c1c-444b-82b9-057aac301577.0686ed93-bea4-458d-ad44-e883ca85a545" returned: 0 in 0.325s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:00 devstack cinder-volume[86111]: WARNING cinder.volume.drivers.remotefs [None req-c19e3755-5e5a-428a-a2c6-1891598910ac tempest-ProjectReaderTests-1698516188 None] /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-bbc73c0f-7c1c-444b-82b9-057aac301577.0686ed93-bea4-458d-ad44-e883ca85a545 is being set with open permissions: ugo+rw Aug 29 01:29:00 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c19e3755-5e5a-428a-a2c6-1891598910ac tempest-ProjectReaderTests-1698516188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-bbc73c0f-7c1c-444b-82b9-057aac301577.0686ed93-bea4-458d-ad44-e883ca85a545 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:00 devstack sudo[105593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-bbc73c0f-7c1c-444b-82b9-057aac301577.0686ed93-bea4-458d-ad44-e883ca85a545 Aug 29 01:29:00 devstack sudo[105593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:01 devstack sudo[105584]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:01 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-e9b02422-2d3f-490d-b1e9-03d24fa9feb2 tempest-ProjectMemberTests-1570638723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-0f1fa702-973e-41fb-b9f1-cf7cf9446407" returned: 0 in 0.403s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:01 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-e9b02422-2d3f-490d-b1e9-03d24fa9feb2 tempest-ProjectMemberTests-1570638723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-0f1fa702-973e-41fb-b9f1-cf7cf9446407 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:01 devstack sudo[105596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-0f1fa702-973e-41fb-b9f1-cf7cf9446407 Aug 29 01:29:01 devstack sudo[105596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:01 devstack sudo[105593]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:01 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c19e3755-5e5a-428a-a2c6-1891598910ac tempest-ProjectReaderTests-1698516188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-bbc73c0f-7c1c-444b-82b9-057aac301577.0686ed93-bea4-458d-ad44-e883ca85a545" returned: 0 in 0.270s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:01 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c19e3755-5e5a-428a-a2c6-1891598910ac tempest-ProjectReaderTests-1698516188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-bbc73c0f-7c1c-444b-82b9-057aac301577.info {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:01 devstack sudo[105599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-bbc73c0f-7c1c-444b-82b9-057aac301577.info Aug 29 01:29:01 devstack sudo[105599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:01 devstack sudo[105596]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:01 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-e9b02422-2d3f-490d-b1e9-03d24fa9feb2 tempest-ProjectMemberTests-1570638723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-0f1fa702-973e-41fb-b9f1-cf7cf9446407" returned: 0 in 0.288s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:01 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-e9b02422-2d3f-490d-b1e9-03d24fa9feb2 tempest-ProjectMemberTests-1570638723 None] Lock "cinder-quobyte-0f1fa702-973e-41fb-b9f1-cf7cf9446407" released by "delete_volume" :: held 0.821s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:29:01 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-e9b02422-2d3f-490d-b1e9-03d24fa9feb2 tempest-ProjectMemberTests-1570638723 None] Created reservations ['d05590e8-ba98-447d-9582-cc29eaf92108', '44bfaae8-7b1a-4b28-950f-3e68c851c8dd', '9a769ce9-176a-48b1-bd08-663a77ff626a', '213eb06a-d041-4aa2-936a-efb60f19b97c'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:29:01 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-e9b02422-2d3f-490d-b1e9-03d24fa9feb2 tempest-ProjectMemberTests-1570638723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:29:01 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-e9b02422-2d3f-490d-b1e9-03d24fa9feb2 tempest-ProjectMemberTests-1570638723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:29:01 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-e9b02422-2d3f-490d-b1e9-03d24fa9feb2 tempest-ProjectMemberTests-1570638723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:29:01 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-e9b02422-2d3f-490d-b1e9-03d24fa9feb2 tempest-ProjectMemberTests-1570638723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:29:01 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-e9b02422-2d3f-490d-b1e9-03d24fa9feb2 tempest-ProjectMemberTests-1570638723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:29:01 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-e9b02422-2d3f-490d-b1e9-03d24fa9feb2 tempest-ProjectMemberTests-1570638723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:01 devstack sudo[105599]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:01 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c19e3755-5e5a-428a-a2c6-1891598910ac tempest-ProjectReaderTests-1698516188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-bbc73c0f-7c1c-444b-82b9-057aac301577.info" returned: 0 in 0.338s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:01 devstack cinder-volume[86111]: WARNING cinder.volume.drivers.remotefs [None req-c19e3755-5e5a-428a-a2c6-1891598910ac tempest-ProjectReaderTests-1698516188 None] /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-bbc73c0f-7c1c-444b-82b9-057aac301577.info is being set with open permissions: ugo+rw Aug 29 01:29:01 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c19e3755-5e5a-428a-a2c6-1891598910ac tempest-ProjectReaderTests-1698516188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-bbc73c0f-7c1c-444b-82b9-057aac301577.info {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:01 devstack sudo[105603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:29:01 devstack sudo[105603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:01 devstack sudo[105604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-bbc73c0f-7c1c-444b-82b9-057aac301577.info Aug 29 01:29:01 devstack sudo[105604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:01 devstack sudo[105604]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:01 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c19e3755-5e5a-428a-a2c6-1891598910ac tempest-ProjectReaderTests-1698516188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-bbc73c0f-7c1c-444b-82b9-057aac301577.info" returned: 0 in 0.300s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:01 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-c19e3755-5e5a-428a-a2c6-1891598910ac tempest-ProjectReaderTests-1698516188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.282s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:29:01 devstack sudo[105603]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:01 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-e9b02422-2d3f-490d-b1e9-03d24fa9feb2 tempest-ProjectMemberTests-1570638723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.375s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:01 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-e9b02422-2d3f-490d-b1e9-03d24fa9feb2 tempest-ProjectMemberTests-1570638723 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:29:01 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-e9b02422-2d3f-490d-b1e9-03d24fa9feb2 tempest-ProjectMemberTests-1570638723 None] Deleted volume successfully. Aug 29 01:29:01 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-c19e3755-5e5a-428a-a2c6-1891598910ac tempest-ProjectReaderTests-1698516188 None] Create snapshot completed successfully Aug 29 01:29:02 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-e9b02422-2d3f-490d-b1e9-03d24fa9feb2 tempest-ProjectMemberTests-1570638723 None] Lock "cinder-0f1fa702-973e-41fb-b9f1-cf7cf9446407-delete_volume" released by "delete_volume" :: held 1.479s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:29:02 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-262166ac-461d-4fda-8a47-81461b27438c tempest-ProjectMemberTests-1570638723 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:29:02 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-262166ac-461d-4fda-8a47-81461b27438c tempest-ProjectMemberTests-1570638723 None] Flow 'volume_create_manager' (76818d61-3dc3-442b-a1f3-d32b745117a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:29:02 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-262166ac-461d-4fda-8a47-81461b27438c tempest-ProjectMemberTests-1570638723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a999948b-af95-4cee-96e4-cfc699bd3d27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:29:02 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-262166ac-461d-4fda-8a47-81461b27438c tempest-ProjectMemberTests-1570638723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a999948b-af95-4cee-96e4-cfc699bd3d27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:29:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2078503417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28252c4f-3254-474a-a4dc-9047310904e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc3e18b86dee456398aada5b169dc198',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:29:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:29:02Z,use_quota=True,user_id='ea18f1190bab494589a803742a7eb22a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:29:02 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-262166ac-461d-4fda-8a47-81461b27438c tempest-ProjectMemberTests-1570638723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64b50834-adca-46bb-89e5-b7ab7a398264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:29:02 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-262166ac-461d-4fda-8a47-81461b27438c tempest-ProjectMemberTests-1570638723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64b50834-adca-46bb-89e5-b7ab7a398264) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:29:02 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-262166ac-461d-4fda-8a47-81461b27438c tempest-ProjectMemberTests-1570638723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd591368-de4d-46a8-b8df-c58816b852d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:29:02 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-262166ac-461d-4fda-8a47-81461b27438c tempest-ProjectMemberTests-1570638723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd591368-de4d-46a8-b8df-c58816b852d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28252c4f-3254-474a-a4dc-9047310904e0', 'volume_name': 'volume-28252c4f-3254-474a-a4dc-9047310904e0', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:29:02 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-262166ac-461d-4fda-8a47-81461b27438c tempest-ProjectMemberTests-1570638723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6dbd7c1-4c1f-4400-a105-9dc3cbda1425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:29:02 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-262166ac-461d-4fda-8a47-81461b27438c tempest-ProjectMemberTests-1570638723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6dbd7c1-4c1f-4400-a105-9dc3cbda1425) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:29:02 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-262166ac-461d-4fda-8a47-81461b27438c tempest-ProjectMemberTests-1570638723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (576c185a-e020-4ed0-9fd7-c8738b2a9e4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:29:02 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-262166ac-461d-4fda-8a47-81461b27438c tempest-ProjectMemberTests-1570638723 None] Volume 28252c4f-3254-474a-a4dc-9047310904e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28252c4f-3254-474a-a4dc-9047310904e0', 'volume_size': 1} Aug 29 01:29:02 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-262166ac-461d-4fda-8a47-81461b27438c tempest-ProjectMemberTests-1570638723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:29:02 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-262166ac-461d-4fda-8a47-81461b27438c tempest-ProjectMemberTests-1570638723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:29:02 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-262166ac-461d-4fda-8a47-81461b27438c tempest-ProjectMemberTests-1570638723 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:29:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2078503417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28252c4f-3254-474a-a4dc-9047310904e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc3e18b86dee456398aada5b169dc198',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:29:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:29:02Z,use_quota=True,user_id='ea18f1190bab494589a803742a7eb22a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:29:02 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-262166ac-461d-4fda-8a47-81461b27438c tempest-ProjectMemberTests-1570638723 None] Creating volume 28252c4f-3254-474a-a4dc-9047310904e0 {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:29:02 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-262166ac-461d-4fda-8a47-81461b27438c tempest-ProjectMemberTests-1570638723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:29:02 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-262166ac-461d-4fda-8a47-81461b27438c tempest-ProjectMemberTests-1570638723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:29:02 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-262166ac-461d-4fda-8a47-81461b27438c tempest-ProjectMemberTests-1570638723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:29:02 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-262166ac-461d-4fda-8a47-81461b27438c tempest-ProjectMemberTests-1570638723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:29:02 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-262166ac-461d-4fda-8a47-81461b27438c tempest-ProjectMemberTests-1570638723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:29:02 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-262166ac-461d-4fda-8a47-81461b27438c tempest-ProjectMemberTests-1570638723 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:29:02 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-262166ac-461d-4fda-8a47-81461b27438c tempest-ProjectMemberTests-1570638723 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:29:02 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-262166ac-461d-4fda-8a47-81461b27438c tempest-ProjectMemberTests-1570638723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-28252c4f-3254-474a-a4dc-9047310904e0 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:02 devstack sudo[105609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-28252c4f-3254-474a-a4dc-9047310904e0 1073741824 Aug 29 01:29:02 devstack sudo[105609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:02 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-84fd8b4f-8a9e-44c8-99e6-a3a7c835920c tempest-ProjectReaderTests-1698516188 None] Acquiring lock "cinder-0686ed93-bea4-458d-ad44-e883ca85a545-delete_snapshot" by "delete_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:29:02 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-84fd8b4f-8a9e-44c8-99e6-a3a7c835920c tempest-ProjectReaderTests-1698516188 None] Lock "cinder-0686ed93-bea4-458d-ad44-e883ca85a545-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:29:02 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-84fd8b4f-8a9e-44c8-99e6-a3a7c835920c tempest-ProjectReaderTests-1698516188 None] Acquiring lock "cinder-quobyte-bbc73c0f-7c1c-444b-82b9-057aac301577" by "delete_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:29:02 devstack sudo[105609]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:02 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-84fd8b4f-8a9e-44c8-99e6-a3a7c835920c tempest-ProjectReaderTests-1698516188 None] Lock "cinder-quobyte-bbc73c0f-7c1c-444b-82b9-057aac301577" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:29:02 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-84fd8b4f-8a9e-44c8-99e6-a3a7c835920c tempest-ProjectReaderTests-1698516188 None] Acquiring lock "cinder-quobyte-0686ed93-bea4-458d-ad44-e883ca85a545" by "_delete_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:29:02 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-262166ac-461d-4fda-8a47-81461b27438c tempest-ProjectMemberTests-1570638723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-28252c4f-3254-474a-a4dc-9047310904e0 1073741824" returned: 0 in 0.482s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:02 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-84fd8b4f-8a9e-44c8-99e6-a3a7c835920c tempest-ProjectReaderTests-1698516188 None] Lock "cinder-quobyte-0686ed93-bea4-458d-ad44-e883ca85a545" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:29:02 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-84fd8b4f-8a9e-44c8-99e6-a3a7c835920c tempest-ProjectReaderTests-1698516188 None] Deleting offline snapshot 0686ed93-bea4-458d-ad44-e883ca85a545 of volume bbc73c0f-7c1c-444b-82b9-057aac301577 {{(pid=86111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 29 01:29:02 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-84fd8b4f-8a9e-44c8-99e6-a3a7c835920c tempest-ProjectReaderTests-1698516188 None] snapshot_file for this snap is: volume-bbc73c0f-7c1c-444b-82b9-057aac301577.0686ed93-bea4-458d-ad44-e883ca85a545 {{(pid=86111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 29 01:29:02 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5b47529-92c2-430a-b760-6ce4dde14b73]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:29:02 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-84fd8b4f-8a9e-44c8-99e6-a3a7c835920c tempest-ProjectReaderTests-1698516188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-bbc73c0f-7c1c-444b-82b9-057aac301577.0686ed93-bea4-458d-ad44-e883ca85a545 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:02 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-262166ac-461d-4fda-8a47-81461b27438c tempest-ProjectMemberTests-1570638723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-28252c4f-3254-474a-a4dc-9047310904e0 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:03 devstack sudo[105616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-28252c4f-3254-474a-a4dc-9047310904e0 Aug 29 01:29:03 devstack sudo[105616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:03 devstack sudo[105615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-bbc73c0f-7c1c-444b-82b9-057aac301577.0686ed93-bea4-458d-ad44-e883ca85a545 Aug 29 01:29:03 devstack sudo[105615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:03 devstack sudo[105616]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:03 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-262166ac-461d-4fda-8a47-81461b27438c tempest-ProjectMemberTests-1570638723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-28252c4f-3254-474a-a4dc-9047310904e0" returned: 0 in 0.275s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:03 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-262166ac-461d-4fda-8a47-81461b27438c tempest-ProjectMemberTests-1570638723 None] <== create_volume: return (858ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:29:03 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-262166ac-461d-4fda-8a47-81461b27438c tempest-ProjectMemberTests-1570638723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.861s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:29:03 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-262166ac-461d-4fda-8a47-81461b27438c tempest-ProjectMemberTests-1570638723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (576c185a-e020-4ed0-9fd7-c8738b2a9e4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28252c4f-3254-474a-a4dc-9047310904e0', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:29:03 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-262166ac-461d-4fda-8a47-81461b27438c tempest-ProjectMemberTests-1570638723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcd20294-20ff-4099-baac-35f6d1c5191e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:29:03 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-262166ac-461d-4fda-8a47-81461b27438c tempest-ProjectMemberTests-1570638723 None] Volume volume-28252c4f-3254-474a-a4dc-9047310904e0 (28252c4f-3254-474a-a4dc-9047310904e0): created successfully Aug 29 01:29:03 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-262166ac-461d-4fda-8a47-81461b27438c tempest-ProjectMemberTests-1570638723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcd20294-20ff-4099-baac-35f6d1c5191e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:29:03 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-262166ac-461d-4fda-8a47-81461b27438c tempest-ProjectMemberTests-1570638723 None] Flow 'volume_create_manager' (76818d61-3dc3-442b-a1f3-d32b745117a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:29:03 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-262166ac-461d-4fda-8a47-81461b27438c tempest-ProjectMemberTests-1570638723 None] Created volume successfully. Aug 29 01:29:03 devstack sudo[105615]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:03 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-84fd8b4f-8a9e-44c8-99e6-a3a7c835920c tempest-ProjectReaderTests-1698516188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-bbc73c0f-7c1c-444b-82b9-057aac301577.0686ed93-bea4-458d-ad44-e883ca85a545" returned: 0 in 0.434s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:03 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-84fd8b4f-8a9e-44c8-99e6-a3a7c835920c tempest-ProjectReaderTests-1698516188 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bbc73c0f-7c1c-444b-82b9-057aac301577(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 29 01:29:03 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[af976696-0145-4ff1-bec4-7f0834b4bb9b]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:29:03 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-84fd8b4f-8a9e-44c8-99e6-a3a7c835920c tempest-ProjectReaderTests-1698516188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-bbc73c0f-7c1c-444b-82b9-057aac301577 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:03 devstack sudo[105623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-bbc73c0f-7c1c-444b-82b9-057aac301577 Aug 29 01:29:03 devstack sudo[105623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:03 devstack sudo[105623]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:03 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-84fd8b4f-8a9e-44c8-99e6-a3a7c835920c tempest-ProjectReaderTests-1698516188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-bbc73c0f-7c1c-444b-82b9-057aac301577" returned: 0 in 0.399s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:03 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-84fd8b4f-8a9e-44c8-99e6-a3a7c835920c tempest-ProjectReaderTests-1698516188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-bbc73c0f-7c1c-444b-82b9-057aac301577.0686ed93-bea4-458d-ad44-e883ca85a545 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:03 devstack sudo[105628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-bbc73c0f-7c1c-444b-82b9-057aac301577.0686ed93-bea4-458d-ad44-e883ca85a545 Aug 29 01:29:03 devstack sudo[105628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:04 devstack sudo[105628]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:04 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-84fd8b4f-8a9e-44c8-99e6-a3a7c835920c tempest-ProjectReaderTests-1698516188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-bbc73c0f-7c1c-444b-82b9-057aac301577.0686ed93-bea4-458d-ad44-e883ca85a545" returned: 0 in 0.351s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:04 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-84fd8b4f-8a9e-44c8-99e6-a3a7c835920c tempest-ProjectReaderTests-1698516188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-bbc73c0f-7c1c-444b-82b9-057aac301577.0686ed93-bea4-458d-ad44-e883ca85a545 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:04 devstack sudo[105635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-bbc73c0f-7c1c-444b-82b9-057aac301577.0686ed93-bea4-458d-ad44-e883ca85a545 Aug 29 01:29:04 devstack sudo[105635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:04 devstack sudo[105635]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:04 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-84fd8b4f-8a9e-44c8-99e6-a3a7c835920c tempest-ProjectReaderTests-1698516188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-bbc73c0f-7c1c-444b-82b9-057aac301577.0686ed93-bea4-458d-ad44-e883ca85a545" returned: 0 in 0.254s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:04 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-84fd8b4f-8a9e-44c8-99e6-a3a7c835920c tempest-ProjectReaderTests-1698516188 None] Lock "cinder-quobyte-0686ed93-bea4-458d-ad44-e883ca85a545" released by "_delete_snapshot" :: held 1.551s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:29:04 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-84fd8b4f-8a9e-44c8-99e6-a3a7c835920c tempest-ProjectReaderTests-1698516188 None] Lock "cinder-quobyte-bbc73c0f-7c1c-444b-82b9-057aac301577" released by "delete_snapshot" :: held 1.585s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:29:04 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-84fd8b4f-8a9e-44c8-99e6-a3a7c835920c tempest-ProjectReaderTests-1698516188 None] Created reservations ['1ae33172-b70b-4dba-ba56-b0063454e9f1', '7763571f-87ad-4be6-b197-ad96f0e92947', '9166c1a6-1be4-459b-a832-1df3cff1b8ea', 'f32d738d-95de-4b09-bc33-cba5b61b46fb'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:29:04 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-717d5a2e-c7ea-4e08-8f31-7567f43e7a54 tempest-ProjectMemberTests-1570638723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:29:04 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-717d5a2e-c7ea-4e08-8f31-7567f43e7a54 tempest-ProjectMemberTests-1570638723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:29:04 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-717d5a2e-c7ea-4e08-8f31-7567f43e7a54 tempest-ProjectMemberTests-1570638723 None] Creating offline snapshot 3872d752-15c1-46c6-9719-808e8c67fc65 of volume 28252c4f-3254-474a-a4dc-9047310904e0 {{(pid=86111) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 29 01:29:04 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb77997b-874f-4017-8b04-34be8da0ed8c]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:29:04 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-717d5a2e-c7ea-4e08-8f31-7567f43e7a54 tempest-ProjectMemberTests-1570638723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-28252c4f-3254-474a-a4dc-9047310904e0 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:04 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-84fd8b4f-8a9e-44c8-99e6-a3a7c835920c tempest-ProjectReaderTests-1698516188 None] Delete snapshot completed successfully. Aug 29 01:29:04 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-84fd8b4f-8a9e-44c8-99e6-a3a7c835920c tempest-ProjectReaderTests-1698516188 None] Lock "cinder-0686ed93-bea4-458d-ad44-e883ca85a545-delete_snapshot" released by "delete_snapshot" :: held 1.875s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:29:04 devstack sudo[105638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-28252c4f-3254-474a-a4dc-9047310904e0 Aug 29 01:29:04 devstack sudo[105638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:05 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-c95be418-9520-4ce0-9d4b-e9f7441f91f3 tempest-ProjectReaderTests-1698516188 None] Acquiring lock "cinder-bbc73c0f-7c1c-444b-82b9-057aac301577-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:29:05 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-c95be418-9520-4ce0-9d4b-e9f7441f91f3 tempest-ProjectReaderTests-1698516188 None] Lock "cinder-bbc73c0f-7c1c-444b-82b9-057aac301577-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:29:05 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-c95be418-9520-4ce0-9d4b-e9f7441f91f3 tempest-ProjectReaderTests-1698516188 None] Acquiring lock "cinder-quobyte-bbc73c0f-7c1c-444b-82b9-057aac301577" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:29:05 devstack sudo[105638]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:05 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-717d5a2e-c7ea-4e08-8f31-7567f43e7a54 tempest-ProjectMemberTests-1570638723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-28252c4f-3254-474a-a4dc-9047310904e0" returned: 0 in 0.424s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:05 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-717d5a2e-c7ea-4e08-8f31-7567f43e7a54 tempest-ProjectMemberTests-1570638723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-28252c4f-3254-474a-a4dc-9047310904e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-28252c4f-3254-474a-a4dc-9047310904e0.3872d752-15c1-46c6-9719-808e8c67fc65 1G {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:05 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-c95be418-9520-4ce0-9d4b-e9f7441f91f3 tempest-ProjectReaderTests-1698516188 None] Lock "cinder-quobyte-bbc73c0f-7c1c-444b-82b9-057aac301577" acquired by "delete_volume" :: waited 0.025s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:29:05 devstack sudo[105643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-28252c4f-3254-474a-a4dc-9047310904e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-28252c4f-3254-474a-a4dc-9047310904e0.3872d752-15c1-46c6-9719-808e8c67fc65 1G Aug 29 01:29:05 devstack sudo[105643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:05 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[539d346f-37d7-4cde-b33d-538e1e01bae6]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:29:05 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c95be418-9520-4ce0-9d4b-e9f7441f91f3 tempest-ProjectReaderTests-1698516188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-bbc73c0f-7c1c-444b-82b9-057aac301577 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:05 devstack sudo[105645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-bbc73c0f-7c1c-444b-82b9-057aac301577 Aug 29 01:29:05 devstack sudo[105645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:05 devstack sudo[105643]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:05 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-717d5a2e-c7ea-4e08-8f31-7567f43e7a54 tempest-ProjectMemberTests-1570638723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-28252c4f-3254-474a-a4dc-9047310904e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-28252c4f-3254-474a-a4dc-9047310904e0.3872d752-15c1-46c6-9719-808e8c67fc65 1G" returned: 0 in 0.435s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:05 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-717d5a2e-c7ea-4e08-8f31-7567f43e7a54 tempest-ProjectMemberTests-1570638723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-28252c4f-3254-474a-a4dc-9047310904e0 -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-28252c4f-3254-474a-a4dc-9047310904e0.3872d752-15c1-46c6-9719-808e8c67fc65 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:05 devstack sudo[105655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-28252c4f-3254-474a-a4dc-9047310904e0 -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-28252c4f-3254-474a-a4dc-9047310904e0.3872d752-15c1-46c6-9719-808e8c67fc65 Aug 29 01:29:05 devstack sudo[105655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:05 devstack sudo[105645]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:05 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c95be418-9520-4ce0-9d4b-e9f7441f91f3 tempest-ProjectReaderTests-1698516188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-bbc73c0f-7c1c-444b-82b9-057aac301577" returned: 0 in 0.421s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:05 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c95be418-9520-4ce0-9d4b-e9f7441f91f3 tempest-ProjectReaderTests-1698516188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-bbc73c0f-7c1c-444b-82b9-057aac301577 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:05 devstack sudo[105657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-bbc73c0f-7c1c-444b-82b9-057aac301577 Aug 29 01:29:05 devstack sudo[105657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:05 devstack sudo[105657]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:05 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c95be418-9520-4ce0-9d4b-e9f7441f91f3 tempest-ProjectReaderTests-1698516188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-bbc73c0f-7c1c-444b-82b9-057aac301577" returned: 0 in 0.260s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:05 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-c95be418-9520-4ce0-9d4b-e9f7441f91f3 tempest-ProjectReaderTests-1698516188 None] Lock "cinder-quobyte-bbc73c0f-7c1c-444b-82b9-057aac301577" released by "delete_volume" :: held 0.756s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:29:05 devstack sudo[105655]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:05 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-717d5a2e-c7ea-4e08-8f31-7567f43e7a54 tempest-ProjectMemberTests-1570638723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-28252c4f-3254-474a-a4dc-9047310904e0 -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-28252c4f-3254-474a-a4dc-9047310904e0.3872d752-15c1-46c6-9719-808e8c67fc65" returned: 0 in 0.341s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:05 devstack cinder-volume[86111]: WARNING cinder.volume.drivers.remotefs [None req-717d5a2e-c7ea-4e08-8f31-7567f43e7a54 tempest-ProjectMemberTests-1570638723 None] /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-28252c4f-3254-474a-a4dc-9047310904e0.3872d752-15c1-46c6-9719-808e8c67fc65 is being set with open permissions: ugo+rw Aug 29 01:29:05 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-717d5a2e-c7ea-4e08-8f31-7567f43e7a54 tempest-ProjectMemberTests-1570638723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-28252c4f-3254-474a-a4dc-9047310904e0.3872d752-15c1-46c6-9719-808e8c67fc65 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:05 devstack sudo[105664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-28252c4f-3254-474a-a4dc-9047310904e0.3872d752-15c1-46c6-9719-808e8c67fc65 Aug 29 01:29:05 devstack sudo[105664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:05 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-c95be418-9520-4ce0-9d4b-e9f7441f91f3 tempest-ProjectReaderTests-1698516188 None] Created reservations ['6245f9f4-94f3-43e1-9420-91ec0ae62e44', 'fc1ead94-c1e4-4b2f-8807-50cd65849e5e', '4cc74af6-8fef-4585-b8a9-c9d1c5fca3d1', '32bab6aa-1d97-4124-9ef5-4d1b51fff0a9'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:29:06 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-c95be418-9520-4ce0-9d4b-e9f7441f91f3 tempest-ProjectReaderTests-1698516188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:29:06 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-c95be418-9520-4ce0-9d4b-e9f7441f91f3 tempest-ProjectReaderTests-1698516188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:29:06 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-c95be418-9520-4ce0-9d4b-e9f7441f91f3 tempest-ProjectReaderTests-1698516188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:29:06 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-c95be418-9520-4ce0-9d4b-e9f7441f91f3 tempest-ProjectReaderTests-1698516188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:29:06 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-c95be418-9520-4ce0-9d4b-e9f7441f91f3 tempest-ProjectReaderTests-1698516188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:29:06 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c95be418-9520-4ce0-9d4b-e9f7441f91f3 tempest-ProjectReaderTests-1698516188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:06 devstack sudo[105666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:29:06 devstack sudo[105666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:06 devstack sudo[105664]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:06 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-717d5a2e-c7ea-4e08-8f31-7567f43e7a54 tempest-ProjectMemberTests-1570638723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-28252c4f-3254-474a-a4dc-9047310904e0.3872d752-15c1-46c6-9719-808e8c67fc65" returned: 0 in 0.296s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:06 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-717d5a2e-c7ea-4e08-8f31-7567f43e7a54 tempest-ProjectMemberTests-1570638723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-28252c4f-3254-474a-a4dc-9047310904e0.info {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:06 devstack sudo[105669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-28252c4f-3254-474a-a4dc-9047310904e0.info Aug 29 01:29:06 devstack sudo[105669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:06 devstack sudo[105666]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:06 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c95be418-9520-4ce0-9d4b-e9f7441f91f3 tempest-ProjectReaderTests-1698516188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.310s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:06 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-c95be418-9520-4ce0-9d4b-e9f7441f91f3 tempest-ProjectReaderTests-1698516188 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:29:06 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-c95be418-9520-4ce0-9d4b-e9f7441f91f3 tempest-ProjectReaderTests-1698516188 None] Deleted volume successfully. Aug 29 01:29:06 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-c95be418-9520-4ce0-9d4b-e9f7441f91f3 tempest-ProjectReaderTests-1698516188 None] Lock "cinder-bbc73c0f-7c1c-444b-82b9-057aac301577-delete_volume" released by "delete_volume" :: held 1.334s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:29:06 devstack sudo[105669]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:06 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-717d5a2e-c7ea-4e08-8f31-7567f43e7a54 tempest-ProjectMemberTests-1570638723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-28252c4f-3254-474a-a4dc-9047310904e0.info" returned: 0 in 0.350s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:06 devstack cinder-volume[86111]: WARNING cinder.volume.drivers.remotefs [None req-717d5a2e-c7ea-4e08-8f31-7567f43e7a54 tempest-ProjectMemberTests-1570638723 None] /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-28252c4f-3254-474a-a4dc-9047310904e0.info is being set with open permissions: ugo+rw Aug 29 01:29:06 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-717d5a2e-c7ea-4e08-8f31-7567f43e7a54 tempest-ProjectMemberTests-1570638723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-28252c4f-3254-474a-a4dc-9047310904e0.info {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:06 devstack sudo[105673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-28252c4f-3254-474a-a4dc-9047310904e0.info Aug 29 01:29:06 devstack sudo[105673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:06 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a1a4e4a-d70c-4966-b51e-78eb00a8e8b9 tempest-ProjectReaderTests-1698516188 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:29:06 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-2a1a4e4a-d70c-4966-b51e-78eb00a8e8b9 tempest-ProjectReaderTests-1698516188 None] Flow 'volume_create_manager' (5635007f-b6a6-4329-9600-207edd86eeed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:29:06 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-2a1a4e4a-d70c-4966-b51e-78eb00a8e8b9 tempest-ProjectReaderTests-1698516188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e50709c-273c-45dc-bcb1-9df17e17c43c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:29:06 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-2a1a4e4a-d70c-4966-b51e-78eb00a8e8b9 tempest-ProjectReaderTests-1698516188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e50709c-273c-45dc-bcb1-9df17e17c43c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:29:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-503737453',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15a296be-9108-4655-b61d-19ecddbb78ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f049b4b9de194d0bb816e863c7740f77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:29:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:29:07Z,use_quota=True,user_id='168ab677c6ef4d8f93d853c32c291481',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:29:06 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-2a1a4e4a-d70c-4966-b51e-78eb00a8e8b9 tempest-ProjectReaderTests-1698516188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99e0383f-6ded-4347-997d-8cac06d2eb2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:29:06 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-2a1a4e4a-d70c-4966-b51e-78eb00a8e8b9 tempest-ProjectReaderTests-1698516188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99e0383f-6ded-4347-997d-8cac06d2eb2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:29:06 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-2a1a4e4a-d70c-4966-b51e-78eb00a8e8b9 tempest-ProjectReaderTests-1698516188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52ee5f58-0f69-42a2-8e45-70a840390115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:29:06 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-2a1a4e4a-d70c-4966-b51e-78eb00a8e8b9 tempest-ProjectReaderTests-1698516188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52ee5f58-0f69-42a2-8e45-70a840390115) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15a296be-9108-4655-b61d-19ecddbb78ae', 'volume_name': 'volume-15a296be-9108-4655-b61d-19ecddbb78ae', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:29:06 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-2a1a4e4a-d70c-4966-b51e-78eb00a8e8b9 tempest-ProjectReaderTests-1698516188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52aed188-1ecb-4f50-ae24-756e85c1f173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:29:06 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-2a1a4e4a-d70c-4966-b51e-78eb00a8e8b9 tempest-ProjectReaderTests-1698516188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52aed188-1ecb-4f50-ae24-756e85c1f173) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:29:06 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-2a1a4e4a-d70c-4966-b51e-78eb00a8e8b9 tempest-ProjectReaderTests-1698516188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fd410ad-9e77-464e-a486-8dc404be6335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:29:06 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-2a1a4e4a-d70c-4966-b51e-78eb00a8e8b9 tempest-ProjectReaderTests-1698516188 None] Volume 15a296be-9108-4655-b61d-19ecddbb78ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15a296be-9108-4655-b61d-19ecddbb78ae', 'volume_size': 1} Aug 29 01:29:06 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-2a1a4e4a-d70c-4966-b51e-78eb00a8e8b9 tempest-ProjectReaderTests-1698516188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:29:06 devstack sudo[105673]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:06 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-717d5a2e-c7ea-4e08-8f31-7567f43e7a54 tempest-ProjectMemberTests-1570638723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-28252c4f-3254-474a-a4dc-9047310904e0.info" returned: 0 in 0.297s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:06 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-717d5a2e-c7ea-4e08-8f31-7567f43e7a54 tempest-ProjectMemberTests-1570638723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.255s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:29:06 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-2a1a4e4a-d70c-4966-b51e-78eb00a8e8b9 tempest-ProjectReaderTests-1698516188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.064s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:29:06 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-2a1a4e4a-d70c-4966-b51e-78eb00a8e8b9 tempest-ProjectReaderTests-1698516188 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:29:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-503737453',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15a296be-9108-4655-b61d-19ecddbb78ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f049b4b9de194d0bb816e863c7740f77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:29:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:29:07Z,use_quota=True,user_id='168ab677c6ef4d8f93d853c32c291481',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:29:06 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-2a1a4e4a-d70c-4966-b51e-78eb00a8e8b9 tempest-ProjectReaderTests-1698516188 None] Creating volume 15a296be-9108-4655-b61d-19ecddbb78ae {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:29:06 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-2a1a4e4a-d70c-4966-b51e-78eb00a8e8b9 tempest-ProjectReaderTests-1698516188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:29:06 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-2a1a4e4a-d70c-4966-b51e-78eb00a8e8b9 tempest-ProjectReaderTests-1698516188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:29:06 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-2a1a4e4a-d70c-4966-b51e-78eb00a8e8b9 tempest-ProjectReaderTests-1698516188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:29:06 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-2a1a4e4a-d70c-4966-b51e-78eb00a8e8b9 tempest-ProjectReaderTests-1698516188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:29:06 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-2a1a4e4a-d70c-4966-b51e-78eb00a8e8b9 tempest-ProjectReaderTests-1698516188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:29:06 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-2a1a4e4a-d70c-4966-b51e-78eb00a8e8b9 tempest-ProjectReaderTests-1698516188 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:29:06 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-2a1a4e4a-d70c-4966-b51e-78eb00a8e8b9 tempest-ProjectReaderTests-1698516188 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:29:06 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-2a1a4e4a-d70c-4966-b51e-78eb00a8e8b9 tempest-ProjectReaderTests-1698516188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-15a296be-9108-4655-b61d-19ecddbb78ae 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:06 devstack sudo[105676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-15a296be-9108-4655-b61d-19ecddbb78ae 1073741824 Aug 29 01:29:06 devstack sudo[105676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:06 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-717d5a2e-c7ea-4e08-8f31-7567f43e7a54 tempest-ProjectMemberTests-1570638723 None] Create snapshot completed successfully Aug 29 01:29:07 devstack sudo[105676]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:07 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-2a1a4e4a-d70c-4966-b51e-78eb00a8e8b9 tempest-ProjectReaderTests-1698516188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-15a296be-9108-4655-b61d-19ecddbb78ae 1073741824" returned: 0 in 0.436s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:07 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-2a1a4e4a-d70c-4966-b51e-78eb00a8e8b9 tempest-ProjectReaderTests-1698516188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-15a296be-9108-4655-b61d-19ecddbb78ae {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:07 devstack sudo[105682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-15a296be-9108-4655-b61d-19ecddbb78ae Aug 29 01:29:07 devstack sudo[105682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:07 devstack sudo[105682]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:07 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-2a1a4e4a-d70c-4966-b51e-78eb00a8e8b9 tempest-ProjectReaderTests-1698516188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-15a296be-9108-4655-b61d-19ecddbb78ae" returned: 0 in 0.305s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:07 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-2a1a4e4a-d70c-4966-b51e-78eb00a8e8b9 tempest-ProjectReaderTests-1698516188 None] <== create_volume: return (804ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:29:07 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-2a1a4e4a-d70c-4966-b51e-78eb00a8e8b9 tempest-ProjectReaderTests-1698516188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.810s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:29:07 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-2a1a4e4a-d70c-4966-b51e-78eb00a8e8b9 tempest-ProjectReaderTests-1698516188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fd410ad-9e77-464e-a486-8dc404be6335) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15a296be-9108-4655-b61d-19ecddbb78ae', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:29:07 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-2a1a4e4a-d70c-4966-b51e-78eb00a8e8b9 tempest-ProjectReaderTests-1698516188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a7519f7-547a-42ef-bbc9-0a5f8b15acdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:29:07 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-2a1a4e4a-d70c-4966-b51e-78eb00a8e8b9 tempest-ProjectReaderTests-1698516188 None] Volume volume-15a296be-9108-4655-b61d-19ecddbb78ae (15a296be-9108-4655-b61d-19ecddbb78ae): created successfully Aug 29 01:29:07 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-2a1a4e4a-d70c-4966-b51e-78eb00a8e8b9 tempest-ProjectReaderTests-1698516188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a7519f7-547a-42ef-bbc9-0a5f8b15acdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:29:07 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-2a1a4e4a-d70c-4966-b51e-78eb00a8e8b9 tempest-ProjectReaderTests-1698516188 None] Flow 'volume_create_manager' (5635007f-b6a6-4329-9600-207edd86eeed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:29:07 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-2a1a4e4a-d70c-4966-b51e-78eb00a8e8b9 tempest-ProjectReaderTests-1698516188 None] Created volume successfully. Aug 29 01:29:07 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-06892fca-1ece-4fa5-82f2-027aa25c350f tempest-ProjectMemberTests-1570638723 None] Acquiring lock "cinder-3872d752-15c1-46c6-9719-808e8c67fc65-delete_snapshot" by "delete_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:29:07 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-06892fca-1ece-4fa5-82f2-027aa25c350f tempest-ProjectMemberTests-1570638723 None] Lock "cinder-3872d752-15c1-46c6-9719-808e8c67fc65-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:29:07 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-06892fca-1ece-4fa5-82f2-027aa25c350f tempest-ProjectMemberTests-1570638723 None] Acquiring lock "cinder-quobyte-28252c4f-3254-474a-a4dc-9047310904e0" by "delete_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:29:07 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-06892fca-1ece-4fa5-82f2-027aa25c350f tempest-ProjectMemberTests-1570638723 None] Lock "cinder-quobyte-28252c4f-3254-474a-a4dc-9047310904e0" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:29:07 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-06892fca-1ece-4fa5-82f2-027aa25c350f tempest-ProjectMemberTests-1570638723 None] Acquiring lock "cinder-quobyte-3872d752-15c1-46c6-9719-808e8c67fc65" by "_delete_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:29:07 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-06892fca-1ece-4fa5-82f2-027aa25c350f tempest-ProjectMemberTests-1570638723 None] Lock "cinder-quobyte-3872d752-15c1-46c6-9719-808e8c67fc65" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:29:07 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-06892fca-1ece-4fa5-82f2-027aa25c350f tempest-ProjectMemberTests-1570638723 None] Deleting offline snapshot 3872d752-15c1-46c6-9719-808e8c67fc65 of volume 28252c4f-3254-474a-a4dc-9047310904e0 {{(pid=86111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 29 01:29:07 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-06892fca-1ece-4fa5-82f2-027aa25c350f tempest-ProjectMemberTests-1570638723 None] snapshot_file for this snap is: volume-28252c4f-3254-474a-a4dc-9047310904e0.3872d752-15c1-46c6-9719-808e8c67fc65 {{(pid=86111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 29 01:29:08 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d687f36-a53b-4541-af44-51496fa59f6f]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:29:08 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-06892fca-1ece-4fa5-82f2-027aa25c350f tempest-ProjectMemberTests-1570638723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-28252c4f-3254-474a-a4dc-9047310904e0.3872d752-15c1-46c6-9719-808e8c67fc65 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:08 devstack sudo[105685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-28252c4f-3254-474a-a4dc-9047310904e0.3872d752-15c1-46c6-9719-808e8c67fc65 Aug 29 01:29:08 devstack sudo[105685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:08 devstack sudo[105685]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:08 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-06892fca-1ece-4fa5-82f2-027aa25c350f tempest-ProjectMemberTests-1570638723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-28252c4f-3254-474a-a4dc-9047310904e0.3872d752-15c1-46c6-9719-808e8c67fc65" returned: 0 in 0.377s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:08 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-06892fca-1ece-4fa5-82f2-027aa25c350f tempest-ProjectMemberTests-1570638723 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-28252c4f-3254-474a-a4dc-9047310904e0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 29 01:29:08 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e163cfc-0396-47c1-abbc-11fbb5128954]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:29:08 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-06892fca-1ece-4fa5-82f2-027aa25c350f tempest-ProjectMemberTests-1570638723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-28252c4f-3254-474a-a4dc-9047310904e0 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:08 devstack sudo[105690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-28252c4f-3254-474a-a4dc-9047310904e0 Aug 29 01:29:08 devstack sudo[105690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:08 devstack sudo[105690]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:08 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-06892fca-1ece-4fa5-82f2-027aa25c350f tempest-ProjectMemberTests-1570638723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-28252c4f-3254-474a-a4dc-9047310904e0" returned: 0 in 0.374s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:08 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-06892fca-1ece-4fa5-82f2-027aa25c350f tempest-ProjectMemberTests-1570638723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-28252c4f-3254-474a-a4dc-9047310904e0.3872d752-15c1-46c6-9719-808e8c67fc65 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:08 devstack sudo[105695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-28252c4f-3254-474a-a4dc-9047310904e0.3872d752-15c1-46c6-9719-808e8c67fc65 Aug 29 01:29:08 devstack sudo[105695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:09 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-366e9728-3eb3-4c9c-9295-729e4d3e0a48 tempest-ProjectReaderTests-1698516188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:29:09 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-366e9728-3eb3-4c9c-9295-729e4d3e0a48 tempest-ProjectReaderTests-1698516188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:29:09 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-366e9728-3eb3-4c9c-9295-729e4d3e0a48 tempest-ProjectReaderTests-1698516188 None] Creating offline snapshot 3e181837-4b87-4d1e-9c69-40444ceff38e of volume 15a296be-9108-4655-b61d-19ecddbb78ae {{(pid=86111) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 29 01:29:09 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb9127a0-d648-4305-aa9b-0330493a43fc]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:29:09 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-366e9728-3eb3-4c9c-9295-729e4d3e0a48 tempest-ProjectReaderTests-1698516188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-15a296be-9108-4655-b61d-19ecddbb78ae {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:09 devstack sudo[105695]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:09 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-06892fca-1ece-4fa5-82f2-027aa25c350f tempest-ProjectMemberTests-1570638723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-28252c4f-3254-474a-a4dc-9047310904e0.3872d752-15c1-46c6-9719-808e8c67fc65" returned: 0 in 0.440s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:09 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-06892fca-1ece-4fa5-82f2-027aa25c350f tempest-ProjectMemberTests-1570638723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-28252c4f-3254-474a-a4dc-9047310904e0.3872d752-15c1-46c6-9719-808e8c67fc65 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:09 devstack sudo[105700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-15a296be-9108-4655-b61d-19ecddbb78ae Aug 29 01:29:09 devstack sudo[105700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:09 devstack sudo[105702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-28252c4f-3254-474a-a4dc-9047310904e0.3872d752-15c1-46c6-9719-808e8c67fc65 Aug 29 01:29:09 devstack sudo[105702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:09 devstack sudo[105702]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:09 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-06892fca-1ece-4fa5-82f2-027aa25c350f tempest-ProjectMemberTests-1570638723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-28252c4f-3254-474a-a4dc-9047310904e0.3872d752-15c1-46c6-9719-808e8c67fc65" returned: 0 in 0.267s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:09 devstack sudo[105700]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:09 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-366e9728-3eb3-4c9c-9295-729e4d3e0a48 tempest-ProjectReaderTests-1698516188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-15a296be-9108-4655-b61d-19ecddbb78ae" returned: 0 in 0.418s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:09 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-366e9728-3eb3-4c9c-9295-729e4d3e0a48 tempest-ProjectReaderTests-1698516188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-15a296be-9108-4655-b61d-19ecddbb78ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-15a296be-9108-4655-b61d-19ecddbb78ae.3e181837-4b87-4d1e-9c69-40444ceff38e 1G {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:09 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-06892fca-1ece-4fa5-82f2-027aa25c350f tempest-ProjectMemberTests-1570638723 None] Lock "cinder-quobyte-3872d752-15c1-46c6-9719-808e8c67fc65" released by "_delete_snapshot" :: held 1.593s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:29:09 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-06892fca-1ece-4fa5-82f2-027aa25c350f tempest-ProjectMemberTests-1570638723 None] Lock "cinder-quobyte-28252c4f-3254-474a-a4dc-9047310904e0" released by "delete_snapshot" :: held 1.634s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:29:09 devstack sudo[105709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-15a296be-9108-4655-b61d-19ecddbb78ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-15a296be-9108-4655-b61d-19ecddbb78ae.3e181837-4b87-4d1e-9c69-40444ceff38e 1G Aug 29 01:29:09 devstack sudo[105709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:09 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-06892fca-1ece-4fa5-82f2-027aa25c350f tempest-ProjectMemberTests-1570638723 None] Created reservations ['2e0ab786-578f-4767-9c64-d506eadd7a58', '0f760516-4def-49a9-a722-a3fb0627c4e0', 'b522ad98-918e-4bc9-8c90-d7d733087b65', '53c88972-d074-4f7d-8c87-a2664577bbcb'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:29:09 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-06892fca-1ece-4fa5-82f2-027aa25c350f tempest-ProjectMemberTests-1570638723 None] Delete snapshot completed successfully. Aug 29 01:29:09 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-06892fca-1ece-4fa5-82f2-027aa25c350f tempest-ProjectMemberTests-1570638723 None] Lock "cinder-3872d752-15c1-46c6-9719-808e8c67fc65-delete_snapshot" released by "delete_snapshot" :: held 1.821s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:29:10 devstack sudo[105709]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:10 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-366e9728-3eb3-4c9c-9295-729e4d3e0a48 tempest-ProjectReaderTests-1698516188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-15a296be-9108-4655-b61d-19ecddbb78ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-15a296be-9108-4655-b61d-19ecddbb78ae.3e181837-4b87-4d1e-9c69-40444ceff38e 1G" returned: 0 in 0.509s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:10 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-366e9728-3eb3-4c9c-9295-729e4d3e0a48 tempest-ProjectReaderTests-1698516188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15a296be-9108-4655-b61d-19ecddbb78ae -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-15a296be-9108-4655-b61d-19ecddbb78ae.3e181837-4b87-4d1e-9c69-40444ceff38e {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:10 devstack sudo[105715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15a296be-9108-4655-b61d-19ecddbb78ae -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-15a296be-9108-4655-b61d-19ecddbb78ae.3e181837-4b87-4d1e-9c69-40444ceff38e Aug 29 01:29:10 devstack sudo[105715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:10 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-facef1e8-c4eb-4b30-a3b5-29581f8d1891 tempest-ProjectMemberTests-1570638723 None] Acquiring lock "cinder-28252c4f-3254-474a-a4dc-9047310904e0-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:29:10 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-facef1e8-c4eb-4b30-a3b5-29581f8d1891 tempest-ProjectMemberTests-1570638723 None] Lock "cinder-28252c4f-3254-474a-a4dc-9047310904e0-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:29:10 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-facef1e8-c4eb-4b30-a3b5-29581f8d1891 tempest-ProjectMemberTests-1570638723 None] Acquiring lock "cinder-quobyte-28252c4f-3254-474a-a4dc-9047310904e0" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:29:10 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-facef1e8-c4eb-4b30-a3b5-29581f8d1891 tempest-ProjectMemberTests-1570638723 None] Lock "cinder-quobyte-28252c4f-3254-474a-a4dc-9047310904e0" acquired by "delete_volume" :: waited 0.018s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:29:10 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a28e170-e6b4-4c26-9aca-81ecef1e7047]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:29:10 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-facef1e8-c4eb-4b30-a3b5-29581f8d1891 tempest-ProjectMemberTests-1570638723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-28252c4f-3254-474a-a4dc-9047310904e0 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:10 devstack sudo[105717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-28252c4f-3254-474a-a4dc-9047310904e0 Aug 29 01:29:10 devstack sudo[105717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:10 devstack sudo[105715]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:10 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-366e9728-3eb3-4c9c-9295-729e4d3e0a48 tempest-ProjectReaderTests-1698516188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15a296be-9108-4655-b61d-19ecddbb78ae -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-15a296be-9108-4655-b61d-19ecddbb78ae.3e181837-4b87-4d1e-9c69-40444ceff38e" returned: 0 in 0.358s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:10 devstack cinder-volume[86111]: WARNING cinder.volume.drivers.remotefs [None req-366e9728-3eb3-4c9c-9295-729e4d3e0a48 tempest-ProjectReaderTests-1698516188 None] /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-15a296be-9108-4655-b61d-19ecddbb78ae.3e181837-4b87-4d1e-9c69-40444ceff38e is being set with open permissions: ugo+rw Aug 29 01:29:10 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-366e9728-3eb3-4c9c-9295-729e4d3e0a48 tempest-ProjectReaderTests-1698516188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-15a296be-9108-4655-b61d-19ecddbb78ae.3e181837-4b87-4d1e-9c69-40444ceff38e {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:10 devstack sudo[105722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-15a296be-9108-4655-b61d-19ecddbb78ae.3e181837-4b87-4d1e-9c69-40444ceff38e Aug 29 01:29:10 devstack sudo[105722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:10 devstack sudo[105717]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:10 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-facef1e8-c4eb-4b30-a3b5-29581f8d1891 tempest-ProjectMemberTests-1570638723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-28252c4f-3254-474a-a4dc-9047310904e0" returned: 0 in 0.418s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:10 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-facef1e8-c4eb-4b30-a3b5-29581f8d1891 tempest-ProjectMemberTests-1570638723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-28252c4f-3254-474a-a4dc-9047310904e0 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:10 devstack sudo[105722]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:10 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-366e9728-3eb3-4c9c-9295-729e4d3e0a48 tempest-ProjectReaderTests-1698516188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-15a296be-9108-4655-b61d-19ecddbb78ae.3e181837-4b87-4d1e-9c69-40444ceff38e" returned: 0 in 0.293s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:10 devstack sudo[105728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-28252c4f-3254-474a-a4dc-9047310904e0 Aug 29 01:29:10 devstack sudo[105728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:10 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-366e9728-3eb3-4c9c-9295-729e4d3e0a48 tempest-ProjectReaderTests-1698516188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-15a296be-9108-4655-b61d-19ecddbb78ae.info {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:10 devstack sudo[105730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-15a296be-9108-4655-b61d-19ecddbb78ae.info Aug 29 01:29:10 devstack sudo[105730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:10 devstack sudo[105728]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:10 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-facef1e8-c4eb-4b30-a3b5-29581f8d1891 tempest-ProjectMemberTests-1570638723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-28252c4f-3254-474a-a4dc-9047310904e0" returned: 0 in 0.268s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:10 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-facef1e8-c4eb-4b30-a3b5-29581f8d1891 tempest-ProjectMemberTests-1570638723 None] Lock "cinder-quobyte-28252c4f-3254-474a-a4dc-9047310904e0" released by "delete_volume" :: held 0.769s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:29:11 devstack sudo[105730]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:11 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-366e9728-3eb3-4c9c-9295-729e4d3e0a48 tempest-ProjectReaderTests-1698516188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-15a296be-9108-4655-b61d-19ecddbb78ae.info" returned: 0 in 0.293s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:11 devstack cinder-volume[86111]: WARNING cinder.volume.drivers.remotefs [None req-366e9728-3eb3-4c9c-9295-729e4d3e0a48 tempest-ProjectReaderTests-1698516188 None] /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-15a296be-9108-4655-b61d-19ecddbb78ae.info is being set with open permissions: ugo+rw Aug 29 01:29:11 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-366e9728-3eb3-4c9c-9295-729e4d3e0a48 tempest-ProjectReaderTests-1698516188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-15a296be-9108-4655-b61d-19ecddbb78ae.info {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:11 devstack sudo[105734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-15a296be-9108-4655-b61d-19ecddbb78ae.info Aug 29 01:29:11 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-facef1e8-c4eb-4b30-a3b5-29581f8d1891 tempest-ProjectMemberTests-1570638723 None] Created reservations ['b5180cad-0e98-4caf-9193-4902c1dc3ec7', 'c4c59957-e212-496e-a43c-1702122cec31', '57992a30-96c6-481c-8939-c4046c291aef', 'aba6b75a-4ee6-4339-a2b6-48cdae3fd597'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:29:11 devstack sudo[105734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:11 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-facef1e8-c4eb-4b30-a3b5-29581f8d1891 tempest-ProjectMemberTests-1570638723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:29:11 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-facef1e8-c4eb-4b30-a3b5-29581f8d1891 tempest-ProjectMemberTests-1570638723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:29:11 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-facef1e8-c4eb-4b30-a3b5-29581f8d1891 tempest-ProjectMemberTests-1570638723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:29:11 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-facef1e8-c4eb-4b30-a3b5-29581f8d1891 tempest-ProjectMemberTests-1570638723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:29:11 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-facef1e8-c4eb-4b30-a3b5-29581f8d1891 tempest-ProjectMemberTests-1570638723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:29:11 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-facef1e8-c4eb-4b30-a3b5-29581f8d1891 tempest-ProjectMemberTests-1570638723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:11 devstack sudo[105736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:29:11 devstack sudo[105736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:11 devstack sudo[105734]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:11 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-366e9728-3eb3-4c9c-9295-729e4d3e0a48 tempest-ProjectReaderTests-1698516188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-15a296be-9108-4655-b61d-19ecddbb78ae.info" returned: 0 in 0.293s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:11 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-366e9728-3eb3-4c9c-9295-729e4d3e0a48 tempest-ProjectReaderTests-1698516188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.271s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:29:11 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-366e9728-3eb3-4c9c-9295-729e4d3e0a48 tempest-ProjectReaderTests-1698516188 None] Create snapshot completed successfully Aug 29 01:29:11 devstack sudo[105736]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:11 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-facef1e8-c4eb-4b30-a3b5-29581f8d1891 tempest-ProjectMemberTests-1570638723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.292s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:11 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-facef1e8-c4eb-4b30-a3b5-29581f8d1891 tempest-ProjectMemberTests-1570638723 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:29:11 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-facef1e8-c4eb-4b30-a3b5-29581f8d1891 tempest-ProjectMemberTests-1570638723 None] Deleted volume successfully. Aug 29 01:29:11 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-facef1e8-c4eb-4b30-a3b5-29581f8d1891 tempest-ProjectMemberTests-1570638723 None] Lock "cinder-28252c4f-3254-474a-a4dc-9047310904e0-delete_volume" released by "delete_volume" :: held 1.340s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:29:11 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-b979e772-9ea0-4e3f-b4c7-982b526a8df2 tempest-ProjectMemberTests-1570638723 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:29:11 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-b979e772-9ea0-4e3f-b4c7-982b526a8df2 tempest-ProjectMemberTests-1570638723 None] Flow 'volume_create_manager' (29729fda-6d43-42f3-81c9-bb472977e198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:29:11 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-b979e772-9ea0-4e3f-b4c7-982b526a8df2 tempest-ProjectMemberTests-1570638723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4782476a-78ee-4f85-b705-ef74abf0583c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:29:11 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-b979e772-9ea0-4e3f-b4c7-982b526a8df2 tempest-ProjectMemberTests-1570638723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4782476a-78ee-4f85-b705-ef74abf0583c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:29:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1511368700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5db6ae99-4ae5-4c44-9c1d-d486d02bb330,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc3e18b86dee456398aada5b169dc198',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:29:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:29:12Z,use_quota=True,user_id='ea18f1190bab494589a803742a7eb22a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:29:11 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-b979e772-9ea0-4e3f-b4c7-982b526a8df2 tempest-ProjectMemberTests-1570638723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d66f466-4dc3-40f2-8085-bae76ea13ce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:29:11 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-b979e772-9ea0-4e3f-b4c7-982b526a8df2 tempest-ProjectMemberTests-1570638723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d66f466-4dc3-40f2-8085-bae76ea13ce0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:29:11 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-b979e772-9ea0-4e3f-b4c7-982b526a8df2 tempest-ProjectMemberTests-1570638723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0323a95-400e-41bd-8b26-c579e68371ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:29:11 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-b979e772-9ea0-4e3f-b4c7-982b526a8df2 tempest-ProjectMemberTests-1570638723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0323a95-400e-41bd-8b26-c579e68371ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5db6ae99-4ae5-4c44-9c1d-d486d02bb330', 'volume_name': 'volume-5db6ae99-4ae5-4c44-9c1d-d486d02bb330', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:29:11 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-b979e772-9ea0-4e3f-b4c7-982b526a8df2 tempest-ProjectMemberTests-1570638723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bbeafdc-f838-476c-908d-e061a56a77bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:29:11 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-b979e772-9ea0-4e3f-b4c7-982b526a8df2 tempest-ProjectMemberTests-1570638723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bbeafdc-f838-476c-908d-e061a56a77bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:29:11 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-b979e772-9ea0-4e3f-b4c7-982b526a8df2 tempest-ProjectMemberTests-1570638723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f133554a-e344-4194-b34f-3da7ca10eb83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:29:11 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-b979e772-9ea0-4e3f-b4c7-982b526a8df2 tempest-ProjectMemberTests-1570638723 None] Volume 5db6ae99-4ae5-4c44-9c1d-d486d02bb330: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5db6ae99-4ae5-4c44-9c1d-d486d02bb330', 'volume_size': 1} Aug 29 01:29:11 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-b979e772-9ea0-4e3f-b4c7-982b526a8df2 tempest-ProjectMemberTests-1570638723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:29:11 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-b979e772-9ea0-4e3f-b4c7-982b526a8df2 tempest-ProjectMemberTests-1570638723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:29:11 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-b979e772-9ea0-4e3f-b4c7-982b526a8df2 tempest-ProjectMemberTests-1570638723 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:29:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1511368700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5db6ae99-4ae5-4c44-9c1d-d486d02bb330,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc3e18b86dee456398aada5b169dc198',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:29:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:29:12Z,use_quota=True,user_id='ea18f1190bab494589a803742a7eb22a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:29:11 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-b979e772-9ea0-4e3f-b4c7-982b526a8df2 tempest-ProjectMemberTests-1570638723 None] Creating volume 5db6ae99-4ae5-4c44-9c1d-d486d02bb330 {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:29:11 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-b979e772-9ea0-4e3f-b4c7-982b526a8df2 tempest-ProjectMemberTests-1570638723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:29:11 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-b979e772-9ea0-4e3f-b4c7-982b526a8df2 tempest-ProjectMemberTests-1570638723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:29:11 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-b979e772-9ea0-4e3f-b4c7-982b526a8df2 tempest-ProjectMemberTests-1570638723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:29:11 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-b979e772-9ea0-4e3f-b4c7-982b526a8df2 tempest-ProjectMemberTests-1570638723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:29:11 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-b979e772-9ea0-4e3f-b4c7-982b526a8df2 tempest-ProjectMemberTests-1570638723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:29:11 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-b979e772-9ea0-4e3f-b4c7-982b526a8df2 tempest-ProjectMemberTests-1570638723 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:29:11 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-b979e772-9ea0-4e3f-b4c7-982b526a8df2 tempest-ProjectMemberTests-1570638723 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:29:11 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-b979e772-9ea0-4e3f-b4c7-982b526a8df2 tempest-ProjectMemberTests-1570638723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-5db6ae99-4ae5-4c44-9c1d-d486d02bb330 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:11 devstack sudo[105740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-5db6ae99-4ae5-4c44-9c1d-d486d02bb330 1073741824 Aug 29 01:29:11 devstack sudo[105740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:12 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-76f9950f-2f4d-47df-ba2e-f3aade4dccd0 tempest-ProjectReaderTests-1698516188 None] Acquiring lock "cinder-3e181837-4b87-4d1e-9c69-40444ceff38e-delete_snapshot" by "delete_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:29:12 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-76f9950f-2f4d-47df-ba2e-f3aade4dccd0 tempest-ProjectReaderTests-1698516188 None] Lock "cinder-3e181837-4b87-4d1e-9c69-40444ceff38e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:29:12 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-76f9950f-2f4d-47df-ba2e-f3aade4dccd0 tempest-ProjectReaderTests-1698516188 None] Acquiring lock "cinder-quobyte-15a296be-9108-4655-b61d-19ecddbb78ae" by "delete_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:29:12 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-76f9950f-2f4d-47df-ba2e-f3aade4dccd0 tempest-ProjectReaderTests-1698516188 None] Lock "cinder-quobyte-15a296be-9108-4655-b61d-19ecddbb78ae" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:29:12 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-76f9950f-2f4d-47df-ba2e-f3aade4dccd0 tempest-ProjectReaderTests-1698516188 None] Acquiring lock "cinder-quobyte-3e181837-4b87-4d1e-9c69-40444ceff38e" by "_delete_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:29:12 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-76f9950f-2f4d-47df-ba2e-f3aade4dccd0 tempest-ProjectReaderTests-1698516188 None] Lock "cinder-quobyte-3e181837-4b87-4d1e-9c69-40444ceff38e" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:29:12 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-76f9950f-2f4d-47df-ba2e-f3aade4dccd0 tempest-ProjectReaderTests-1698516188 None] Deleting offline snapshot 3e181837-4b87-4d1e-9c69-40444ceff38e of volume 15a296be-9108-4655-b61d-19ecddbb78ae {{(pid=86111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 29 01:29:12 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-76f9950f-2f4d-47df-ba2e-f3aade4dccd0 tempest-ProjectReaderTests-1698516188 None] snapshot_file for this snap is: volume-15a296be-9108-4655-b61d-19ecddbb78ae.3e181837-4b87-4d1e-9c69-40444ceff38e {{(pid=86111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 29 01:29:12 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[2603706f-3edf-434a-a00c-f8e0dbd7801d]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:29:12 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-76f9950f-2f4d-47df-ba2e-f3aade4dccd0 tempest-ProjectReaderTests-1698516188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-15a296be-9108-4655-b61d-19ecddbb78ae.3e181837-4b87-4d1e-9c69-40444ceff38e {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:12 devstack sudo[105740]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:12 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-b979e772-9ea0-4e3f-b4c7-982b526a8df2 tempest-ProjectMemberTests-1570638723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-5db6ae99-4ae5-4c44-9c1d-d486d02bb330 1073741824" returned: 0 in 0.536s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:12 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-b979e772-9ea0-4e3f-b4c7-982b526a8df2 tempest-ProjectMemberTests-1570638723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-5db6ae99-4ae5-4c44-9c1d-d486d02bb330 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:12 devstack sudo[105745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-15a296be-9108-4655-b61d-19ecddbb78ae.3e181837-4b87-4d1e-9c69-40444ceff38e Aug 29 01:29:12 devstack sudo[105745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:12 devstack sudo[105746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-5db6ae99-4ae5-4c44-9c1d-d486d02bb330 Aug 29 01:29:12 devstack sudo[105746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:12 devstack sudo[105746]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:12 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-b979e772-9ea0-4e3f-b4c7-982b526a8df2 tempest-ProjectMemberTests-1570638723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-5db6ae99-4ae5-4c44-9c1d-d486d02bb330" returned: 0 in 0.313s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:12 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-b979e772-9ea0-4e3f-b4c7-982b526a8df2 tempest-ProjectMemberTests-1570638723 None] <== create_volume: return (903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:29:12 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-b979e772-9ea0-4e3f-b4c7-982b526a8df2 tempest-ProjectMemberTests-1570638723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:29:12 devstack sudo[105745]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:12 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-b979e772-9ea0-4e3f-b4c7-982b526a8df2 tempest-ProjectMemberTests-1570638723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f133554a-e344-4194-b34f-3da7ca10eb83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5db6ae99-4ae5-4c44-9c1d-d486d02bb330', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:29:12 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-b979e772-9ea0-4e3f-b4c7-982b526a8df2 tempest-ProjectMemberTests-1570638723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d097371-d05b-4241-a02f-24c2c2442d58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:29:12 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-76f9950f-2f4d-47df-ba2e-f3aade4dccd0 tempest-ProjectReaderTests-1698516188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-15a296be-9108-4655-b61d-19ecddbb78ae.3e181837-4b87-4d1e-9c69-40444ceff38e" returned: 0 in 0.461s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:12 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-76f9950f-2f4d-47df-ba2e-f3aade4dccd0 tempest-ProjectReaderTests-1698516188 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-15a296be-9108-4655-b61d-19ecddbb78ae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 29 01:29:12 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-b979e772-9ea0-4e3f-b4c7-982b526a8df2 tempest-ProjectMemberTests-1570638723 None] Volume volume-5db6ae99-4ae5-4c44-9c1d-d486d02bb330 (5db6ae99-4ae5-4c44-9c1d-d486d02bb330): created successfully Aug 29 01:29:12 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-b979e772-9ea0-4e3f-b4c7-982b526a8df2 tempest-ProjectMemberTests-1570638723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d097371-d05b-4241-a02f-24c2c2442d58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:29:12 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-b979e772-9ea0-4e3f-b4c7-982b526a8df2 tempest-ProjectMemberTests-1570638723 None] Flow 'volume_create_manager' (29729fda-6d43-42f3-81c9-bb472977e198) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:29:12 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0182409-e1b6-433b-b9fe-b9d5c304637b]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:29:12 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-76f9950f-2f4d-47df-ba2e-f3aade4dccd0 tempest-ProjectReaderTests-1698516188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-15a296be-9108-4655-b61d-19ecddbb78ae {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:12 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-b979e772-9ea0-4e3f-b4c7-982b526a8df2 tempest-ProjectMemberTests-1570638723 None] Created volume successfully. Aug 29 01:29:13 devstack sudo[105753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-15a296be-9108-4655-b61d-19ecddbb78ae Aug 29 01:29:13 devstack sudo[105753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:13 devstack sudo[105753]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:13 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-76f9950f-2f4d-47df-ba2e-f3aade4dccd0 tempest-ProjectReaderTests-1698516188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-15a296be-9108-4655-b61d-19ecddbb78ae" returned: 0 in 0.383s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:13 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-76f9950f-2f4d-47df-ba2e-f3aade4dccd0 tempest-ProjectReaderTests-1698516188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-15a296be-9108-4655-b61d-19ecddbb78ae.3e181837-4b87-4d1e-9c69-40444ceff38e {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:13 devstack sudo[105758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-15a296be-9108-4655-b61d-19ecddbb78ae.3e181837-4b87-4d1e-9c69-40444ceff38e Aug 29 01:29:13 devstack sudo[105758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:13 devstack sudo[105758]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:13 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-76f9950f-2f4d-47df-ba2e-f3aade4dccd0 tempest-ProjectReaderTests-1698516188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-15a296be-9108-4655-b61d-19ecddbb78ae.3e181837-4b87-4d1e-9c69-40444ceff38e" returned: 0 in 0.336s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:13 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-76f9950f-2f4d-47df-ba2e-f3aade4dccd0 tempest-ProjectReaderTests-1698516188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-15a296be-9108-4655-b61d-19ecddbb78ae.3e181837-4b87-4d1e-9c69-40444ceff38e {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:13 devstack sudo[105763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-15a296be-9108-4655-b61d-19ecddbb78ae.3e181837-4b87-4d1e-9c69-40444ceff38e Aug 29 01:29:13 devstack sudo[105763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:13 devstack sudo[105763]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:13 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-76f9950f-2f4d-47df-ba2e-f3aade4dccd0 tempest-ProjectReaderTests-1698516188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-15a296be-9108-4655-b61d-19ecddbb78ae.3e181837-4b87-4d1e-9c69-40444ceff38e" returned: 0 in 0.318s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:13 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-76f9950f-2f4d-47df-ba2e-f3aade4dccd0 tempest-ProjectReaderTests-1698516188 None] Lock "cinder-quobyte-3e181837-4b87-4d1e-9c69-40444ceff38e" released by "_delete_snapshot" :: held 1.607s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:29:13 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-76f9950f-2f4d-47df-ba2e-f3aade4dccd0 tempest-ProjectReaderTests-1698516188 None] Lock "cinder-quobyte-15a296be-9108-4655-b61d-19ecddbb78ae" released by "delete_snapshot" :: held 1.636s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:29:14 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-76f9950f-2f4d-47df-ba2e-f3aade4dccd0 tempest-ProjectReaderTests-1698516188 None] Created reservations ['e4f392c0-3bff-49e8-afff-aa5dc1f8cd3c', 'e44bd68c-d9cb-47f0-8bd8-456ced0ad374', 'e3d0e643-a177-4bc6-a6f4-c3cba13b65de', '938c3466-45f3-49f0-bf9a-06bd9dea3543'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:29:14 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-76f9950f-2f4d-47df-ba2e-f3aade4dccd0 tempest-ProjectReaderTests-1698516188 None] Delete snapshot completed successfully. Aug 29 01:29:14 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-76f9950f-2f4d-47df-ba2e-f3aade4dccd0 tempest-ProjectReaderTests-1698516188 None] Lock "cinder-3e181837-4b87-4d1e-9c69-40444ceff38e-delete_snapshot" released by "delete_snapshot" :: held 1.847s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:29:14 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-a015c961-2850-4e1b-848b-e47c6ffc25b1 tempest-ProjectMemberTests-1570638723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:29:14 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-a015c961-2850-4e1b-848b-e47c6ffc25b1 tempest-ProjectMemberTests-1570638723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:29:14 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-a015c961-2850-4e1b-848b-e47c6ffc25b1 tempest-ProjectMemberTests-1570638723 None] Creating offline snapshot 05c90dd2-53ec-4fae-81c8-d836ee7bbe72 of volume 5db6ae99-4ae5-4c44-9c1d-d486d02bb330 {{(pid=86111) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 29 01:29:14 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[db1650b4-165e-4977-a2c0-d1c9a84aa9d0]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:29:14 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-a015c961-2850-4e1b-848b-e47c6ffc25b1 tempest-ProjectMemberTests-1570638723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-5db6ae99-4ae5-4c44-9c1d-d486d02bb330 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:14 devstack sudo[105766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-5db6ae99-4ae5-4c44-9c1d-d486d02bb330 Aug 29 01:29:14 devstack sudo[105766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:14 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-c4d8cbcd-8272-447f-b5e3-2d8d69a7aed7 tempest-ProjectReaderTests-1698516188 None] Acquiring lock "cinder-15a296be-9108-4655-b61d-19ecddbb78ae-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:29:14 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-c4d8cbcd-8272-447f-b5e3-2d8d69a7aed7 tempest-ProjectReaderTests-1698516188 None] Lock "cinder-15a296be-9108-4655-b61d-19ecddbb78ae-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:29:14 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-c4d8cbcd-8272-447f-b5e3-2d8d69a7aed7 tempest-ProjectReaderTests-1698516188 None] Acquiring lock "cinder-quobyte-15a296be-9108-4655-b61d-19ecddbb78ae" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:29:14 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-c4d8cbcd-8272-447f-b5e3-2d8d69a7aed7 tempest-ProjectReaderTests-1698516188 None] Lock "cinder-quobyte-15a296be-9108-4655-b61d-19ecddbb78ae" acquired by "delete_volume" :: waited 0.014s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:29:14 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[7239ca02-e1e6-4126-b6ba-20ccf6ac221e]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:29:14 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c4d8cbcd-8272-447f-b5e3-2d8d69a7aed7 tempest-ProjectReaderTests-1698516188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-15a296be-9108-4655-b61d-19ecddbb78ae {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:14 devstack sudo[105766]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:14 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-a015c961-2850-4e1b-848b-e47c6ffc25b1 tempest-ProjectMemberTests-1570638723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-5db6ae99-4ae5-4c44-9c1d-d486d02bb330" returned: 0 in 0.472s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:14 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-a015c961-2850-4e1b-848b-e47c6ffc25b1 tempest-ProjectMemberTests-1570638723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-5db6ae99-4ae5-4c44-9c1d-d486d02bb330,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-5db6ae99-4ae5-4c44-9c1d-d486d02bb330.05c90dd2-53ec-4fae-81c8-d836ee7bbe72 1G {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:14 devstack sudo[105772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-5db6ae99-4ae5-4c44-9c1d-d486d02bb330,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-5db6ae99-4ae5-4c44-9c1d-d486d02bb330.05c90dd2-53ec-4fae-81c8-d836ee7bbe72 1G Aug 29 01:29:14 devstack sudo[105772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:14 devstack sudo[105770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-15a296be-9108-4655-b61d-19ecddbb78ae Aug 29 01:29:14 devstack sudo[105770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:15 devstack sudo[105770]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:15 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c4d8cbcd-8272-447f-b5e3-2d8d69a7aed7 tempest-ProjectReaderTests-1698516188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-15a296be-9108-4655-b61d-19ecddbb78ae" returned: 0 in 0.408s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:15 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c4d8cbcd-8272-447f-b5e3-2d8d69a7aed7 tempest-ProjectReaderTests-1698516188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-15a296be-9108-4655-b61d-19ecddbb78ae {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:15 devstack sudo[105781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-15a296be-9108-4655-b61d-19ecddbb78ae Aug 29 01:29:15 devstack sudo[105781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:15 devstack sudo[105772]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:15 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-a015c961-2850-4e1b-848b-e47c6ffc25b1 tempest-ProjectMemberTests-1570638723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-5db6ae99-4ae5-4c44-9c1d-d486d02bb330,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-5db6ae99-4ae5-4c44-9c1d-d486d02bb330.05c90dd2-53ec-4fae-81c8-d836ee7bbe72 1G" returned: 0 in 0.461s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:15 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-a015c961-2850-4e1b-848b-e47c6ffc25b1 tempest-ProjectMemberTests-1570638723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5db6ae99-4ae5-4c44-9c1d-d486d02bb330 -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-5db6ae99-4ae5-4c44-9c1d-d486d02bb330.05c90dd2-53ec-4fae-81c8-d836ee7bbe72 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:15 devstack sudo[105784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5db6ae99-4ae5-4c44-9c1d-d486d02bb330 -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-5db6ae99-4ae5-4c44-9c1d-d486d02bb330.05c90dd2-53ec-4fae-81c8-d836ee7bbe72 Aug 29 01:29:15 devstack sudo[105784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:15 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3aaa751-6871-4147-8909-47c91d913377 tempest-SnapshotDependencyTests-1328723867 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:29:15 devstack sudo[105781]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:15 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-a3aaa751-6871-4147-8909-47c91d913377 tempest-SnapshotDependencyTests-1328723867 None] Flow 'volume_create_manager' (6f813f81-5c2f-4d91-901f-381ad636c0f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:29:15 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-a3aaa751-6871-4147-8909-47c91d913377 tempest-SnapshotDependencyTests-1328723867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (715d6f84-a865-4c4a-9b47-1fc47efb4857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:29:15 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c4d8cbcd-8272-447f-b5e3-2d8d69a7aed7 tempest-ProjectReaderTests-1698516188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-15a296be-9108-4655-b61d-19ecddbb78ae" returned: 0 in 0.296s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:15 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-a3aaa751-6871-4147-8909-47c91d913377 tempest-SnapshotDependencyTests-1328723867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (715d6f84-a865-4c4a-9b47-1fc47efb4857) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:29:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1140972619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab6562a3-d834-46a3-b24b-4666d0cfbdec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8dc9a2a6f1c8491294f01226d1d173e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:29:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:29:15Z,use_quota=True,user_id='5bd37772fdb04b39a80ce087db7f7698',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:29:15 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-a3aaa751-6871-4147-8909-47c91d913377 tempest-SnapshotDependencyTests-1328723867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbd8de35-fb21-4058-8cc2-aea2a8e25746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:29:15 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-a3aaa751-6871-4147-8909-47c91d913377 tempest-SnapshotDependencyTests-1328723867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbd8de35-fb21-4058-8cc2-aea2a8e25746) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:29:15 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-a3aaa751-6871-4147-8909-47c91d913377 tempest-SnapshotDependencyTests-1328723867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00d48bac-42e6-4458-92cd-9b6f062f81d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:29:15 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-a3aaa751-6871-4147-8909-47c91d913377 tempest-SnapshotDependencyTests-1328723867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00d48bac-42e6-4458-92cd-9b6f062f81d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab6562a3-d834-46a3-b24b-4666d0cfbdec', 'volume_name': 'volume-ab6562a3-d834-46a3-b24b-4666d0cfbdec', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:29:15 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-a3aaa751-6871-4147-8909-47c91d913377 tempest-SnapshotDependencyTests-1328723867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (975f8104-1c46-4659-a0a2-30b3b25e04ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:29:15 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-a3aaa751-6871-4147-8909-47c91d913377 tempest-SnapshotDependencyTests-1328723867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (975f8104-1c46-4659-a0a2-30b3b25e04ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:29:15 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-a3aaa751-6871-4147-8909-47c91d913377 tempest-SnapshotDependencyTests-1328723867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb0605a5-f753-4fbb-ab1e-4e22f2f30476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:29:15 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-a3aaa751-6871-4147-8909-47c91d913377 tempest-SnapshotDependencyTests-1328723867 None] Volume ab6562a3-d834-46a3-b24b-4666d0cfbdec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab6562a3-d834-46a3-b24b-4666d0cfbdec', 'volume_size': 1} Aug 29 01:29:15 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-a3aaa751-6871-4147-8909-47c91d913377 tempest-SnapshotDependencyTests-1328723867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:29:15 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-c4d8cbcd-8272-447f-b5e3-2d8d69a7aed7 tempest-ProjectReaderTests-1698516188 None] Lock "cinder-quobyte-15a296be-9108-4655-b61d-19ecddbb78ae" released by "delete_volume" :: held 0.809s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:29:15 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-c4d8cbcd-8272-447f-b5e3-2d8d69a7aed7 tempest-ProjectReaderTests-1698516188 None] Created reservations ['0db497b1-f087-4607-b0e3-daf51a8504b3', '8141cce0-37a2-4838-8387-1fe9b3e3aaac', 'f887e7fa-7cea-436e-8007-dd4a09d78d6c', '57bcc508-9a97-4a99-8de5-59cb194fe540'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:29:15 devstack sudo[105784]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:15 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-a015c961-2850-4e1b-848b-e47c6ffc25b1 tempest-ProjectMemberTests-1570638723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5db6ae99-4ae5-4c44-9c1d-d486d02bb330 -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-5db6ae99-4ae5-4c44-9c1d-d486d02bb330.05c90dd2-53ec-4fae-81c8-d836ee7bbe72" returned: 0 in 0.312s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:15 devstack cinder-volume[86111]: WARNING cinder.volume.drivers.remotefs [None req-a015c961-2850-4e1b-848b-e47c6ffc25b1 tempest-ProjectMemberTests-1570638723 None] /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-5db6ae99-4ae5-4c44-9c1d-d486d02bb330.05c90dd2-53ec-4fae-81c8-d836ee7bbe72 is being set with open permissions: ugo+rw Aug 29 01:29:15 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-a015c961-2850-4e1b-848b-e47c6ffc25b1 tempest-ProjectMemberTests-1570638723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-5db6ae99-4ae5-4c44-9c1d-d486d02bb330.05c90dd2-53ec-4fae-81c8-d836ee7bbe72 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:15 devstack sudo[105791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-5db6ae99-4ae5-4c44-9c1d-d486d02bb330.05c90dd2-53ec-4fae-81c8-d836ee7bbe72 Aug 29 01:29:15 devstack sudo[105791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:15 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-c4d8cbcd-8272-447f-b5e3-2d8d69a7aed7 tempest-ProjectReaderTests-1698516188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:29:15 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-c4d8cbcd-8272-447f-b5e3-2d8d69a7aed7 tempest-ProjectReaderTests-1698516188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:29:15 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-c4d8cbcd-8272-447f-b5e3-2d8d69a7aed7 tempest-ProjectReaderTests-1698516188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:29:15 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-c4d8cbcd-8272-447f-b5e3-2d8d69a7aed7 tempest-ProjectReaderTests-1698516188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:29:15 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-c4d8cbcd-8272-447f-b5e3-2d8d69a7aed7 tempest-ProjectReaderTests-1698516188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:29:15 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c4d8cbcd-8272-447f-b5e3-2d8d69a7aed7 tempest-ProjectReaderTests-1698516188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:15 devstack sudo[105793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:29:15 devstack sudo[105793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:15 devstack sudo[105791]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:15 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-a015c961-2850-4e1b-848b-e47c6ffc25b1 tempest-ProjectMemberTests-1570638723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-5db6ae99-4ae5-4c44-9c1d-d486d02bb330.05c90dd2-53ec-4fae-81c8-d836ee7bbe72" returned: 0 in 0.270s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:15 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-a015c961-2850-4e1b-848b-e47c6ffc25b1 tempest-ProjectMemberTests-1570638723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-5db6ae99-4ae5-4c44-9c1d-d486d02bb330.info {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:15 devstack sudo[105793]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:15 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c4d8cbcd-8272-447f-b5e3-2d8d69a7aed7 tempest-ProjectReaderTests-1698516188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.260s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:15 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-c4d8cbcd-8272-447f-b5e3-2d8d69a7aed7 tempest-ProjectReaderTests-1698516188 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:29:15 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-c4d8cbcd-8272-447f-b5e3-2d8d69a7aed7 tempest-ProjectReaderTests-1698516188 None] Deleted volume successfully. Aug 29 01:29:15 devstack sudo[105797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-5db6ae99-4ae5-4c44-9c1d-d486d02bb330.info Aug 29 01:29:15 devstack sudo[105797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:15 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-c4d8cbcd-8272-447f-b5e3-2d8d69a7aed7 tempest-ProjectReaderTests-1698516188 None] Lock "cinder-15a296be-9108-4655-b61d-19ecddbb78ae-delete_volume" released by "delete_volume" :: held 1.323s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:29:16 devstack sudo[105797]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:16 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-a015c961-2850-4e1b-848b-e47c6ffc25b1 tempest-ProjectMemberTests-1570638723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-5db6ae99-4ae5-4c44-9c1d-d486d02bb330.info" returned: 0 in 0.285s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:16 devstack cinder-volume[86111]: WARNING cinder.volume.drivers.remotefs [None req-a015c961-2850-4e1b-848b-e47c6ffc25b1 tempest-ProjectMemberTests-1570638723 None] /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-5db6ae99-4ae5-4c44-9c1d-d486d02bb330.info is being set with open permissions: ugo+rw Aug 29 01:29:16 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-a015c961-2850-4e1b-848b-e47c6ffc25b1 tempest-ProjectMemberTests-1570638723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-5db6ae99-4ae5-4c44-9c1d-d486d02bb330.info {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:16 devstack sudo[105800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-5db6ae99-4ae5-4c44-9c1d-d486d02bb330.info Aug 29 01:29:16 devstack sudo[105800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:16 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-946b2668-d6b9-46c0-b635-3362f4d8d747 tempest-ProjectReaderTests-1698516188 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:29:16 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-946b2668-d6b9-46c0-b635-3362f4d8d747 tempest-ProjectReaderTests-1698516188 None] Flow 'volume_create_manager' (60025e30-d18e-4e39-991c-3b3e570dcbe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:29:16 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-946b2668-d6b9-46c0-b635-3362f4d8d747 tempest-ProjectReaderTests-1698516188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7edb2f0-0d2f-45b9-9e1f-aa705d5c169a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:29:16 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-946b2668-d6b9-46c0-b635-3362f4d8d747 tempest-ProjectReaderTests-1698516188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7edb2f0-0d2f-45b9-9e1f-aa705d5c169a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:29:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1582862309',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=524bfeee-c88f-42bd-bd4c-d5b98c1418cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f049b4b9de194d0bb816e863c7740f77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:29:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:29:16Z,use_quota=True,user_id='168ab677c6ef4d8f93d853c32c291481',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:29:16 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-946b2668-d6b9-46c0-b635-3362f4d8d747 tempest-ProjectReaderTests-1698516188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b2cf775-ddcc-4849-8842-3dde3339d5be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:29:16 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-946b2668-d6b9-46c0-b635-3362f4d8d747 tempest-ProjectReaderTests-1698516188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b2cf775-ddcc-4849-8842-3dde3339d5be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:29:16 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-946b2668-d6b9-46c0-b635-3362f4d8d747 tempest-ProjectReaderTests-1698516188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1623b77c-1199-40ef-ad8b-ba35ccd1672e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:29:16 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-946b2668-d6b9-46c0-b635-3362f4d8d747 tempest-ProjectReaderTests-1698516188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1623b77c-1199-40ef-ad8b-ba35ccd1672e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '524bfeee-c88f-42bd-bd4c-d5b98c1418cb', 'volume_name': 'volume-524bfeee-c88f-42bd-bd4c-d5b98c1418cb', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:29:16 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-946b2668-d6b9-46c0-b635-3362f4d8d747 tempest-ProjectReaderTests-1698516188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79996c27-3aee-4afd-bf42-6d137e694513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:29:16 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-946b2668-d6b9-46c0-b635-3362f4d8d747 tempest-ProjectReaderTests-1698516188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79996c27-3aee-4afd-bf42-6d137e694513) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:29:16 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-946b2668-d6b9-46c0-b635-3362f4d8d747 tempest-ProjectReaderTests-1698516188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (764ca0e1-3a31-4631-83b0-cb377184c857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:29:16 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-946b2668-d6b9-46c0-b635-3362f4d8d747 tempest-ProjectReaderTests-1698516188 None] Volume 524bfeee-c88f-42bd-bd4c-d5b98c1418cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-524bfeee-c88f-42bd-bd4c-d5b98c1418cb', 'volume_size': 1} Aug 29 01:29:16 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-946b2668-d6b9-46c0-b635-3362f4d8d747 tempest-ProjectReaderTests-1698516188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:29:16 devstack sudo[105800]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:16 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-a015c961-2850-4e1b-848b-e47c6ffc25b1 tempest-ProjectMemberTests-1570638723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-5db6ae99-4ae5-4c44-9c1d-d486d02bb330.info" returned: 0 in 0.251s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:16 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-a015c961-2850-4e1b-848b-e47c6ffc25b1 tempest-ProjectMemberTests-1570638723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.142s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:29:16 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-a3aaa751-6871-4147-8909-47c91d913377 tempest-SnapshotDependencyTests-1328723867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.940s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:29:16 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-a3aaa751-6871-4147-8909-47c91d913377 tempest-SnapshotDependencyTests-1328723867 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:29:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1140972619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab6562a3-d834-46a3-b24b-4666d0cfbdec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8dc9a2a6f1c8491294f01226d1d173e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:29:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:29:15Z,use_quota=True,user_id='5bd37772fdb04b39a80ce087db7f7698',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:29:16 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-a3aaa751-6871-4147-8909-47c91d913377 tempest-SnapshotDependencyTests-1328723867 None] Creating volume ab6562a3-d834-46a3-b24b-4666d0cfbdec {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:29:16 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-a3aaa751-6871-4147-8909-47c91d913377 tempest-SnapshotDependencyTests-1328723867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:29:16 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-a3aaa751-6871-4147-8909-47c91d913377 tempest-SnapshotDependencyTests-1328723867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:29:16 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-a3aaa751-6871-4147-8909-47c91d913377 tempest-SnapshotDependencyTests-1328723867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:29:16 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-a3aaa751-6871-4147-8909-47c91d913377 tempest-SnapshotDependencyTests-1328723867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:29:16 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-a3aaa751-6871-4147-8909-47c91d913377 tempest-SnapshotDependencyTests-1328723867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:29:16 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-a3aaa751-6871-4147-8909-47c91d913377 tempest-SnapshotDependencyTests-1328723867 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:29:16 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-a3aaa751-6871-4147-8909-47c91d913377 tempest-SnapshotDependencyTests-1328723867 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:29:16 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-a3aaa751-6871-4147-8909-47c91d913377 tempest-SnapshotDependencyTests-1328723867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ab6562a3-d834-46a3-b24b-4666d0cfbdec 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:16 devstack sudo[105803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ab6562a3-d834-46a3-b24b-4666d0cfbdec 1073741824 Aug 29 01:29:16 devstack sudo[105803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:16 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-a015c961-2850-4e1b-848b-e47c6ffc25b1 tempest-ProjectMemberTests-1570638723 None] Create snapshot completed successfully Aug 29 01:29:16 devstack sudo[105803]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:16 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-a3aaa751-6871-4147-8909-47c91d913377 tempest-SnapshotDependencyTests-1328723867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ab6562a3-d834-46a3-b24b-4666d0cfbdec 1073741824" returned: 0 in 0.380s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:16 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-a3aaa751-6871-4147-8909-47c91d913377 tempest-SnapshotDependencyTests-1328723867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ab6562a3-d834-46a3-b24b-4666d0cfbdec {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:16 devstack sudo[105808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ab6562a3-d834-46a3-b24b-4666d0cfbdec Aug 29 01:29:16 devstack sudo[105808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:16 devstack sudo[105808]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:17 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-a3aaa751-6871-4147-8909-47c91d913377 tempest-SnapshotDependencyTests-1328723867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ab6562a3-d834-46a3-b24b-4666d0cfbdec" returned: 0 in 0.242s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:17 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-a3aaa751-6871-4147-8909-47c91d913377 tempest-SnapshotDependencyTests-1328723867 None] <== create_volume: return (659ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:29:17 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-a3aaa751-6871-4147-8909-47c91d913377 tempest-SnapshotDependencyTests-1328723867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.662s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:29:17 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-946b2668-d6b9-46c0-b635-3362f4d8d747 tempest-ProjectReaderTests-1698516188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.791s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:29:17 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-946b2668-d6b9-46c0-b635-3362f4d8d747 tempest-ProjectReaderTests-1698516188 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:29:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1582862309',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=524bfeee-c88f-42bd-bd4c-d5b98c1418cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f049b4b9de194d0bb816e863c7740f77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:29:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:29:16Z,use_quota=True,user_id='168ab677c6ef4d8f93d853c32c291481',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:29:17 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-946b2668-d6b9-46c0-b635-3362f4d8d747 tempest-ProjectReaderTests-1698516188 None] Creating volume 524bfeee-c88f-42bd-bd4c-d5b98c1418cb {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:29:17 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-946b2668-d6b9-46c0-b635-3362f4d8d747 tempest-ProjectReaderTests-1698516188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:29:17 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-946b2668-d6b9-46c0-b635-3362f4d8d747 tempest-ProjectReaderTests-1698516188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:29:17 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-946b2668-d6b9-46c0-b635-3362f4d8d747 tempest-ProjectReaderTests-1698516188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:29:17 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-946b2668-d6b9-46c0-b635-3362f4d8d747 tempest-ProjectReaderTests-1698516188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:29:17 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-946b2668-d6b9-46c0-b635-3362f4d8d747 tempest-ProjectReaderTests-1698516188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:29:17 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-946b2668-d6b9-46c0-b635-3362f4d8d747 tempest-ProjectReaderTests-1698516188 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:29:17 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-946b2668-d6b9-46c0-b635-3362f4d8d747 tempest-ProjectReaderTests-1698516188 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:29:17 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-946b2668-d6b9-46c0-b635-3362f4d8d747 tempest-ProjectReaderTests-1698516188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-524bfeee-c88f-42bd-bd4c-d5b98c1418cb 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:17 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-a3aaa751-6871-4147-8909-47c91d913377 tempest-SnapshotDependencyTests-1328723867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb0605a5-f753-4fbb-ab1e-4e22f2f30476) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab6562a3-d834-46a3-b24b-4666d0cfbdec', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:29:17 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-a3aaa751-6871-4147-8909-47c91d913377 tempest-SnapshotDependencyTests-1328723867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (091715bb-97c9-44d7-a7c7-1ce40cdc6606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:29:17 devstack sudo[105811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-524bfeee-c88f-42bd-bd4c-d5b98c1418cb 1073741824 Aug 29 01:29:17 devstack sudo[105811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:17 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-a3aaa751-6871-4147-8909-47c91d913377 tempest-SnapshotDependencyTests-1328723867 None] Volume volume-ab6562a3-d834-46a3-b24b-4666d0cfbdec (ab6562a3-d834-46a3-b24b-4666d0cfbdec): created successfully Aug 29 01:29:17 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-a3aaa751-6871-4147-8909-47c91d913377 tempest-SnapshotDependencyTests-1328723867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (091715bb-97c9-44d7-a7c7-1ce40cdc6606) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:29:17 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-a3aaa751-6871-4147-8909-47c91d913377 tempest-SnapshotDependencyTests-1328723867 None] Flow 'volume_create_manager' (6f813f81-5c2f-4d91-901f-381ad636c0f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:29:17 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-a3aaa751-6871-4147-8909-47c91d913377 tempest-SnapshotDependencyTests-1328723867 None] Created volume successfully. Aug 29 01:29:17 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-53b58381-3558-4a94-9072-00cf0913442a tempest-ProjectMemberTests-1570638723 None] Acquiring lock "cinder-05c90dd2-53ec-4fae-81c8-d836ee7bbe72-delete_snapshot" by "delete_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:29:17 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-53b58381-3558-4a94-9072-00cf0913442a tempest-ProjectMemberTests-1570638723 None] Lock "cinder-05c90dd2-53ec-4fae-81c8-d836ee7bbe72-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:29:17 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-53b58381-3558-4a94-9072-00cf0913442a tempest-ProjectMemberTests-1570638723 None] Acquiring lock "cinder-quobyte-5db6ae99-4ae5-4c44-9c1d-d486d02bb330" by "delete_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:29:17 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-53b58381-3558-4a94-9072-00cf0913442a tempest-ProjectMemberTests-1570638723 None] Lock "cinder-quobyte-5db6ae99-4ae5-4c44-9c1d-d486d02bb330" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:29:17 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-53b58381-3558-4a94-9072-00cf0913442a tempest-ProjectMemberTests-1570638723 None] Acquiring lock "cinder-quobyte-05c90dd2-53ec-4fae-81c8-d836ee7bbe72" by "_delete_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:29:17 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-53b58381-3558-4a94-9072-00cf0913442a tempest-ProjectMemberTests-1570638723 None] Lock "cinder-quobyte-05c90dd2-53ec-4fae-81c8-d836ee7bbe72" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:29:17 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-53b58381-3558-4a94-9072-00cf0913442a tempest-ProjectMemberTests-1570638723 None] Deleting offline snapshot 05c90dd2-53ec-4fae-81c8-d836ee7bbe72 of volume 5db6ae99-4ae5-4c44-9c1d-d486d02bb330 {{(pid=86111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 29 01:29:17 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-53b58381-3558-4a94-9072-00cf0913442a tempest-ProjectMemberTests-1570638723 None] snapshot_file for this snap is: volume-5db6ae99-4ae5-4c44-9c1d-d486d02bb330.05c90dd2-53ec-4fae-81c8-d836ee7bbe72 {{(pid=86111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 29 01:29:17 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5d29826-bf86-4bfe-8be2-89117f7ac108]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:29:17 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-53b58381-3558-4a94-9072-00cf0913442a tempest-ProjectMemberTests-1570638723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-5db6ae99-4ae5-4c44-9c1d-d486d02bb330.05c90dd2-53ec-4fae-81c8-d836ee7bbe72 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:17 devstack sudo[105811]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:17 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-946b2668-d6b9-46c0-b635-3362f4d8d747 tempest-ProjectReaderTests-1698516188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-524bfeee-c88f-42bd-bd4c-d5b98c1418cb 1073741824" returned: 0 in 0.498s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:17 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-946b2668-d6b9-46c0-b635-3362f4d8d747 tempest-ProjectReaderTests-1698516188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-524bfeee-c88f-42bd-bd4c-d5b98c1418cb {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:17 devstack sudo[105818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-524bfeee-c88f-42bd-bd4c-d5b98c1418cb Aug 29 01:29:17 devstack sudo[105818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:17 devstack sudo[105817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-5db6ae99-4ae5-4c44-9c1d-d486d02bb330.05c90dd2-53ec-4fae-81c8-d836ee7bbe72 Aug 29 01:29:17 devstack sudo[105817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:17 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-135146c8-1325-476e-b61d-86087117356e tempest-SnapshotDependencyTests-1328723867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:29:17 devstack sudo[105818]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:17 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-946b2668-d6b9-46c0-b635-3362f4d8d747 tempest-ProjectReaderTests-1698516188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-524bfeee-c88f-42bd-bd4c-d5b98c1418cb" returned: 0 in 0.265s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:17 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-946b2668-d6b9-46c0-b635-3362f4d8d747 tempest-ProjectReaderTests-1698516188 None] <== create_volume: return (812ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:29:17 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-946b2668-d6b9-46c0-b635-3362f4d8d747 tempest-ProjectReaderTests-1698516188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.815s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:29:17 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-135146c8-1325-476e-b61d-86087117356e tempest-SnapshotDependencyTests-1328723867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.140s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:29:17 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-946b2668-d6b9-46c0-b635-3362f4d8d747 tempest-ProjectReaderTests-1698516188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (764ca0e1-3a31-4631-83b0-cb377184c857) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-524bfeee-c88f-42bd-bd4c-d5b98c1418cb', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:29:17 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-946b2668-d6b9-46c0-b635-3362f4d8d747 tempest-ProjectReaderTests-1698516188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b93dda5-74b7-44e0-93fc-50ae9d8a8555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:29:17 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-135146c8-1325-476e-b61d-86087117356e tempest-SnapshotDependencyTests-1328723867 None] Creating offline snapshot bb855e83-208b-4ed2-a548-9c42f7285676 of volume ab6562a3-d834-46a3-b24b-4666d0cfbdec {{(pid=86111) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 29 01:29:17 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-946b2668-d6b9-46c0-b635-3362f4d8d747 tempest-ProjectReaderTests-1698516188 None] Volume volume-524bfeee-c88f-42bd-bd4c-d5b98c1418cb (524bfeee-c88f-42bd-bd4c-d5b98c1418cb): created successfully Aug 29 01:29:17 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-946b2668-d6b9-46c0-b635-3362f4d8d747 tempest-ProjectReaderTests-1698516188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b93dda5-74b7-44e0-93fc-50ae9d8a8555) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:29:17 devstack sudo[105817]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:17 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-946b2668-d6b9-46c0-b635-3362f4d8d747 tempest-ProjectReaderTests-1698516188 None] Flow 'volume_create_manager' (60025e30-d18e-4e39-991c-3b3e570dcbe2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:29:17 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[78565dcc-0a2d-434c-8769-4139ae77cb8b]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:29:17 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-135146c8-1325-476e-b61d-86087117356e tempest-SnapshotDependencyTests-1328723867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ab6562a3-d834-46a3-b24b-4666d0cfbdec {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:17 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-53b58381-3558-4a94-9072-00cf0913442a tempest-ProjectMemberTests-1570638723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-5db6ae99-4ae5-4c44-9c1d-d486d02bb330.05c90dd2-53ec-4fae-81c8-d836ee7bbe72" returned: 0 in 0.408s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:17 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-53b58381-3558-4a94-9072-00cf0913442a tempest-ProjectMemberTests-1570638723 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5db6ae99-4ae5-4c44-9c1d-d486d02bb330(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 29 01:29:17 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-946b2668-d6b9-46c0-b635-3362f4d8d747 tempest-ProjectReaderTests-1698516188 None] Created volume successfully. Aug 29 01:29:17 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[829f7181-6e6f-4a79-841d-521833671499]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:29:17 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-53b58381-3558-4a94-9072-00cf0913442a tempest-ProjectMemberTests-1570638723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-5db6ae99-4ae5-4c44-9c1d-d486d02bb330 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:18 devstack sudo[105825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ab6562a3-d834-46a3-b24b-4666d0cfbdec Aug 29 01:29:18 devstack sudo[105825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:18 devstack sudo[105826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-5db6ae99-4ae5-4c44-9c1d-d486d02bb330 Aug 29 01:29:18 devstack sudo[105826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:18 devstack sudo[105825]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:18 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-135146c8-1325-476e-b61d-86087117356e tempest-SnapshotDependencyTests-1328723867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ab6562a3-d834-46a3-b24b-4666d0cfbdec" returned: 0 in 0.382s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:18 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-135146c8-1325-476e-b61d-86087117356e tempest-SnapshotDependencyTests-1328723867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ab6562a3-d834-46a3-b24b-4666d0cfbdec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ab6562a3-d834-46a3-b24b-4666d0cfbdec.bb855e83-208b-4ed2-a548-9c42f7285676 1G {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:18 devstack sudo[105834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ab6562a3-d834-46a3-b24b-4666d0cfbdec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ab6562a3-d834-46a3-b24b-4666d0cfbdec.bb855e83-208b-4ed2-a548-9c42f7285676 1G Aug 29 01:29:18 devstack sudo[105834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:18 devstack sudo[105826]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:18 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-568efec2-361e-4d5c-81fa-0e9cc0df918c tempest-ProjectReaderTests-1698516188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:29:18 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-53b58381-3558-4a94-9072-00cf0913442a tempest-ProjectMemberTests-1570638723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-5db6ae99-4ae5-4c44-9c1d-d486d02bb330" returned: 0 in 0.454s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:18 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-53b58381-3558-4a94-9072-00cf0913442a tempest-ProjectMemberTests-1570638723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-5db6ae99-4ae5-4c44-9c1d-d486d02bb330.05c90dd2-53ec-4fae-81c8-d836ee7bbe72 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:18 devstack sudo[105838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-5db6ae99-4ae5-4c44-9c1d-d486d02bb330.05c90dd2-53ec-4fae-81c8-d836ee7bbe72 Aug 29 01:29:18 devstack sudo[105838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:18 devstack sudo[105834]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:18 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-135146c8-1325-476e-b61d-86087117356e tempest-SnapshotDependencyTests-1328723867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ab6562a3-d834-46a3-b24b-4666d0cfbdec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ab6562a3-d834-46a3-b24b-4666d0cfbdec.bb855e83-208b-4ed2-a548-9c42f7285676 1G" returned: 0 in 0.430s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:18 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-135146c8-1325-476e-b61d-86087117356e tempest-SnapshotDependencyTests-1328723867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab6562a3-d834-46a3-b24b-4666d0cfbdec -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ab6562a3-d834-46a3-b24b-4666d0cfbdec.bb855e83-208b-4ed2-a548-9c42f7285676 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:18 devstack sudo[105847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab6562a3-d834-46a3-b24b-4666d0cfbdec -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ab6562a3-d834-46a3-b24b-4666d0cfbdec.bb855e83-208b-4ed2-a548-9c42f7285676 Aug 29 01:29:18 devstack sudo[105847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:18 devstack sudo[105838]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:18 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-53b58381-3558-4a94-9072-00cf0913442a tempest-ProjectMemberTests-1570638723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-5db6ae99-4ae5-4c44-9c1d-d486d02bb330.05c90dd2-53ec-4fae-81c8-d836ee7bbe72" returned: 0 in 0.371s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:18 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-53b58381-3558-4a94-9072-00cf0913442a tempest-ProjectMemberTests-1570638723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-5db6ae99-4ae5-4c44-9c1d-d486d02bb330.05c90dd2-53ec-4fae-81c8-d836ee7bbe72 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:18 devstack sudo[105849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-5db6ae99-4ae5-4c44-9c1d-d486d02bb330.05c90dd2-53ec-4fae-81c8-d836ee7bbe72 Aug 29 01:29:18 devstack sudo[105849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:19 devstack sudo[105847]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:19 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-135146c8-1325-476e-b61d-86087117356e tempest-SnapshotDependencyTests-1328723867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab6562a3-d834-46a3-b24b-4666d0cfbdec -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ab6562a3-d834-46a3-b24b-4666d0cfbdec.bb855e83-208b-4ed2-a548-9c42f7285676" returned: 0 in 0.299s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:19 devstack cinder-volume[86111]: WARNING cinder.volume.drivers.remotefs [None req-135146c8-1325-476e-b61d-86087117356e tempest-SnapshotDependencyTests-1328723867 None] /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ab6562a3-d834-46a3-b24b-4666d0cfbdec.bb855e83-208b-4ed2-a548-9c42f7285676 is being set with open permissions: ugo+rw Aug 29 01:29:19 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-135146c8-1325-476e-b61d-86087117356e tempest-SnapshotDependencyTests-1328723867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ab6562a3-d834-46a3-b24b-4666d0cfbdec.bb855e83-208b-4ed2-a548-9c42f7285676 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:19 devstack sudo[105849]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:19 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-53b58381-3558-4a94-9072-00cf0913442a tempest-ProjectMemberTests-1570638723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-5db6ae99-4ae5-4c44-9c1d-d486d02bb330.05c90dd2-53ec-4fae-81c8-d836ee7bbe72" returned: 0 in 0.259s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:19 devstack sudo[105855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ab6562a3-d834-46a3-b24b-4666d0cfbdec.bb855e83-208b-4ed2-a548-9c42f7285676 Aug 29 01:29:19 devstack sudo[105855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:19 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-53b58381-3558-4a94-9072-00cf0913442a tempest-ProjectMemberTests-1570638723 None] Lock "cinder-quobyte-05c90dd2-53ec-4fae-81c8-d836ee7bbe72" released by "_delete_snapshot" :: held 1.598s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:29:19 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-53b58381-3558-4a94-9072-00cf0913442a tempest-ProjectMemberTests-1570638723 None] Lock "cinder-quobyte-5db6ae99-4ae5-4c44-9c1d-d486d02bb330" released by "delete_snapshot" :: held 1.621s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:29:19 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-53b58381-3558-4a94-9072-00cf0913442a tempest-ProjectMemberTests-1570638723 None] Created reservations ['40d41f52-44e2-4d4e-99d8-ce19bf505fac', '9efaef2e-6baf-429f-b6d3-cb540cc28a1f', 'fc2fb605-ba7d-4bd2-939b-0eb53f885476', '52bc48df-14a1-4a00-9d8d-460ef2c74e59'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:29:19 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-53b58381-3558-4a94-9072-00cf0913442a tempest-ProjectMemberTests-1570638723 None] Delete snapshot completed successfully. Aug 29 01:29:19 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-53b58381-3558-4a94-9072-00cf0913442a tempest-ProjectMemberTests-1570638723 None] Lock "cinder-05c90dd2-53ec-4fae-81c8-d836ee7bbe72-delete_snapshot" released by "delete_snapshot" :: held 1.759s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:29:19 devstack sudo[105855]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:19 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-135146c8-1325-476e-b61d-86087117356e tempest-SnapshotDependencyTests-1328723867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ab6562a3-d834-46a3-b24b-4666d0cfbdec.bb855e83-208b-4ed2-a548-9c42f7285676" returned: 0 in 0.255s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:19 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-135146c8-1325-476e-b61d-86087117356e tempest-SnapshotDependencyTests-1328723867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ab6562a3-d834-46a3-b24b-4666d0cfbdec.info {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:19 devstack sudo[105858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ab6562a3-d834-46a3-b24b-4666d0cfbdec.info Aug 29 01:29:19 devstack sudo[105858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:19 devstack sudo[105858]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:19 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-135146c8-1325-476e-b61d-86087117356e tempest-SnapshotDependencyTests-1328723867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ab6562a3-d834-46a3-b24b-4666d0cfbdec.info" returned: 0 in 0.259s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:19 devstack cinder-volume[86111]: WARNING cinder.volume.drivers.remotefs [None req-135146c8-1325-476e-b61d-86087117356e tempest-SnapshotDependencyTests-1328723867 None] /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ab6562a3-d834-46a3-b24b-4666d0cfbdec.info is being set with open permissions: ugo+rw Aug 29 01:29:19 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-135146c8-1325-476e-b61d-86087117356e tempest-SnapshotDependencyTests-1328723867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ab6562a3-d834-46a3-b24b-4666d0cfbdec.info {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:19 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-afbfcc60-831e-4a50-99ec-4bed59d276de tempest-ProjectMemberTests-1570638723 None] Acquiring lock "cinder-5db6ae99-4ae5-4c44-9c1d-d486d02bb330-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:29:19 devstack sudo[105862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ab6562a3-d834-46a3-b24b-4666d0cfbdec.info Aug 29 01:29:19 devstack sudo[105862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:19 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-afbfcc60-831e-4a50-99ec-4bed59d276de tempest-ProjectMemberTests-1570638723 None] Lock "cinder-5db6ae99-4ae5-4c44-9c1d-d486d02bb330-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:29:19 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-afbfcc60-831e-4a50-99ec-4bed59d276de tempest-ProjectMemberTests-1570638723 None] Acquiring lock "cinder-quobyte-5db6ae99-4ae5-4c44-9c1d-d486d02bb330" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:29:19 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-afbfcc60-831e-4a50-99ec-4bed59d276de tempest-ProjectMemberTests-1570638723 None] Lock "cinder-quobyte-5db6ae99-4ae5-4c44-9c1d-d486d02bb330" acquired by "delete_volume" :: waited 0.017s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:29:19 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[508f9aaa-5bcf-436f-8b0e-d0c4ff7a5f40]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:29:19 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-afbfcc60-831e-4a50-99ec-4bed59d276de tempest-ProjectMemberTests-1570638723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-5db6ae99-4ae5-4c44-9c1d-d486d02bb330 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:19 devstack sudo[105864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-5db6ae99-4ae5-4c44-9c1d-d486d02bb330 Aug 29 01:29:19 devstack sudo[105864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:19 devstack sudo[105862]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:19 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-135146c8-1325-476e-b61d-86087117356e tempest-SnapshotDependencyTests-1328723867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ab6562a3-d834-46a3-b24b-4666d0cfbdec.info" returned: 0 in 0.279s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:19 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-135146c8-1325-476e-b61d-86087117356e tempest-SnapshotDependencyTests-1328723867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.019s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:29:19 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-568efec2-361e-4d5c-81fa-0e9cc0df918c tempest-ProjectReaderTests-1698516188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.462s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:29:19 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-568efec2-361e-4d5c-81fa-0e9cc0df918c tempest-ProjectReaderTests-1698516188 None] Creating offline snapshot c321ea4a-ab43-4190-bff9-ad1f072aeb40 of volume 524bfeee-c88f-42bd-bd4c-d5b98c1418cb {{(pid=86111) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 29 01:29:19 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-135146c8-1325-476e-b61d-86087117356e tempest-SnapshotDependencyTests-1328723867 None] Create snapshot completed successfully Aug 29 01:29:19 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[b76738c1-f1a0-4e36-9a52-2cbcf2d1caaf]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:29:19 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-568efec2-361e-4d5c-81fa-0e9cc0df918c tempest-ProjectReaderTests-1698516188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-524bfeee-c88f-42bd-bd4c-d5b98c1418cb {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:20 devstack sudo[105867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-524bfeee-c88f-42bd-bd4c-d5b98c1418cb Aug 29 01:29:20 devstack sudo[105867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:20 devstack sudo[105864]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:20 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-afbfcc60-831e-4a50-99ec-4bed59d276de tempest-ProjectMemberTests-1570638723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-5db6ae99-4ae5-4c44-9c1d-d486d02bb330" returned: 0 in 0.361s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:20 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-afbfcc60-831e-4a50-99ec-4bed59d276de tempest-ProjectMemberTests-1570638723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-5db6ae99-4ae5-4c44-9c1d-d486d02bb330 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:20 devstack sudo[105872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-5db6ae99-4ae5-4c44-9c1d-d486d02bb330 Aug 29 01:29:20 devstack sudo[105872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:20 devstack sudo[105867]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:20 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-568efec2-361e-4d5c-81fa-0e9cc0df918c tempest-ProjectReaderTests-1698516188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-524bfeee-c88f-42bd-bd4c-d5b98c1418cb" returned: 0 in 0.361s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:20 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-568efec2-361e-4d5c-81fa-0e9cc0df918c tempest-ProjectReaderTests-1698516188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-524bfeee-c88f-42bd-bd4c-d5b98c1418cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-524bfeee-c88f-42bd-bd4c-d5b98c1418cb.c321ea4a-ab43-4190-bff9-ad1f072aeb40 1G {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:20 devstack sudo[105877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-524bfeee-c88f-42bd-bd4c-d5b98c1418cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-524bfeee-c88f-42bd-bd4c-d5b98c1418cb.c321ea4a-ab43-4190-bff9-ad1f072aeb40 1G Aug 29 01:29:20 devstack sudo[105877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:20 devstack sudo[105872]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:20 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-afbfcc60-831e-4a50-99ec-4bed59d276de tempest-ProjectMemberTests-1570638723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-5db6ae99-4ae5-4c44-9c1d-d486d02bb330" returned: 0 in 0.256s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:20 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-afbfcc60-831e-4a50-99ec-4bed59d276de tempest-ProjectMemberTests-1570638723 None] Lock "cinder-quobyte-5db6ae99-4ae5-4c44-9c1d-d486d02bb330" released by "delete_volume" :: held 0.677s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:29:20 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-afbfcc60-831e-4a50-99ec-4bed59d276de tempest-ProjectMemberTests-1570638723 None] Created reservations ['e6bba8df-4b31-4315-9033-ed35534a6410', '43e75cc9-f8bf-44cc-abf5-30b124fafd52', '891ec095-9c77-489a-9921-6b71cf46886d', '5fd55cdb-1fca-43f4-8a7b-68730e1bc647'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:29:20 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-afbfcc60-831e-4a50-99ec-4bed59d276de tempest-ProjectMemberTests-1570638723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:29:20 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-afbfcc60-831e-4a50-99ec-4bed59d276de tempest-ProjectMemberTests-1570638723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:29:20 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-afbfcc60-831e-4a50-99ec-4bed59d276de tempest-ProjectMemberTests-1570638723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:29:20 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-afbfcc60-831e-4a50-99ec-4bed59d276de tempest-ProjectMemberTests-1570638723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:29:20 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-afbfcc60-831e-4a50-99ec-4bed59d276de tempest-ProjectMemberTests-1570638723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:29:20 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-afbfcc60-831e-4a50-99ec-4bed59d276de tempest-ProjectMemberTests-1570638723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:20 devstack sudo[105882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:29:20 devstack sudo[105882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:20 devstack sudo[105877]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:20 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-568efec2-361e-4d5c-81fa-0e9cc0df918c tempest-ProjectReaderTests-1698516188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-524bfeee-c88f-42bd-bd4c-d5b98c1418cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-524bfeee-c88f-42bd-bd4c-d5b98c1418cb.c321ea4a-ab43-4190-bff9-ad1f072aeb40 1G" returned: 0 in 0.391s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:20 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-568efec2-361e-4d5c-81fa-0e9cc0df918c tempest-ProjectReaderTests-1698516188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-524bfeee-c88f-42bd-bd4c-d5b98c1418cb -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-524bfeee-c88f-42bd-bd4c-d5b98c1418cb.c321ea4a-ab43-4190-bff9-ad1f072aeb40 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:20 devstack sudo[105885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-524bfeee-c88f-42bd-bd4c-d5b98c1418cb -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-524bfeee-c88f-42bd-bd4c-d5b98c1418cb.c321ea4a-ab43-4190-bff9-ad1f072aeb40 Aug 29 01:29:20 devstack sudo[105885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:20 devstack sudo[105882]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:20 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-afbfcc60-831e-4a50-99ec-4bed59d276de tempest-ProjectMemberTests-1570638723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.264s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:20 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-afbfcc60-831e-4a50-99ec-4bed59d276de tempest-ProjectMemberTests-1570638723 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:29:20 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-afbfcc60-831e-4a50-99ec-4bed59d276de tempest-ProjectMemberTests-1570638723 None] Deleted volume successfully. Aug 29 01:29:20 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-afbfcc60-831e-4a50-99ec-4bed59d276de tempest-ProjectMemberTests-1570638723 None] Lock "cinder-5db6ae99-4ae5-4c44-9c1d-d486d02bb330-delete_volume" released by "delete_volume" :: held 1.177s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:29:20 devstack sudo[105885]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:20 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-568efec2-361e-4d5c-81fa-0e9cc0df918c tempest-ProjectReaderTests-1698516188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-524bfeee-c88f-42bd-bd4c-d5b98c1418cb -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-524bfeee-c88f-42bd-bd4c-d5b98c1418cb.c321ea4a-ab43-4190-bff9-ad1f072aeb40" returned: 0 in 0.345s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:20 devstack cinder-volume[86111]: WARNING cinder.volume.drivers.remotefs [None req-568efec2-361e-4d5c-81fa-0e9cc0df918c tempest-ProjectReaderTests-1698516188 None] /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-524bfeee-c88f-42bd-bd4c-d5b98c1418cb.c321ea4a-ab43-4190-bff9-ad1f072aeb40 is being set with open permissions: ugo+rw Aug 29 01:29:20 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-568efec2-361e-4d5c-81fa-0e9cc0df918c tempest-ProjectReaderTests-1698516188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-524bfeee-c88f-42bd-bd4c-d5b98c1418cb.c321ea4a-ab43-4190-bff9-ad1f072aeb40 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:21 devstack sudo[105892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-524bfeee-c88f-42bd-bd4c-d5b98c1418cb.c321ea4a-ab43-4190-bff9-ad1f072aeb40 Aug 29 01:29:21 devstack sudo[105892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:21 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6d94a5b-d271-40d5-8d55-51a7fe48ddb2 tempest-ProjectMemberTests-1570638723 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:29:21 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-f6d94a5b-d271-40d5-8d55-51a7fe48ddb2 tempest-ProjectMemberTests-1570638723 None] Flow 'volume_create_manager' (c0ee206d-3963-4848-b218-ff3829555caf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:29:21 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-f6d94a5b-d271-40d5-8d55-51a7fe48ddb2 tempest-ProjectMemberTests-1570638723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27a48249-eb44-4cfb-a95f-7bfc88def5b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:29:21 devstack sudo[105892]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:21 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-f6d94a5b-d271-40d5-8d55-51a7fe48ddb2 tempest-ProjectMemberTests-1570638723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27a48249-eb44-4cfb-a95f-7bfc88def5b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:29:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-340157478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f67636d9-e704-44f7-a2ad-972ba75aace3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc3e18b86dee456398aada5b169dc198',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:29:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:29:21Z,use_quota=True,user_id='ea18f1190bab494589a803742a7eb22a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:29:21 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-f6d94a5b-d271-40d5-8d55-51a7fe48ddb2 tempest-ProjectMemberTests-1570638723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73e69b6c-7c22-4ec5-bbca-31cf3297573a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:29:21 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-f6d94a5b-d271-40d5-8d55-51a7fe48ddb2 tempest-ProjectMemberTests-1570638723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73e69b6c-7c22-4ec5-bbca-31cf3297573a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:29:21 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-f6d94a5b-d271-40d5-8d55-51a7fe48ddb2 tempest-ProjectMemberTests-1570638723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52206c04-f205-4155-87de-e4ab42604a2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:29:21 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-f6d94a5b-d271-40d5-8d55-51a7fe48ddb2 tempest-ProjectMemberTests-1570638723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52206c04-f205-4155-87de-e4ab42604a2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f67636d9-e704-44f7-a2ad-972ba75aace3', 'volume_name': 'volume-f67636d9-e704-44f7-a2ad-972ba75aace3', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:29:21 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-f6d94a5b-d271-40d5-8d55-51a7fe48ddb2 tempest-ProjectMemberTests-1570638723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86dfd887-9e09-41f2-9e3d-f6166bb0d854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:29:21 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-f6d94a5b-d271-40d5-8d55-51a7fe48ddb2 tempest-ProjectMemberTests-1570638723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86dfd887-9e09-41f2-9e3d-f6166bb0d854) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:29:21 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-f6d94a5b-d271-40d5-8d55-51a7fe48ddb2 tempest-ProjectMemberTests-1570638723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (420f3c5f-27df-4daa-8a37-688072a7b65e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:29:21 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-f6d94a5b-d271-40d5-8d55-51a7fe48ddb2 tempest-ProjectMemberTests-1570638723 None] Volume f67636d9-e704-44f7-a2ad-972ba75aace3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f67636d9-e704-44f7-a2ad-972ba75aace3', 'volume_size': 1} Aug 29 01:29:21 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-f6d94a5b-d271-40d5-8d55-51a7fe48ddb2 tempest-ProjectMemberTests-1570638723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:29:21 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-568efec2-361e-4d5c-81fa-0e9cc0df918c tempest-ProjectReaderTests-1698516188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-524bfeee-c88f-42bd-bd4c-d5b98c1418cb.c321ea4a-ab43-4190-bff9-ad1f072aeb40" returned: 0 in 0.330s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:21 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-568efec2-361e-4d5c-81fa-0e9cc0df918c tempest-ProjectReaderTests-1698516188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-524bfeee-c88f-42bd-bd4c-d5b98c1418cb.info {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:21 devstack sudo[105895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-524bfeee-c88f-42bd-bd4c-d5b98c1418cb.info Aug 29 01:29:21 devstack sudo[105895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:21 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-11ca909a-d539-474b-b13f-30ec7d38336d tempest-SnapshotDependencyTests-1328723867 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:29:21 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-11ca909a-d539-474b-b13f-30ec7d38336d tempest-SnapshotDependencyTests-1328723867 None] Flow 'volume_create_manager' (d36f5a23-034a-40ab-921e-2319c84187ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:29:21 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-11ca909a-d539-474b-b13f-30ec7d38336d tempest-SnapshotDependencyTests-1328723867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64c2a43b-e94e-48b3-995c-6779ef5db76a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:29:21 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-11ca909a-d539-474b-b13f-30ec7d38336d tempest-SnapshotDependencyTests-1328723867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64c2a43b-e94e-48b3-995c-6779ef5db76a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:29:21Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ac15684-dc42-4f90-b41e-fb4a34d4dd23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8dc9a2a6f1c8491294f01226d1d173e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:29:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=bb855e83-208b-4ed2-a548-9c42f7285676,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:29:21Z,use_quota=True,user_id='5bd37772fdb04b39a80ce087db7f7698',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:29:21 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-11ca909a-d539-474b-b13f-30ec7d38336d tempest-SnapshotDependencyTests-1328723867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f064516a-4c4a-47ee-9e75-a45aac8ea6b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:29:21 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-11ca909a-d539-474b-b13f-30ec7d38336d tempest-SnapshotDependencyTests-1328723867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f064516a-4c4a-47ee-9e75-a45aac8ea6b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:29:21 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-11ca909a-d539-474b-b13f-30ec7d38336d tempest-SnapshotDependencyTests-1328723867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d94a62c9-d077-4744-8c49-7f53dc8d5438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:29:21 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-11ca909a-d539-474b-b13f-30ec7d38336d tempest-SnapshotDependencyTests-1328723867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d94a62c9-d077-4744-8c49-7f53dc8d5438) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6ac15684-dc42-4f90-b41e-fb4a34d4dd23', 'volume_name': 'volume-6ac15684-dc42-4f90-b41e-fb4a34d4dd23', 'volume_size': 1, 'snapshot_id': 'bb855e83-208b-4ed2-a548-9c42f7285676'}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:29:21 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-11ca909a-d539-474b-b13f-30ec7d38336d tempest-SnapshotDependencyTests-1328723867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56a865ff-2ea8-42d5-82d9-75a93cd9c6fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:29:21 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-11ca909a-d539-474b-b13f-30ec7d38336d tempest-SnapshotDependencyTests-1328723867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56a865ff-2ea8-42d5-82d9-75a93cd9c6fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:29:21 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-11ca909a-d539-474b-b13f-30ec7d38336d tempest-SnapshotDependencyTests-1328723867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71a3f4b2-2632-4c8d-968a-90542e1e57b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:29:21 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-11ca909a-d539-474b-b13f-30ec7d38336d tempest-SnapshotDependencyTests-1328723867 None] Volume 6ac15684-dc42-4f90-b41e-fb4a34d4dd23: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6ac15684-dc42-4f90-b41e-fb4a34d4dd23', 'volume_size': 1, 'snapshot_id': 'bb855e83-208b-4ed2-a548-9c42f7285676'} Aug 29 01:29:21 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-11ca909a-d539-474b-b13f-30ec7d38336d tempest-SnapshotDependencyTests-1328723867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:29:21 devstack sudo[105895]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:21 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-568efec2-361e-4d5c-81fa-0e9cc0df918c tempest-ProjectReaderTests-1698516188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-524bfeee-c88f-42bd-bd4c-d5b98c1418cb.info" returned: 0 in 0.258s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:21 devstack cinder-volume[86111]: WARNING cinder.volume.drivers.remotefs [None req-568efec2-361e-4d5c-81fa-0e9cc0df918c tempest-ProjectReaderTests-1698516188 None] /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-524bfeee-c88f-42bd-bd4c-d5b98c1418cb.info is being set with open permissions: ugo+rw Aug 29 01:29:21 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-568efec2-361e-4d5c-81fa-0e9cc0df918c tempest-ProjectReaderTests-1698516188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-524bfeee-c88f-42bd-bd4c-d5b98c1418cb.info {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:21 devstack sudo[105898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-524bfeee-c88f-42bd-bd4c-d5b98c1418cb.info Aug 29 01:29:21 devstack sudo[105898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:21 devstack sudo[105898]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:21 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-568efec2-361e-4d5c-81fa-0e9cc0df918c tempest-ProjectReaderTests-1698516188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-524bfeee-c88f-42bd-bd4c-d5b98c1418cb.info" returned: 0 in 0.238s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:21 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-568efec2-361e-4d5c-81fa-0e9cc0df918c tempest-ProjectReaderTests-1698516188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.013s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:29:21 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-f6d94a5b-d271-40d5-8d55-51a7fe48ddb2 tempest-ProjectMemberTests-1570638723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.545s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:29:21 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-f6d94a5b-d271-40d5-8d55-51a7fe48ddb2 tempest-ProjectMemberTests-1570638723 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:29:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-340157478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f67636d9-e704-44f7-a2ad-972ba75aace3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc3e18b86dee456398aada5b169dc198',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:29:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:29:21Z,use_quota=True,user_id='ea18f1190bab494589a803742a7eb22a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:29:21 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-f6d94a5b-d271-40d5-8d55-51a7fe48ddb2 tempest-ProjectMemberTests-1570638723 None] Creating volume f67636d9-e704-44f7-a2ad-972ba75aace3 {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:29:21 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-f6d94a5b-d271-40d5-8d55-51a7fe48ddb2 tempest-ProjectMemberTests-1570638723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:29:21 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-f6d94a5b-d271-40d5-8d55-51a7fe48ddb2 tempest-ProjectMemberTests-1570638723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:29:21 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-f6d94a5b-d271-40d5-8d55-51a7fe48ddb2 tempest-ProjectMemberTests-1570638723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:29:21 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-f6d94a5b-d271-40d5-8d55-51a7fe48ddb2 tempest-ProjectMemberTests-1570638723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:29:21 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-f6d94a5b-d271-40d5-8d55-51a7fe48ddb2 tempest-ProjectMemberTests-1570638723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:29:21 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-f6d94a5b-d271-40d5-8d55-51a7fe48ddb2 tempest-ProjectMemberTests-1570638723 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:29:21 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-f6d94a5b-d271-40d5-8d55-51a7fe48ddb2 tempest-ProjectMemberTests-1570638723 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:29:21 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-f6d94a5b-d271-40d5-8d55-51a7fe48ddb2 tempest-ProjectMemberTests-1570638723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-f67636d9-e704-44f7-a2ad-972ba75aace3 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:21 devstack sudo[105902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-f67636d9-e704-44f7-a2ad-972ba75aace3 1073741824 Aug 29 01:29:21 devstack sudo[105902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:21 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-568efec2-361e-4d5c-81fa-0e9cc0df918c tempest-ProjectReaderTests-1698516188 None] Create snapshot completed successfully Aug 29 01:29:22 devstack sudo[105902]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:22 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-f6d94a5b-d271-40d5-8d55-51a7fe48ddb2 tempest-ProjectMemberTests-1570638723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-f67636d9-e704-44f7-a2ad-972ba75aace3 1073741824" returned: 0 in 0.407s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:22 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-f6d94a5b-d271-40d5-8d55-51a7fe48ddb2 tempest-ProjectMemberTests-1570638723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-f67636d9-e704-44f7-a2ad-972ba75aace3 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:22 devstack sudo[105908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-f67636d9-e704-44f7-a2ad-972ba75aace3 Aug 29 01:29:22 devstack sudo[105908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:22 devstack sudo[105908]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:22 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-f6d94a5b-d271-40d5-8d55-51a7fe48ddb2 tempest-ProjectMemberTests-1570638723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-f67636d9-e704-44f7-a2ad-972ba75aace3" returned: 0 in 0.257s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:22 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-f6d94a5b-d271-40d5-8d55-51a7fe48ddb2 tempest-ProjectMemberTests-1570638723 None] <== create_volume: return (703ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:29:22 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-f6d94a5b-d271-40d5-8d55-51a7fe48ddb2 tempest-ProjectMemberTests-1570638723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.707s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:29:22 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-11ca909a-d539-474b-b13f-30ec7d38336d tempest-SnapshotDependencyTests-1328723867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.012s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:29:22 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-11ca909a-d539-474b-b13f-30ec7d38336d tempest-SnapshotDependencyTests-1328723867 None] Acquiring lock "cinder-quobyte-bb855e83-208b-4ed2-a548-9c42f7285676-6ac15684-dc42-4f90-b41e-fb4a34d4dd23" by "_create_volume_from_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:29:22 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-269f622e-fe85-428f-9dd2-4a566545a032 tempest-ProjectReaderTests-1698516188 None] Acquiring lock "cinder-c321ea4a-ab43-4190-bff9-ad1f072aeb40-delete_snapshot" by "delete_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:29:22 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-11ca909a-d539-474b-b13f-30ec7d38336d tempest-SnapshotDependencyTests-1328723867 None] Lock "cinder-quobyte-bb855e83-208b-4ed2-a548-9c42f7285676-6ac15684-dc42-4f90-b41e-fb4a34d4dd23" acquired by "_create_volume_from_snapshot" :: waited 0.029s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:29:22 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-11ca909a-d539-474b-b13f-30ec7d38336d tempest-SnapshotDependencyTests-1328723867 None] Creating volume 6ac15684-dc42-4f90-b41e-fb4a34d4dd23 from snapshot bb855e83-208b-4ed2-a548-9c42f7285676 {{(pid=86111) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Aug 29 01:29:22 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-11ca909a-d539-474b-b13f-30ec7d38336d tempest-SnapshotDependencyTests-1328723867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:29:22 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-11ca909a-d539-474b-b13f-30ec7d38336d tempest-SnapshotDependencyTests-1328723867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:29:22 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-11ca909a-d539-474b-b13f-30ec7d38336d tempest-SnapshotDependencyTests-1328723867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:29:22 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-11ca909a-d539-474b-b13f-30ec7d38336d tempest-SnapshotDependencyTests-1328723867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:29:22 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-11ca909a-d539-474b-b13f-30ec7d38336d tempest-SnapshotDependencyTests-1328723867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:29:22 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-11ca909a-d539-474b-b13f-30ec7d38336d tempest-SnapshotDependencyTests-1328723867 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:29:22 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-11ca909a-d539-474b-b13f-30ec7d38336d tempest-SnapshotDependencyTests-1328723867 None] Acquiring lock "cinder-quobyte-6ac15684-dc42-4f90-b41e-fb4a34d4dd23" by "_copy_volume_from_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:29:22 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-f6d94a5b-d271-40d5-8d55-51a7fe48ddb2 tempest-ProjectMemberTests-1570638723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (420f3c5f-27df-4daa-8a37-688072a7b65e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f67636d9-e704-44f7-a2ad-972ba75aace3', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:29:22 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-f6d94a5b-d271-40d5-8d55-51a7fe48ddb2 tempest-ProjectMemberTests-1570638723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fff9407f-1ccf-4a9c-8c33-61d906a5f584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:29:22 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-f6d94a5b-d271-40d5-8d55-51a7fe48ddb2 tempest-ProjectMemberTests-1570638723 None] Volume volume-f67636d9-e704-44f7-a2ad-972ba75aace3 (f67636d9-e704-44f7-a2ad-972ba75aace3): created successfully Aug 29 01:29:22 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-f6d94a5b-d271-40d5-8d55-51a7fe48ddb2 tempest-ProjectMemberTests-1570638723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fff9407f-1ccf-4a9c-8c33-61d906a5f584) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:29:22 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-f6d94a5b-d271-40d5-8d55-51a7fe48ddb2 tempest-ProjectMemberTests-1570638723 None] Flow 'volume_create_manager' (c0ee206d-3963-4848-b218-ff3829555caf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:29:22 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-269f622e-fe85-428f-9dd2-4a566545a032 tempest-ProjectReaderTests-1698516188 None] Lock "cinder-c321ea4a-ab43-4190-bff9-ad1f072aeb40-delete_snapshot" acquired by "delete_snapshot" :: waited 0.096s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:29:22 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-269f622e-fe85-428f-9dd2-4a566545a032 tempest-ProjectReaderTests-1698516188 None] Acquiring lock "cinder-quobyte-524bfeee-c88f-42bd-bd4c-d5b98c1418cb" by "delete_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:29:22 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-11ca909a-d539-474b-b13f-30ec7d38336d tempest-SnapshotDependencyTests-1328723867 None] Lock "cinder-quobyte-6ac15684-dc42-4f90-b41e-fb4a34d4dd23" acquired by "_copy_volume_from_snapshot" :: waited 0.088s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:29:22 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-11ca909a-d539-474b-b13f-30ec7d38336d tempest-SnapshotDependencyTests-1328723867 None] snapshot: bb855e83-208b-4ed2-a548-9c42f7285676, volume: 6ac15684-dc42-4f90-b41e-fb4a34d4dd23, {{(pid=86111) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 29 01:29:22 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-f6d94a5b-d271-40d5-8d55-51a7fe48ddb2 tempest-ProjectMemberTests-1570638723 None] Created volume successfully. Aug 29 01:29:22 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-11ca909a-d539-474b-b13f-30ec7d38336d tempest-SnapshotDependencyTests-1328723867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:29:22 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-11ca909a-d539-474b-b13f-30ec7d38336d tempest-SnapshotDependencyTests-1328723867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:29:22 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-11ca909a-d539-474b-b13f-30ec7d38336d tempest-SnapshotDependencyTests-1328723867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:29:22 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-11ca909a-d539-474b-b13f-30ec7d38336d tempest-SnapshotDependencyTests-1328723867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:29:22 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-11ca909a-d539-474b-b13f-30ec7d38336d tempest-SnapshotDependencyTests-1328723867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:29:22 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-269f622e-fe85-428f-9dd2-4a566545a032 tempest-ProjectReaderTests-1698516188 None] Lock "cinder-quobyte-524bfeee-c88f-42bd-bd4c-d5b98c1418cb" acquired by "delete_snapshot" :: waited 0.047s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:29:22 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-269f622e-fe85-428f-9dd2-4a566545a032 tempest-ProjectReaderTests-1698516188 None] Acquiring lock "cinder-quobyte-c321ea4a-ab43-4190-bff9-ad1f072aeb40" by "_delete_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:29:22 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e6fecb4-224c-444a-9986-6c836bb457cd]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:29:22 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-11ca909a-d539-474b-b13f-30ec7d38336d tempest-SnapshotDependencyTests-1328723867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ab6562a3-d834-46a3-b24b-4666d0cfbdec.bb855e83-208b-4ed2-a548-9c42f7285676 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:22 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-269f622e-fe85-428f-9dd2-4a566545a032 tempest-ProjectReaderTests-1698516188 None] Lock "cinder-quobyte-c321ea4a-ab43-4190-bff9-ad1f072aeb40" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:29:22 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-269f622e-fe85-428f-9dd2-4a566545a032 tempest-ProjectReaderTests-1698516188 None] Deleting offline snapshot c321ea4a-ab43-4190-bff9-ad1f072aeb40 of volume 524bfeee-c88f-42bd-bd4c-d5b98c1418cb {{(pid=86111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 29 01:29:22 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-269f622e-fe85-428f-9dd2-4a566545a032 tempest-ProjectReaderTests-1698516188 None] snapshot_file for this snap is: volume-524bfeee-c88f-42bd-bd4c-d5b98c1418cb.c321ea4a-ab43-4190-bff9-ad1f072aeb40 {{(pid=86111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 29 01:29:22 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[73e43dcf-ceac-4eca-b6ad-cb9097c82a9e]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:29:22 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-269f622e-fe85-428f-9dd2-4a566545a032 tempest-ProjectReaderTests-1698516188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-524bfeee-c88f-42bd-bd4c-d5b98c1418cb.c321ea4a-ab43-4190-bff9-ad1f072aeb40 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:22 devstack sudo[105911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ab6562a3-d834-46a3-b24b-4666d0cfbdec.bb855e83-208b-4ed2-a548-9c42f7285676 Aug 29 01:29:22 devstack sudo[105911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:22 devstack sudo[105912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-524bfeee-c88f-42bd-bd4c-d5b98c1418cb.c321ea4a-ab43-4190-bff9-ad1f072aeb40 Aug 29 01:29:22 devstack sudo[105912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:23 devstack sudo[105911]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:23 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-11ca909a-d539-474b-b13f-30ec7d38336d tempest-SnapshotDependencyTests-1328723867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ab6562a3-d834-46a3-b24b-4666d0cfbdec.bb855e83-208b-4ed2-a548-9c42f7285676" returned: 0 in 0.385s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:23 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-11ca909a-d539-474b-b13f-30ec7d38336d tempest-SnapshotDependencyTests-1328723867 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab6562a3-d834-46a3-b24b-4666d0cfbdec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 29 01:29:23 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dd7b44c-0159-4a8e-befc-1271ebe2dfc4]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:29:23 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-11ca909a-d539-474b-b13f-30ec7d38336d tempest-SnapshotDependencyTests-1328723867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ab6562a3-d834-46a3-b24b-4666d0cfbdec {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:23 devstack sudo[105912]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:23 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-269f622e-fe85-428f-9dd2-4a566545a032 tempest-ProjectReaderTests-1698516188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-524bfeee-c88f-42bd-bd4c-d5b98c1418cb.c321ea4a-ab43-4190-bff9-ad1f072aeb40" returned: 0 in 0.373s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:23 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-269f622e-fe85-428f-9dd2-4a566545a032 tempest-ProjectReaderTests-1698516188 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-524bfeee-c88f-42bd-bd4c-d5b98c1418cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 29 01:29:23 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[00d3896c-a0e1-408c-bcb4-f57137da5ebc]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:29:23 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-269f622e-fe85-428f-9dd2-4a566545a032 tempest-ProjectReaderTests-1698516188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-524bfeee-c88f-42bd-bd4c-d5b98c1418cb {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:23 devstack sudo[105927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ab6562a3-d834-46a3-b24b-4666d0cfbdec Aug 29 01:29:23 devstack sudo[105927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:23 devstack sudo[105928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-524bfeee-c88f-42bd-bd4c-d5b98c1418cb Aug 29 01:29:23 devstack sudo[105928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:23 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-c9308c77-23f9-40d1-a33c-602268b6fd07 tempest-ProjectMemberTests-1570638723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:29:23 devstack sudo[105927]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:23 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-11ca909a-d539-474b-b13f-30ec7d38336d tempest-SnapshotDependencyTests-1328723867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ab6562a3-d834-46a3-b24b-4666d0cfbdec" returned: 0 in 0.424s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:23 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-11ca909a-d539-474b-b13f-30ec7d38336d tempest-SnapshotDependencyTests-1328723867 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ab6562a3-d834-46a3-b24b-4666d0cfbdec {{(pid=86111) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 29 01:29:23 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-11ca909a-d539-474b-b13f-30ec7d38336d tempest-SnapshotDependencyTests-1328723867 None] Creating direct copy from snapshot {{(pid=86111) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 29 01:29:23 devstack cinder-volume[86111]: DEBUG cinder.utils [None req-11ca909a-d539-474b-b13f-30ec7d38336d tempest-SnapshotDependencyTests-1328723867 None] Path /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-6ac15684-dc42-4f90-b41e-fb4a34d4dd23 not found in is_blk_device check {{(pid=86111) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 29 01:29:23 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-11ca909a-d539-474b-b13f-30ec7d38336d tempest-SnapshotDependencyTests-1328723867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ab6562a3-d834-46a3-b24b-4666d0cfbdec /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-6ac15684-dc42-4f90-b41e-fb4a34d4dd23 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:23 devstack sudo[105938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ab6562a3-d834-46a3-b24b-4666d0cfbdec /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-6ac15684-dc42-4f90-b41e-fb4a34d4dd23 Aug 29 01:29:23 devstack sudo[105938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:23 devstack sudo[105928]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:23 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-269f622e-fe85-428f-9dd2-4a566545a032 tempest-ProjectReaderTests-1698516188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-524bfeee-c88f-42bd-bd4c-d5b98c1418cb" returned: 0 in 0.402s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:23 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-269f622e-fe85-428f-9dd2-4a566545a032 tempest-ProjectReaderTests-1698516188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-524bfeee-c88f-42bd-bd4c-d5b98c1418cb.c321ea4a-ab43-4190-bff9-ad1f072aeb40 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:23 devstack sudo[105940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-524bfeee-c88f-42bd-bd4c-d5b98c1418cb.c321ea4a-ab43-4190-bff9-ad1f072aeb40 Aug 29 01:29:23 devstack sudo[105940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:23 devstack sudo[105940]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:23 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-269f622e-fe85-428f-9dd2-4a566545a032 tempest-ProjectReaderTests-1698516188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-524bfeee-c88f-42bd-bd4c-d5b98c1418cb.c321ea4a-ab43-4190-bff9-ad1f072aeb40" returned: 0 in 0.352s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:23 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-269f622e-fe85-428f-9dd2-4a566545a032 tempest-ProjectReaderTests-1698516188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-524bfeee-c88f-42bd-bd4c-d5b98c1418cb.c321ea4a-ab43-4190-bff9-ad1f072aeb40 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:24 devstack sudo[105950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-524bfeee-c88f-42bd-bd4c-d5b98c1418cb.c321ea4a-ab43-4190-bff9-ad1f072aeb40 Aug 29 01:29:24 devstack sudo[105950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:24 devstack sudo[105950]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:24 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-269f622e-fe85-428f-9dd2-4a566545a032 tempest-ProjectReaderTests-1698516188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-524bfeee-c88f-42bd-bd4c-d5b98c1418cb.c321ea4a-ab43-4190-bff9-ad1f072aeb40" returned: 0 in 0.337s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:24 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-269f622e-fe85-428f-9dd2-4a566545a032 tempest-ProjectReaderTests-1698516188 None] Lock "cinder-quobyte-c321ea4a-ab43-4190-bff9-ad1f072aeb40" released by "_delete_snapshot" :: held 1.614s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:29:24 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-269f622e-fe85-428f-9dd2-4a566545a032 tempest-ProjectReaderTests-1698516188 None] Lock "cinder-quobyte-524bfeee-c88f-42bd-bd4c-d5b98c1418cb" released by "delete_snapshot" :: held 1.662s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:29:24 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-269f622e-fe85-428f-9dd2-4a566545a032 tempest-ProjectReaderTests-1698516188 None] Created reservations ['64a273f1-b1a6-4c9e-8989-a96dc12836ed', '99d28e81-f74a-481c-891f-a4d6103fcccc', '7b47ffc3-876c-4223-bbfb-2b9006c49f3b', '9b3ea78d-b09a-4a93-8d2f-caa3090ca54a'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:29:24 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-269f622e-fe85-428f-9dd2-4a566545a032 tempest-ProjectReaderTests-1698516188 None] Delete snapshot completed successfully. Aug 29 01:29:24 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-269f622e-fe85-428f-9dd2-4a566545a032 tempest-ProjectReaderTests-1698516188 None] Lock "cinder-c321ea4a-ab43-4190-bff9-ad1f072aeb40-delete_snapshot" released by "delete_snapshot" :: held 2.071s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:29:24 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-5f136e61-520a-4e3d-8d6f-0189ec1e371e tempest-ProjectReaderTests-1698516188 None] Acquiring lock "cinder-524bfeee-c88f-42bd-bd4c-d5b98c1418cb-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:29:24 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-5f136e61-520a-4e3d-8d6f-0189ec1e371e tempest-ProjectReaderTests-1698516188 None] Lock "cinder-524bfeee-c88f-42bd-bd4c-d5b98c1418cb-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:29:25 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-5f136e61-520a-4e3d-8d6f-0189ec1e371e tempest-ProjectReaderTests-1698516188 None] Acquiring lock "cinder-quobyte-524bfeee-c88f-42bd-bd4c-d5b98c1418cb" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:29:25 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-5f136e61-520a-4e3d-8d6f-0189ec1e371e tempest-ProjectReaderTests-1698516188 None] Lock "cinder-quobyte-524bfeee-c88f-42bd-bd4c-d5b98c1418cb" acquired by "delete_volume" :: waited 0.028s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:29:25 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[67d8d3cd-1f40-484e-aa37-b4d6422c2bc9]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:29:25 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-5f136e61-520a-4e3d-8d6f-0189ec1e371e tempest-ProjectReaderTests-1698516188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-524bfeee-c88f-42bd-bd4c-d5b98c1418cb {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:25 devstack sudo[105961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-524bfeee-c88f-42bd-bd4c-d5b98c1418cb Aug 29 01:29:25 devstack sudo[105961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:26 devstack sudo[105961]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:26 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-5f136e61-520a-4e3d-8d6f-0189ec1e371e tempest-ProjectReaderTests-1698516188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-524bfeee-c88f-42bd-bd4c-d5b98c1418cb" returned: 0 in 0.865s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:26 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-5f136e61-520a-4e3d-8d6f-0189ec1e371e tempest-ProjectReaderTests-1698516188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-524bfeee-c88f-42bd-bd4c-d5b98c1418cb {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:26 devstack sudo[105966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-524bfeee-c88f-42bd-bd4c-d5b98c1418cb Aug 29 01:29:26 devstack sudo[105966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:26 devstack sudo[105966]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:26 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-5f136e61-520a-4e3d-8d6f-0189ec1e371e tempest-ProjectReaderTests-1698516188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-524bfeee-c88f-42bd-bd4c-d5b98c1418cb" returned: 0 in 0.572s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:26 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-5f136e61-520a-4e3d-8d6f-0189ec1e371e tempest-ProjectReaderTests-1698516188 None] Lock "cinder-quobyte-524bfeee-c88f-42bd-bd4c-d5b98c1418cb" released by "delete_volume" :: held 1.583s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:29:26 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-5f136e61-520a-4e3d-8d6f-0189ec1e371e tempest-ProjectReaderTests-1698516188 None] Created reservations ['a514e94d-7b73-4fa6-9d2b-8feb10c0d79e', 'e8c60627-449b-4279-8b81-d37c6e8f9b4b', 'f1b740a8-79b5-4b53-987d-fe2330894ca4', '2d850e7e-62ff-4f9b-bab3-305006f8092a'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:29:26 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-5f136e61-520a-4e3d-8d6f-0189ec1e371e tempest-ProjectReaderTests-1698516188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:29:26 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-5f136e61-520a-4e3d-8d6f-0189ec1e371e tempest-ProjectReaderTests-1698516188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:29:26 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-5f136e61-520a-4e3d-8d6f-0189ec1e371e tempest-ProjectReaderTests-1698516188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:29:26 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-5f136e61-520a-4e3d-8d6f-0189ec1e371e tempest-ProjectReaderTests-1698516188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:29:26 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-5f136e61-520a-4e3d-8d6f-0189ec1e371e tempest-ProjectReaderTests-1698516188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:29:26 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-5f136e61-520a-4e3d-8d6f-0189ec1e371e tempest-ProjectReaderTests-1698516188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:26 devstack sudo[105969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:29:26 devstack sudo[105969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:27 devstack sudo[105969]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:27 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-5f136e61-520a-4e3d-8d6f-0189ec1e371e tempest-ProjectReaderTests-1698516188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.592s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:27 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-5f136e61-520a-4e3d-8d6f-0189ec1e371e tempest-ProjectReaderTests-1698516188 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:29:27 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-5f136e61-520a-4e3d-8d6f-0189ec1e371e tempest-ProjectReaderTests-1698516188 None] Deleted volume successfully. Aug 29 01:29:27 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-5f136e61-520a-4e3d-8d6f-0189ec1e371e tempest-ProjectReaderTests-1698516188 None] Lock "cinder-524bfeee-c88f-42bd-bd4c-d5b98c1418cb-delete_volume" released by "delete_volume" :: held 2.621s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:29:28 devstack sudo[105938]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:28 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-11ca909a-d539-474b-b13f-30ec7d38336d tempest-SnapshotDependencyTests-1328723867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ab6562a3-d834-46a3-b24b-4666d0cfbdec /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-6ac15684-dc42-4f90-b41e-fb4a34d4dd23" returned: 0 in 4.853s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:28 devstack cinder-volume[86111]: DEBUG cinder.image.image_utils [None req-11ca909a-d539-474b-b13f-30ec7d38336d tempest-SnapshotDependencyTests-1328723867 None] Image conversion details: src /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ab6562a3-d834-46a3-b24b-4666d0cfbdec, size 1024.00 MB, duration 4.85 sec, destination /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-6ac15684-dc42-4f90-b41e-fb4a34d4dd23 {{(pid=86111) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 29 01:29:28 devstack cinder-volume[86111]: INFO cinder.image.image_utils [None req-11ca909a-d539-474b-b13f-30ec7d38336d tempest-SnapshotDependencyTests-1328723867 None] Converted 1024.00 MB image at 210.97 MB/s Aug 29 01:29:28 devstack cinder-volume[86111]: WARNING cinder.volume.drivers.remotefs [None req-11ca909a-d539-474b-b13f-30ec7d38336d tempest-SnapshotDependencyTests-1328723867 None] /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-6ac15684-dc42-4f90-b41e-fb4a34d4dd23 is being set with open permissions: ugo+rw Aug 29 01:29:28 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-11ca909a-d539-474b-b13f-30ec7d38336d tempest-SnapshotDependencyTests-1328723867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-6ac15684-dc42-4f90-b41e-fb4a34d4dd23 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:28 devstack sudo[105972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-6ac15684-dc42-4f90-b41e-fb4a34d4dd23 Aug 29 01:29:28 devstack sudo[105972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:28 devstack sudo[105972]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:28 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-11ca909a-d539-474b-b13f-30ec7d38336d tempest-SnapshotDependencyTests-1328723867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-6ac15684-dc42-4f90-b41e-fb4a34d4dd23" returned: 0 in 0.251s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:28 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-11ca909a-d539-474b-b13f-30ec7d38336d tempest-SnapshotDependencyTests-1328723867 None] Lock "cinder-quobyte-6ac15684-dc42-4f90-b41e-fb4a34d4dd23" released by "_copy_volume_from_snapshot" :: held 6.006s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:29:28 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-11ca909a-d539-474b-b13f-30ec7d38336d tempest-SnapshotDependencyTests-1328723867 None] Lock "cinder-quobyte-bb855e83-208b-4ed2-a548-9c42f7285676-6ac15684-dc42-4f90-b41e-fb4a34d4dd23" released by "_create_volume_from_snapshot" :: held 6.145s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:29:28 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-11ca909a-d539-474b-b13f-30ec7d38336d tempest-SnapshotDependencyTests-1328723867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.176s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:29:28 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-c9308c77-23f9-40d1-a33c-602268b6fd07 tempest-ProjectMemberTests-1570638723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.224s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:29:28 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-c9308c77-23f9-40d1-a33c-602268b6fd07 tempest-ProjectMemberTests-1570638723 None] Creating offline snapshot c0127ecf-c3d2-441c-a208-9b3dc51cb476 of volume f67636d9-e704-44f7-a2ad-972ba75aace3 {{(pid=86111) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 29 01:29:28 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-11ca909a-d539-474b-b13f-30ec7d38336d tempest-SnapshotDependencyTests-1328723867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71a3f4b2-2632-4c8d-968a-90542e1e57b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ac15684-dc42-4f90-b41e-fb4a34d4dd23', 'volume_size': 1, 'snapshot_id': 'bb855e83-208b-4ed2-a548-9c42f7285676'}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:29:28 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-11ca909a-d539-474b-b13f-30ec7d38336d tempest-SnapshotDependencyTests-1328723867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de980425-c525-4ec0-a171-b26c231ee930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:29:28 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7616836-f18a-4ba3-a044-bffc80e6e768]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:29:28 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c9308c77-23f9-40d1-a33c-602268b6fd07 tempest-ProjectMemberTests-1570638723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-f67636d9-e704-44f7-a2ad-972ba75aace3 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:28 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-11ca909a-d539-474b-b13f-30ec7d38336d tempest-SnapshotDependencyTests-1328723867 None] Volume volume-6ac15684-dc42-4f90-b41e-fb4a34d4dd23 (6ac15684-dc42-4f90-b41e-fb4a34d4dd23): created successfully Aug 29 01:29:28 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-11ca909a-d539-474b-b13f-30ec7d38336d tempest-SnapshotDependencyTests-1328723867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de980425-c525-4ec0-a171-b26c231ee930) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:29:28 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-11ca909a-d539-474b-b13f-30ec7d38336d tempest-SnapshotDependencyTests-1328723867 None] Flow 'volume_create_manager' (d36f5a23-034a-40ab-921e-2319c84187ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:29:28 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-11ca909a-d539-474b-b13f-30ec7d38336d tempest-SnapshotDependencyTests-1328723867 None] Created volume successfully. Aug 29 01:29:28 devstack sudo[105975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-f67636d9-e704-44f7-a2ad-972ba75aace3 Aug 29 01:29:28 devstack sudo[105975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:29 devstack sudo[105975]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:29 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c9308c77-23f9-40d1-a33c-602268b6fd07 tempest-ProjectMemberTests-1570638723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-f67636d9-e704-44f7-a2ad-972ba75aace3" returned: 0 in 0.383s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:29 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c9308c77-23f9-40d1-a33c-602268b6fd07 tempest-ProjectMemberTests-1570638723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-f67636d9-e704-44f7-a2ad-972ba75aace3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-f67636d9-e704-44f7-a2ad-972ba75aace3.c0127ecf-c3d2-441c-a208-9b3dc51cb476 1G {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:29 devstack sudo[105980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-f67636d9-e704-44f7-a2ad-972ba75aace3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-f67636d9-e704-44f7-a2ad-972ba75aace3.c0127ecf-c3d2-441c-a208-9b3dc51cb476 1G Aug 29 01:29:29 devstack sudo[105980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:29 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-bfceed19-6071-4ea4-8499-7ceb1654b5d4 tempest-SnapshotDependencyTests-1328723867 None] Acquiring lock "cinder-bb855e83-208b-4ed2-a548-9c42f7285676-delete_snapshot" by "delete_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:29:29 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-bfceed19-6071-4ea4-8499-7ceb1654b5d4 tempest-SnapshotDependencyTests-1328723867 None] Lock "cinder-bb855e83-208b-4ed2-a548-9c42f7285676-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:29:29 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-bfceed19-6071-4ea4-8499-7ceb1654b5d4 tempest-SnapshotDependencyTests-1328723867 None] Acquiring lock "cinder-quobyte-ab6562a3-d834-46a3-b24b-4666d0cfbdec" by "delete_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:29:29 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-bfceed19-6071-4ea4-8499-7ceb1654b5d4 tempest-SnapshotDependencyTests-1328723867 None] Lock "cinder-quobyte-ab6562a3-d834-46a3-b24b-4666d0cfbdec" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:29:29 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-bfceed19-6071-4ea4-8499-7ceb1654b5d4 tempest-SnapshotDependencyTests-1328723867 None] Acquiring lock "cinder-quobyte-bb855e83-208b-4ed2-a548-9c42f7285676" by "_delete_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:29:29 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-bfceed19-6071-4ea4-8499-7ceb1654b5d4 tempest-SnapshotDependencyTests-1328723867 None] Lock "cinder-quobyte-bb855e83-208b-4ed2-a548-9c42f7285676" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:29:29 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-bfceed19-6071-4ea4-8499-7ceb1654b5d4 tempest-SnapshotDependencyTests-1328723867 None] Deleting offline snapshot bb855e83-208b-4ed2-a548-9c42f7285676 of volume ab6562a3-d834-46a3-b24b-4666d0cfbdec {{(pid=86111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 29 01:29:29 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-bfceed19-6071-4ea4-8499-7ceb1654b5d4 tempest-SnapshotDependencyTests-1328723867 None] snapshot_file for this snap is: volume-ab6562a3-d834-46a3-b24b-4666d0cfbdec.bb855e83-208b-4ed2-a548-9c42f7285676 {{(pid=86111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 29 01:29:29 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b933339-7046-45ad-a0cd-e42879f08739]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:29:29 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-bfceed19-6071-4ea4-8499-7ceb1654b5d4 tempest-SnapshotDependencyTests-1328723867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ab6562a3-d834-46a3-b24b-4666d0cfbdec.bb855e83-208b-4ed2-a548-9c42f7285676 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:29 devstack sudo[105986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ab6562a3-d834-46a3-b24b-4666d0cfbdec.bb855e83-208b-4ed2-a548-9c42f7285676 Aug 29 01:29:29 devstack sudo[105986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:29 devstack sudo[105980]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:29 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c9308c77-23f9-40d1-a33c-602268b6fd07 tempest-ProjectMemberTests-1570638723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-f67636d9-e704-44f7-a2ad-972ba75aace3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-f67636d9-e704-44f7-a2ad-972ba75aace3.c0127ecf-c3d2-441c-a208-9b3dc51cb476 1G" returned: 0 in 0.486s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:29 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c9308c77-23f9-40d1-a33c-602268b6fd07 tempest-ProjectMemberTests-1570638723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f67636d9-e704-44f7-a2ad-972ba75aace3 -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-f67636d9-e704-44f7-a2ad-972ba75aace3.c0127ecf-c3d2-441c-a208-9b3dc51cb476 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:29 devstack sudo[105989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f67636d9-e704-44f7-a2ad-972ba75aace3 -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-f67636d9-e704-44f7-a2ad-972ba75aace3.c0127ecf-c3d2-441c-a208-9b3dc51cb476 Aug 29 01:29:29 devstack sudo[105989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:29 devstack sudo[105986]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:29 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-bfceed19-6071-4ea4-8499-7ceb1654b5d4 tempest-SnapshotDependencyTests-1328723867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ab6562a3-d834-46a3-b24b-4666d0cfbdec.bb855e83-208b-4ed2-a548-9c42f7285676" returned: 0 in 0.421s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:29 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-bfceed19-6071-4ea4-8499-7ceb1654b5d4 tempest-SnapshotDependencyTests-1328723867 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab6562a3-d834-46a3-b24b-4666d0cfbdec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 29 01:29:29 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[f290c8dd-b44e-4b48-b60c-0efadf70071d]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:29:29 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-bfceed19-6071-4ea4-8499-7ceb1654b5d4 tempest-SnapshotDependencyTests-1328723867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ab6562a3-d834-46a3-b24b-4666d0cfbdec {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:29 devstack sudo[105989]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:29 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c9308c77-23f9-40d1-a33c-602268b6fd07 tempest-ProjectMemberTests-1570638723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f67636d9-e704-44f7-a2ad-972ba75aace3 -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-f67636d9-e704-44f7-a2ad-972ba75aace3.c0127ecf-c3d2-441c-a208-9b3dc51cb476" returned: 0 in 0.321s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:30 devstack cinder-volume[86111]: WARNING cinder.volume.drivers.remotefs [None req-c9308c77-23f9-40d1-a33c-602268b6fd07 tempest-ProjectMemberTests-1570638723 None] /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-f67636d9-e704-44f7-a2ad-972ba75aace3.c0127ecf-c3d2-441c-a208-9b3dc51cb476 is being set with open permissions: ugo+rw Aug 29 01:29:30 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c9308c77-23f9-40d1-a33c-602268b6fd07 tempest-ProjectMemberTests-1570638723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-f67636d9-e704-44f7-a2ad-972ba75aace3.c0127ecf-c3d2-441c-a208-9b3dc51cb476 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:30 devstack sudo[105995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ab6562a3-d834-46a3-b24b-4666d0cfbdec Aug 29 01:29:30 devstack sudo[105995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:30 devstack sudo[105998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-f67636d9-e704-44f7-a2ad-972ba75aace3.c0127ecf-c3d2-441c-a208-9b3dc51cb476 Aug 29 01:29:30 devstack sudo[105998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:30 devstack sudo[105998]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:30 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c9308c77-23f9-40d1-a33c-602268b6fd07 tempest-ProjectMemberTests-1570638723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-f67636d9-e704-44f7-a2ad-972ba75aace3.c0127ecf-c3d2-441c-a208-9b3dc51cb476" returned: 0 in 0.273s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:30 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c9308c77-23f9-40d1-a33c-602268b6fd07 tempest-ProjectMemberTests-1570638723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-f67636d9-e704-44f7-a2ad-972ba75aace3.info {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:30 devstack sudo[106004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-f67636d9-e704-44f7-a2ad-972ba75aace3.info Aug 29 01:29:30 devstack sudo[106004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:30 devstack sudo[105995]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:30 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-bfceed19-6071-4ea4-8499-7ceb1654b5d4 tempest-SnapshotDependencyTests-1328723867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ab6562a3-d834-46a3-b24b-4666d0cfbdec" returned: 0 in 0.580s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:30 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-bfceed19-6071-4ea4-8499-7ceb1654b5d4 tempest-SnapshotDependencyTests-1328723867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ab6562a3-d834-46a3-b24b-4666d0cfbdec.bb855e83-208b-4ed2-a548-9c42f7285676 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:30 devstack sudo[106007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ab6562a3-d834-46a3-b24b-4666d0cfbdec.bb855e83-208b-4ed2-a548-9c42f7285676 Aug 29 01:29:30 devstack sudo[106007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:30 devstack sudo[106004]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:30 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c9308c77-23f9-40d1-a33c-602268b6fd07 tempest-ProjectMemberTests-1570638723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-f67636d9-e704-44f7-a2ad-972ba75aace3.info" returned: 0 in 0.273s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:30 devstack cinder-volume[86111]: WARNING cinder.volume.drivers.remotefs [None req-c9308c77-23f9-40d1-a33c-602268b6fd07 tempest-ProjectMemberTests-1570638723 None] /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-f67636d9-e704-44f7-a2ad-972ba75aace3.info is being set with open permissions: ugo+rw Aug 29 01:29:30 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c9308c77-23f9-40d1-a33c-602268b6fd07 tempest-ProjectMemberTests-1570638723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-f67636d9-e704-44f7-a2ad-972ba75aace3.info {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:30 devstack sudo[106010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-f67636d9-e704-44f7-a2ad-972ba75aace3.info Aug 29 01:29:30 devstack sudo[106010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:30 devstack sudo[106010]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:30 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-c9308c77-23f9-40d1-a33c-602268b6fd07 tempest-ProjectMemberTests-1570638723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-f67636d9-e704-44f7-a2ad-972ba75aace3.info" returned: 0 in 0.250s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:30 devstack sudo[106007]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:30 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-c9308c77-23f9-40d1-a33c-602268b6fd07 tempest-ProjectMemberTests-1570638723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.083s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:29:30 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-bfceed19-6071-4ea4-8499-7ceb1654b5d4 tempest-SnapshotDependencyTests-1328723867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ab6562a3-d834-46a3-b24b-4666d0cfbdec.bb855e83-208b-4ed2-a548-9c42f7285676" returned: 0 in 0.367s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:30 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-bfceed19-6071-4ea4-8499-7ceb1654b5d4 tempest-SnapshotDependencyTests-1328723867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ab6562a3-d834-46a3-b24b-4666d0cfbdec.bb855e83-208b-4ed2-a548-9c42f7285676 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:30 devstack sudo[106017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ab6562a3-d834-46a3-b24b-4666d0cfbdec.bb855e83-208b-4ed2-a548-9c42f7285676 Aug 29 01:29:30 devstack sudo[106017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:30 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-c9308c77-23f9-40d1-a33c-602268b6fd07 tempest-ProjectMemberTests-1570638723 None] Create snapshot completed successfully Aug 29 01:29:31 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-8b404597-cbc8-4040-b8db-5c9aa36797de tempest-ProjectMemberTests-1570638723 None] Acquiring lock "cinder-c0127ecf-c3d2-441c-a208-9b3dc51cb476-delete_snapshot" by "delete_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:29:31 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-8b404597-cbc8-4040-b8db-5c9aa36797de tempest-ProjectMemberTests-1570638723 None] Lock "cinder-c0127ecf-c3d2-441c-a208-9b3dc51cb476-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:29:31 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-8b404597-cbc8-4040-b8db-5c9aa36797de tempest-ProjectMemberTests-1570638723 None] Acquiring lock "cinder-quobyte-f67636d9-e704-44f7-a2ad-972ba75aace3" by "delete_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:29:31 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-8b404597-cbc8-4040-b8db-5c9aa36797de tempest-ProjectMemberTests-1570638723 None] Lock "cinder-quobyte-f67636d9-e704-44f7-a2ad-972ba75aace3" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:29:31 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-8b404597-cbc8-4040-b8db-5c9aa36797de tempest-ProjectMemberTests-1570638723 None] Acquiring lock "cinder-quobyte-c0127ecf-c3d2-441c-a208-9b3dc51cb476" by "_delete_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:29:31 devstack sudo[106017]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:31 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-bfceed19-6071-4ea4-8499-7ceb1654b5d4 tempest-SnapshotDependencyTests-1328723867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ab6562a3-d834-46a3-b24b-4666d0cfbdec.bb855e83-208b-4ed2-a548-9c42f7285676" returned: 0 in 0.296s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:31 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-8b404597-cbc8-4040-b8db-5c9aa36797de tempest-ProjectMemberTests-1570638723 None] Lock "cinder-quobyte-c0127ecf-c3d2-441c-a208-9b3dc51cb476" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:29:31 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-8b404597-cbc8-4040-b8db-5c9aa36797de tempest-ProjectMemberTests-1570638723 None] Deleting offline snapshot c0127ecf-c3d2-441c-a208-9b3dc51cb476 of volume f67636d9-e704-44f7-a2ad-972ba75aace3 {{(pid=86111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 29 01:29:31 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-8b404597-cbc8-4040-b8db-5c9aa36797de tempest-ProjectMemberTests-1570638723 None] snapshot_file for this snap is: volume-f67636d9-e704-44f7-a2ad-972ba75aace3.c0127ecf-c3d2-441c-a208-9b3dc51cb476 {{(pid=86111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 29 01:29:31 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[d26f926a-82b2-4d97-86fe-fbf3b1dd2ac3]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:29:31 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8b404597-cbc8-4040-b8db-5c9aa36797de tempest-ProjectMemberTests-1570638723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-f67636d9-e704-44f7-a2ad-972ba75aace3.c0127ecf-c3d2-441c-a208-9b3dc51cb476 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:31 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-bfceed19-6071-4ea4-8499-7ceb1654b5d4 tempest-SnapshotDependencyTests-1328723867 None] Lock "cinder-quobyte-bb855e83-208b-4ed2-a548-9c42f7285676" released by "_delete_snapshot" :: held 1.808s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:29:31 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-bfceed19-6071-4ea4-8499-7ceb1654b5d4 tempest-SnapshotDependencyTests-1328723867 None] Lock "cinder-quobyte-ab6562a3-d834-46a3-b24b-4666d0cfbdec" released by "delete_snapshot" :: held 1.843s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:29:31 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-bfceed19-6071-4ea4-8499-7ceb1654b5d4 tempest-SnapshotDependencyTests-1328723867 None] Created reservations ['74396c68-0e2e-4553-a7dc-3125320bb066', '0bc423b8-a41b-431b-b1b0-57836d734384', '49c1d5b9-e1be-481d-a624-5fb6ef7aadb8', '59db0e0b-08e8-4c11-8cb3-514b50c459c1'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:29:31 devstack sudo[106020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-f67636d9-e704-44f7-a2ad-972ba75aace3.c0127ecf-c3d2-441c-a208-9b3dc51cb476 Aug 29 01:29:31 devstack sudo[106020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:31 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-bfceed19-6071-4ea4-8499-7ceb1654b5d4 tempest-SnapshotDependencyTests-1328723867 None] Delete snapshot completed successfully. Aug 29 01:29:31 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-bfceed19-6071-4ea4-8499-7ceb1654b5d4 tempest-SnapshotDependencyTests-1328723867 None] Lock "cinder-bb855e83-208b-4ed2-a548-9c42f7285676-delete_snapshot" released by "delete_snapshot" :: held 2.017s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:29:31 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-13da8eeb-6d27-432e-bd51-1cdbed910dbe tempest-SnapshotDependencyTests-1328723867 None] Acquiring lock "cinder-ab6562a3-d834-46a3-b24b-4666d0cfbdec-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:29:31 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-13da8eeb-6d27-432e-bd51-1cdbed910dbe tempest-SnapshotDependencyTests-1328723867 None] Lock "cinder-ab6562a3-d834-46a3-b24b-4666d0cfbdec-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:29:31 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-13da8eeb-6d27-432e-bd51-1cdbed910dbe tempest-SnapshotDependencyTests-1328723867 None] Acquiring lock "cinder-quobyte-ab6562a3-d834-46a3-b24b-4666d0cfbdec" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:29:31 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-13da8eeb-6d27-432e-bd51-1cdbed910dbe tempest-SnapshotDependencyTests-1328723867 None] Lock "cinder-quobyte-ab6562a3-d834-46a3-b24b-4666d0cfbdec" acquired by "delete_volume" :: waited 0.016s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:29:31 devstack sudo[106020]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:31 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8b404597-cbc8-4040-b8db-5c9aa36797de tempest-ProjectMemberTests-1570638723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-f67636d9-e704-44f7-a2ad-972ba75aace3.c0127ecf-c3d2-441c-a208-9b3dc51cb476" returned: 0 in 0.429s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:31 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-8b404597-cbc8-4040-b8db-5c9aa36797de tempest-ProjectMemberTests-1570638723 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f67636d9-e704-44f7-a2ad-972ba75aace3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 29 01:29:31 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cce504b-870d-4a28-94e7-233f5bd313ab]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:29:31 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-13da8eeb-6d27-432e-bd51-1cdbed910dbe tempest-SnapshotDependencyTests-1328723867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ab6562a3-d834-46a3-b24b-4666d0cfbdec {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:31 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b9dfe60-7145-405b-8e63-a3d3294a5f0c]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:29:31 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8b404597-cbc8-4040-b8db-5c9aa36797de tempest-ProjectMemberTests-1570638723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-f67636d9-e704-44f7-a2ad-972ba75aace3 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:31 devstack sudo[106025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ab6562a3-d834-46a3-b24b-4666d0cfbdec Aug 29 01:29:31 devstack sudo[106025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:31 devstack sudo[106026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-f67636d9-e704-44f7-a2ad-972ba75aace3 Aug 29 01:29:31 devstack sudo[106026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:32 devstack sudo[106025]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:32 devstack sudo[106026]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:32 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8b404597-cbc8-4040-b8db-5c9aa36797de tempest-ProjectMemberTests-1570638723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-f67636d9-e704-44f7-a2ad-972ba75aace3" returned: 0 in 0.391s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:32 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-13da8eeb-6d27-432e-bd51-1cdbed910dbe tempest-SnapshotDependencyTests-1328723867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ab6562a3-d834-46a3-b24b-4666d0cfbdec" returned: 0 in 0.406s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:32 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8b404597-cbc8-4040-b8db-5c9aa36797de tempest-ProjectMemberTests-1570638723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-f67636d9-e704-44f7-a2ad-972ba75aace3.c0127ecf-c3d2-441c-a208-9b3dc51cb476 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:32 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-13da8eeb-6d27-432e-bd51-1cdbed910dbe tempest-SnapshotDependencyTests-1328723867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ab6562a3-d834-46a3-b24b-4666d0cfbdec {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:32 devstack sudo[106035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-f67636d9-e704-44f7-a2ad-972ba75aace3.c0127ecf-c3d2-441c-a208-9b3dc51cb476 Aug 29 01:29:32 devstack sudo[106035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:32 devstack sudo[106036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ab6562a3-d834-46a3-b24b-4666d0cfbdec Aug 29 01:29:32 devstack sudo[106036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:32 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-658f49dd-82f7-4f04-be16-70160683ddb6 tempest-ProjectReaderTests-475607422 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:29:32 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-658f49dd-82f7-4f04-be16-70160683ddb6 tempest-ProjectReaderTests-475607422 None] Flow 'volume_create_manager' (72bebd1b-0f45-4540-acf3-c36d5a900450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:29:32 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-658f49dd-82f7-4f04-be16-70160683ddb6 tempest-ProjectReaderTests-475607422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2b9c73e-0431-49fd-8579-88c925cf21d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:29:32 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-658f49dd-82f7-4f04-be16-70160683ddb6 tempest-ProjectReaderTests-475607422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2b9c73e-0431-49fd-8579-88c925cf21d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:29:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1168092617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3ff87ce-bcfd-43f1-a6f4-4b544f103a52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7edd4d0eadce436f96866b71229d124e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:29:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:29:32Z,use_quota=True,user_id='4a18e6a5b80a4e8082854b3575bb284b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:29:32 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-658f49dd-82f7-4f04-be16-70160683ddb6 tempest-ProjectReaderTests-475607422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1c51411-cbe7-4d9e-ac87-a2f688e3ff51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:29:32 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-658f49dd-82f7-4f04-be16-70160683ddb6 tempest-ProjectReaderTests-475607422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1c51411-cbe7-4d9e-ac87-a2f688e3ff51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:29:32 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-658f49dd-82f7-4f04-be16-70160683ddb6 tempest-ProjectReaderTests-475607422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37d3733c-498c-4251-9f12-460b485f069d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:29:32 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-658f49dd-82f7-4f04-be16-70160683ddb6 tempest-ProjectReaderTests-475607422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37d3733c-498c-4251-9f12-460b485f069d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3ff87ce-bcfd-43f1-a6f4-4b544f103a52', 'volume_name': 'volume-c3ff87ce-bcfd-43f1-a6f4-4b544f103a52', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:29:32 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-658f49dd-82f7-4f04-be16-70160683ddb6 tempest-ProjectReaderTests-475607422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1411338-1c74-4d33-a19a-7113f3c194e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:29:32 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-658f49dd-82f7-4f04-be16-70160683ddb6 tempest-ProjectReaderTests-475607422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1411338-1c74-4d33-a19a-7113f3c194e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:29:32 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-658f49dd-82f7-4f04-be16-70160683ddb6 tempest-ProjectReaderTests-475607422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65e2e165-5ad6-4d4c-a676-d4146a9ce7b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:29:32 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-658f49dd-82f7-4f04-be16-70160683ddb6 tempest-ProjectReaderTests-475607422 None] Volume c3ff87ce-bcfd-43f1-a6f4-4b544f103a52: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3ff87ce-bcfd-43f1-a6f4-4b544f103a52', 'volume_size': 1} Aug 29 01:29:32 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-658f49dd-82f7-4f04-be16-70160683ddb6 tempest-ProjectReaderTests-475607422 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:29:32 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-658f49dd-82f7-4f04-be16-70160683ddb6 tempest-ProjectReaderTests-475607422 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:29:32 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-658f49dd-82f7-4f04-be16-70160683ddb6 tempest-ProjectReaderTests-475607422 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:29:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1168092617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3ff87ce-bcfd-43f1-a6f4-4b544f103a52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7edd4d0eadce436f96866b71229d124e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:29:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:29:32Z,use_quota=True,user_id='4a18e6a5b80a4e8082854b3575bb284b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:29:32 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-658f49dd-82f7-4f04-be16-70160683ddb6 tempest-ProjectReaderTests-475607422 None] Creating volume c3ff87ce-bcfd-43f1-a6f4-4b544f103a52 {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:29:32 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-658f49dd-82f7-4f04-be16-70160683ddb6 tempest-ProjectReaderTests-475607422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:29:32 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-658f49dd-82f7-4f04-be16-70160683ddb6 tempest-ProjectReaderTests-475607422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:29:32 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-658f49dd-82f7-4f04-be16-70160683ddb6 tempest-ProjectReaderTests-475607422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:29:32 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-658f49dd-82f7-4f04-be16-70160683ddb6 tempest-ProjectReaderTests-475607422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:29:32 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-658f49dd-82f7-4f04-be16-70160683ddb6 tempest-ProjectReaderTests-475607422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:29:32 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-658f49dd-82f7-4f04-be16-70160683ddb6 tempest-ProjectReaderTests-475607422 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:29:32 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-658f49dd-82f7-4f04-be16-70160683ddb6 tempest-ProjectReaderTests-475607422 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:29:32 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-658f49dd-82f7-4f04-be16-70160683ddb6 tempest-ProjectReaderTests-475607422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-c3ff87ce-bcfd-43f1-a6f4-4b544f103a52 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:32 devstack sudo[106039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-c3ff87ce-bcfd-43f1-a6f4-4b544f103a52 1073741824 Aug 29 01:29:32 devstack sudo[106039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:32 devstack sudo[106036]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:32 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-13da8eeb-6d27-432e-bd51-1cdbed910dbe tempest-SnapshotDependencyTests-1328723867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-ab6562a3-d834-46a3-b24b-4666d0cfbdec" returned: 0 in 0.297s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:32 devstack sudo[106035]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:32 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-13da8eeb-6d27-432e-bd51-1cdbed910dbe tempest-SnapshotDependencyTests-1328723867 None] Lock "cinder-quobyte-ab6562a3-d834-46a3-b24b-4666d0cfbdec" released by "delete_volume" :: held 0.783s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:29:32 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8b404597-cbc8-4040-b8db-5c9aa36797de tempest-ProjectMemberTests-1570638723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-f67636d9-e704-44f7-a2ad-972ba75aace3.c0127ecf-c3d2-441c-a208-9b3dc51cb476" returned: 0 in 0.330s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:32 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8b404597-cbc8-4040-b8db-5c9aa36797de tempest-ProjectMemberTests-1570638723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-f67636d9-e704-44f7-a2ad-972ba75aace3.c0127ecf-c3d2-441c-a208-9b3dc51cb476 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:32 devstack sudo[106045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-f67636d9-e704-44f7-a2ad-972ba75aace3.c0127ecf-c3d2-441c-a208-9b3dc51cb476 Aug 29 01:29:32 devstack sudo[106045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:32 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-13da8eeb-6d27-432e-bd51-1cdbed910dbe tempest-SnapshotDependencyTests-1328723867 None] Created reservations ['c98dddfd-17ac-46c1-a0d8-b195f4f6b3b1', 'dfaa28d8-7aa7-4c16-8a99-b80f40429b3e', '8bc7a605-a5fe-471c-8341-74fa0278f44f', '29d97b0a-3af2-44fb-bccd-3327fd0fd123'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:29:32 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-13da8eeb-6d27-432e-bd51-1cdbed910dbe tempest-SnapshotDependencyTests-1328723867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:29:32 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-13da8eeb-6d27-432e-bd51-1cdbed910dbe tempest-SnapshotDependencyTests-1328723867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:29:32 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-13da8eeb-6d27-432e-bd51-1cdbed910dbe tempest-SnapshotDependencyTests-1328723867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:29:32 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-13da8eeb-6d27-432e-bd51-1cdbed910dbe tempest-SnapshotDependencyTests-1328723867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:29:32 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-13da8eeb-6d27-432e-bd51-1cdbed910dbe tempest-SnapshotDependencyTests-1328723867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:29:32 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-13da8eeb-6d27-432e-bd51-1cdbed910dbe tempest-SnapshotDependencyTests-1328723867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:32 devstack sudo[106050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:29:32 devstack sudo[106050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:32 devstack sudo[106045]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:32 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-8b404597-cbc8-4040-b8db-5c9aa36797de tempest-ProjectMemberTests-1570638723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-f67636d9-e704-44f7-a2ad-972ba75aace3.c0127ecf-c3d2-441c-a208-9b3dc51cb476" returned: 0 in 0.257s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:32 devstack sudo[106039]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:32 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-658f49dd-82f7-4f04-be16-70160683ddb6 tempest-ProjectReaderTests-475607422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-c3ff87ce-bcfd-43f1-a6f4-4b544f103a52 1073741824" returned: 0 in 0.478s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:32 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-8b404597-cbc8-4040-b8db-5c9aa36797de tempest-ProjectMemberTests-1570638723 None] Lock "cinder-quobyte-c0127ecf-c3d2-441c-a208-9b3dc51cb476" released by "_delete_snapshot" :: held 1.551s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:29:32 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-5a06f316-d3cb-4fde-83d3-00f342fd86d8 tempest-SnapshotDependencyTests-1328723867 None] Acquiring lock "cinder-6ac15684-dc42-4f90-b41e-fb4a34d4dd23-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:29:32 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-8b404597-cbc8-4040-b8db-5c9aa36797de tempest-ProjectMemberTests-1570638723 None] Lock "cinder-quobyte-f67636d9-e704-44f7-a2ad-972ba75aace3" released by "delete_snapshot" :: held 1.597s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:29:32 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-658f49dd-82f7-4f04-be16-70160683ddb6 tempest-ProjectReaderTests-475607422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-c3ff87ce-bcfd-43f1-a6f4-4b544f103a52 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:32 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-5a06f316-d3cb-4fde-83d3-00f342fd86d8 tempest-SnapshotDependencyTests-1328723867 None] Lock "cinder-6ac15684-dc42-4f90-b41e-fb4a34d4dd23-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:29:32 devstack sudo[106054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-c3ff87ce-bcfd-43f1-a6f4-4b544f103a52 Aug 29 01:29:32 devstack sudo[106054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:32 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-5a06f316-d3cb-4fde-83d3-00f342fd86d8 tempest-SnapshotDependencyTests-1328723867 None] Acquiring lock "cinder-quobyte-6ac15684-dc42-4f90-b41e-fb4a34d4dd23" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:29:32 devstack sudo[106050]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:32 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-13da8eeb-6d27-432e-bd51-1cdbed910dbe tempest-SnapshotDependencyTests-1328723867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.297s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:32 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-13da8eeb-6d27-432e-bd51-1cdbed910dbe tempest-SnapshotDependencyTests-1328723867 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:29:32 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-5a06f316-d3cb-4fde-83d3-00f342fd86d8 tempest-SnapshotDependencyTests-1328723867 None] Lock "cinder-quobyte-6ac15684-dc42-4f90-b41e-fb4a34d4dd23" acquired by "delete_volume" :: waited 0.024s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:29:32 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-13da8eeb-6d27-432e-bd51-1cdbed910dbe tempest-SnapshotDependencyTests-1328723867 None] Deleted volume successfully. Aug 29 01:29:32 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-8b404597-cbc8-4040-b8db-5c9aa36797de tempest-ProjectMemberTests-1570638723 None] Created reservations ['c46beb0b-586f-4687-a3f3-7818436e55b8', 'e31f791d-f352-4794-9fdc-af5f28c18138', '27a164bc-5658-4281-9253-29112faa71cc', '0612e9af-6230-4fe4-a66d-3d6443b4e0b0'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:29:32 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ab7f411-55b3-4413-aefb-d970708ac5f5]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:29:32 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-5a06f316-d3cb-4fde-83d3-00f342fd86d8 tempest-SnapshotDependencyTests-1328723867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-6ac15684-dc42-4f90-b41e-fb4a34d4dd23 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:32 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-13da8eeb-6d27-432e-bd51-1cdbed910dbe tempest-SnapshotDependencyTests-1328723867 None] Lock "cinder-ab6562a3-d834-46a3-b24b-4666d0cfbdec-delete_volume" released by "delete_volume" :: held 1.361s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:29:32 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-8b404597-cbc8-4040-b8db-5c9aa36797de tempest-ProjectMemberTests-1570638723 None] Delete snapshot completed successfully. Aug 29 01:29:32 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-8b404597-cbc8-4040-b8db-5c9aa36797de tempest-ProjectMemberTests-1570638723 None] Lock "cinder-c0127ecf-c3d2-441c-a208-9b3dc51cb476-delete_snapshot" released by "delete_snapshot" :: held 1.845s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:29:32 devstack sudo[106057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-6ac15684-dc42-4f90-b41e-fb4a34d4dd23 Aug 29 01:29:33 devstack sudo[106057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:33 devstack sudo[106054]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:33 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-658f49dd-82f7-4f04-be16-70160683ddb6 tempest-ProjectReaderTests-475607422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-c3ff87ce-bcfd-43f1-a6f4-4b544f103a52" returned: 0 in 0.299s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:33 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-658f49dd-82f7-4f04-be16-70160683ddb6 tempest-ProjectReaderTests-475607422 None] <== create_volume: return (852ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:29:33 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-658f49dd-82f7-4f04-be16-70160683ddb6 tempest-ProjectReaderTests-475607422 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.855s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:29:33 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-658f49dd-82f7-4f04-be16-70160683ddb6 tempest-ProjectReaderTests-475607422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65e2e165-5ad6-4d4c-a676-d4146a9ce7b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3ff87ce-bcfd-43f1-a6f4-4b544f103a52', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:29:33 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-658f49dd-82f7-4f04-be16-70160683ddb6 tempest-ProjectReaderTests-475607422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b7f1933-b17e-4a66-8bd0-11b44e257477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:29:33 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-658f49dd-82f7-4f04-be16-70160683ddb6 tempest-ProjectReaderTests-475607422 None] Volume volume-c3ff87ce-bcfd-43f1-a6f4-4b544f103a52 (c3ff87ce-bcfd-43f1-a6f4-4b544f103a52): created successfully Aug 29 01:29:33 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-658f49dd-82f7-4f04-be16-70160683ddb6 tempest-ProjectReaderTests-475607422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b7f1933-b17e-4a66-8bd0-11b44e257477) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:29:33 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-658f49dd-82f7-4f04-be16-70160683ddb6 tempest-ProjectReaderTests-475607422 None] Flow 'volume_create_manager' (72bebd1b-0f45-4540-acf3-c36d5a900450) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:29:33 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-658f49dd-82f7-4f04-be16-70160683ddb6 tempest-ProjectReaderTests-475607422 None] Created volume successfully. Aug 29 01:29:33 devstack sudo[106057]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:33 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-d11ed7b3-abe7-42bb-b91f-dd98745c9dca tempest-ProjectMemberTests-1570638723 None] Acquiring lock "cinder-f67636d9-e704-44f7-a2ad-972ba75aace3-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:29:33 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-5a06f316-d3cb-4fde-83d3-00f342fd86d8 tempest-SnapshotDependencyTests-1328723867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-6ac15684-dc42-4f90-b41e-fb4a34d4dd23" returned: 0 in 0.406s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:33 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-5a06f316-d3cb-4fde-83d3-00f342fd86d8 tempest-SnapshotDependencyTests-1328723867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-6ac15684-dc42-4f90-b41e-fb4a34d4dd23 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:33 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-d11ed7b3-abe7-42bb-b91f-dd98745c9dca tempest-ProjectMemberTests-1570638723 None] Lock "cinder-f67636d9-e704-44f7-a2ad-972ba75aace3-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:29:33 devstack sudo[106063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-6ac15684-dc42-4f90-b41e-fb4a34d4dd23 Aug 29 01:29:33 devstack sudo[106063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:33 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-d11ed7b3-abe7-42bb-b91f-dd98745c9dca tempest-ProjectMemberTests-1570638723 None] Acquiring lock "cinder-quobyte-f67636d9-e704-44f7-a2ad-972ba75aace3" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:29:33 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-d11ed7b3-abe7-42bb-b91f-dd98745c9dca tempest-ProjectMemberTests-1570638723 None] Lock "cinder-quobyte-f67636d9-e704-44f7-a2ad-972ba75aace3" acquired by "delete_volume" :: waited 0.017s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:29:33 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[883bd3cb-2dbd-4387-a33f-feecc2c1978f]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:29:33 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d11ed7b3-abe7-42bb-b91f-dd98745c9dca tempest-ProjectMemberTests-1570638723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-f67636d9-e704-44f7-a2ad-972ba75aace3 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:33 devstack sudo[106065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-f67636d9-e704-44f7-a2ad-972ba75aace3 Aug 29 01:29:33 devstack sudo[106065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:33 devstack sudo[106063]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:33 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-5a06f316-d3cb-4fde-83d3-00f342fd86d8 tempest-SnapshotDependencyTests-1328723867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-6ac15684-dc42-4f90-b41e-fb4a34d4dd23" returned: 0 in 0.259s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:33 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-5a06f316-d3cb-4fde-83d3-00f342fd86d8 tempest-SnapshotDependencyTests-1328723867 None] Lock "cinder-quobyte-6ac15684-dc42-4f90-b41e-fb4a34d4dd23" released by "delete_volume" :: held 0.712s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:29:33 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-5a06f316-d3cb-4fde-83d3-00f342fd86d8 tempest-SnapshotDependencyTests-1328723867 None] Created reservations ['36e78acb-5ff3-47e0-85ad-8b6dd4d69591', 'ff56022a-9329-4668-9ec1-f0b9fd2902a0', '351eb738-40c4-46f7-b10c-91380affbe52', '48d01702-272c-4a27-8660-0c596cc0d626'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:29:33 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-5a06f316-d3cb-4fde-83d3-00f342fd86d8 tempest-SnapshotDependencyTests-1328723867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:29:33 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-5a06f316-d3cb-4fde-83d3-00f342fd86d8 tempest-SnapshotDependencyTests-1328723867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:29:33 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-5a06f316-d3cb-4fde-83d3-00f342fd86d8 tempest-SnapshotDependencyTests-1328723867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:29:33 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-5a06f316-d3cb-4fde-83d3-00f342fd86d8 tempest-SnapshotDependencyTests-1328723867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:29:33 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-5a06f316-d3cb-4fde-83d3-00f342fd86d8 tempest-SnapshotDependencyTests-1328723867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:29:33 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-5a06f316-d3cb-4fde-83d3-00f342fd86d8 tempest-SnapshotDependencyTests-1328723867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:33 devstack sudo[106102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:29:33 devstack sudo[106102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:33 devstack sudo[106065]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:33 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d11ed7b3-abe7-42bb-b91f-dd98745c9dca tempest-ProjectMemberTests-1570638723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-f67636d9-e704-44f7-a2ad-972ba75aace3" returned: 0 in 0.378s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:33 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d11ed7b3-abe7-42bb-b91f-dd98745c9dca tempest-ProjectMemberTests-1570638723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-f67636d9-e704-44f7-a2ad-972ba75aace3 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:33 devstack sudo[106107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-f67636d9-e704-44f7-a2ad-972ba75aace3 Aug 29 01:29:33 devstack sudo[106107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:33 devstack sudo[106102]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:33 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-5a06f316-d3cb-4fde-83d3-00f342fd86d8 tempest-SnapshotDependencyTests-1328723867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.303s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:33 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-5a06f316-d3cb-4fde-83d3-00f342fd86d8 tempest-SnapshotDependencyTests-1328723867 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:29:33 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-5a06f316-d3cb-4fde-83d3-00f342fd86d8 tempest-SnapshotDependencyTests-1328723867 None] Deleted volume successfully. Aug 29 01:29:34 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-5a06f316-d3cb-4fde-83d3-00f342fd86d8 tempest-SnapshotDependencyTests-1328723867 None] Lock "cinder-6ac15684-dc42-4f90-b41e-fb4a34d4dd23-delete_volume" released by "delete_volume" :: held 1.256s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:29:34 devstack sudo[106107]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:34 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d11ed7b3-abe7-42bb-b91f-dd98745c9dca tempest-ProjectMemberTests-1570638723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-f67636d9-e704-44f7-a2ad-972ba75aace3" returned: 0 in 0.332s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:34 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-d11ed7b3-abe7-42bb-b91f-dd98745c9dca tempest-ProjectMemberTests-1570638723 None] Lock "cinder-quobyte-f67636d9-e704-44f7-a2ad-972ba75aace3" released by "delete_volume" :: held 0.770s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:29:34 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-d11ed7b3-abe7-42bb-b91f-dd98745c9dca tempest-ProjectMemberTests-1570638723 None] Created reservations ['7cb78a4e-09f9-47c2-9e1b-d4a6754c72fa', '2b0373ea-d57e-4511-af99-42cfd8e6c78c', 'b221207f-8bf3-4d1f-a192-a75a67300e1c', '40bb7931-196a-4799-94a2-429593a6c3a8'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:29:34 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-d11ed7b3-abe7-42bb-b91f-dd98745c9dca tempest-ProjectMemberTests-1570638723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:29:34 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-d11ed7b3-abe7-42bb-b91f-dd98745c9dca tempest-ProjectMemberTests-1570638723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:29:34 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-d11ed7b3-abe7-42bb-b91f-dd98745c9dca tempest-ProjectMemberTests-1570638723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:29:34 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-d11ed7b3-abe7-42bb-b91f-dd98745c9dca tempest-ProjectMemberTests-1570638723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:29:34 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-d11ed7b3-abe7-42bb-b91f-dd98745c9dca tempest-ProjectMemberTests-1570638723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:29:34 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d11ed7b3-abe7-42bb-b91f-dd98745c9dca tempest-ProjectMemberTests-1570638723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:34 devstack sudo[106113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:29:34 devstack sudo[106113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:34 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-605dbd28-9592-4b23-b3e9-b20e4323797a tempest-ProjectReaderTests-475607422 None] Acquiring lock "cinder-c3ff87ce-bcfd-43f1-a6f4-4b544f103a52-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:29:34 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-605dbd28-9592-4b23-b3e9-b20e4323797a tempest-ProjectReaderTests-475607422 None] Lock "cinder-c3ff87ce-bcfd-43f1-a6f4-4b544f103a52-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:29:34 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-605dbd28-9592-4b23-b3e9-b20e4323797a tempest-ProjectReaderTests-475607422 None] Acquiring lock "cinder-quobyte-c3ff87ce-bcfd-43f1-a6f4-4b544f103a52" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:29:34 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-605dbd28-9592-4b23-b3e9-b20e4323797a tempest-ProjectReaderTests-475607422 None] Lock "cinder-quobyte-c3ff87ce-bcfd-43f1-a6f4-4b544f103a52" acquired by "delete_volume" :: waited 0.023s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:29:34 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[14dfcdd7-a58c-464b-840a-ff9cbfc7ba1b]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:29:34 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-605dbd28-9592-4b23-b3e9-b20e4323797a tempest-ProjectReaderTests-475607422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-c3ff87ce-bcfd-43f1-a6f4-4b544f103a52 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:34 devstack sudo[106113]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:34 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-d11ed7b3-abe7-42bb-b91f-dd98745c9dca tempest-ProjectMemberTests-1570638723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.334s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:34 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-d11ed7b3-abe7-42bb-b91f-dd98745c9dca tempest-ProjectMemberTests-1570638723 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:29:34 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-d11ed7b3-abe7-42bb-b91f-dd98745c9dca tempest-ProjectMemberTests-1570638723 None] Deleted volume successfully. Aug 29 01:29:34 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-d11ed7b3-abe7-42bb-b91f-dd98745c9dca tempest-ProjectMemberTests-1570638723 None] Lock "cinder-f67636d9-e704-44f7-a2ad-972ba75aace3-delete_volume" released by "delete_volume" :: held 1.314s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:29:34 devstack sudo[106115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-c3ff87ce-bcfd-43f1-a6f4-4b544f103a52 Aug 29 01:29:34 devstack sudo[106115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:34 devstack sudo[106115]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:34 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-605dbd28-9592-4b23-b3e9-b20e4323797a tempest-ProjectReaderTests-475607422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-c3ff87ce-bcfd-43f1-a6f4-4b544f103a52" returned: 0 in 0.444s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:34 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-605dbd28-9592-4b23-b3e9-b20e4323797a tempest-ProjectReaderTests-475607422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-c3ff87ce-bcfd-43f1-a6f4-4b544f103a52 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:34 devstack sudo[106121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-c3ff87ce-bcfd-43f1-a6f4-4b544f103a52 Aug 29 01:29:34 devstack sudo[106121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:35 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-604a47c1-08f8-4cea-b695-371d2b902736 tempest-ProjectMemberTests-1570638723 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:29:35 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-604a47c1-08f8-4cea-b695-371d2b902736 tempest-ProjectMemberTests-1570638723 None] Flow 'volume_create_manager' (33c41cab-c4d8-4349-b359-7b570545ca81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:29:35 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-604a47c1-08f8-4cea-b695-371d2b902736 tempest-ProjectMemberTests-1570638723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4533b737-4836-4b2d-a86f-a4865ae8af5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:29:35 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-604a47c1-08f8-4cea-b695-371d2b902736 tempest-ProjectMemberTests-1570638723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4533b737-4836-4b2d-a86f-a4865ae8af5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:29:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-780617821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38bc557b-49cd-489d-b83d-f96bddd0881d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc3e18b86dee456398aada5b169dc198',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:29:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:29:35Z,use_quota=True,user_id='ea18f1190bab494589a803742a7eb22a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:29:35 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-604a47c1-08f8-4cea-b695-371d2b902736 tempest-ProjectMemberTests-1570638723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a461e3ae-d9d5-42a4-9293-9ba35ca55635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:29:35 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-604a47c1-08f8-4cea-b695-371d2b902736 tempest-ProjectMemberTests-1570638723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a461e3ae-d9d5-42a4-9293-9ba35ca55635) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:29:35 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-604a47c1-08f8-4cea-b695-371d2b902736 tempest-ProjectMemberTests-1570638723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d177b001-d4ab-4f78-9ea8-16a621937937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:29:35 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-604a47c1-08f8-4cea-b695-371d2b902736 tempest-ProjectMemberTests-1570638723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d177b001-d4ab-4f78-9ea8-16a621937937) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38bc557b-49cd-489d-b83d-f96bddd0881d', 'volume_name': 'volume-38bc557b-49cd-489d-b83d-f96bddd0881d', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:29:35 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-604a47c1-08f8-4cea-b695-371d2b902736 tempest-ProjectMemberTests-1570638723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6ba455d-889b-40bc-82a0-cab3667f087e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:29:35 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-604a47c1-08f8-4cea-b695-371d2b902736 tempest-ProjectMemberTests-1570638723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6ba455d-889b-40bc-82a0-cab3667f087e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:29:35 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-604a47c1-08f8-4cea-b695-371d2b902736 tempest-ProjectMemberTests-1570638723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fce78d01-45a0-4bf0-a886-9ed702ec5927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:29:35 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-604a47c1-08f8-4cea-b695-371d2b902736 tempest-ProjectMemberTests-1570638723 None] Volume 38bc557b-49cd-489d-b83d-f96bddd0881d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38bc557b-49cd-489d-b83d-f96bddd0881d', 'volume_size': 1} Aug 29 01:29:35 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-604a47c1-08f8-4cea-b695-371d2b902736 tempest-ProjectMemberTests-1570638723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:29:35 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-604a47c1-08f8-4cea-b695-371d2b902736 tempest-ProjectMemberTests-1570638723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:29:35 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-604a47c1-08f8-4cea-b695-371d2b902736 tempest-ProjectMemberTests-1570638723 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:29:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-780617821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38bc557b-49cd-489d-b83d-f96bddd0881d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc3e18b86dee456398aada5b169dc198',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:29:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:29:35Z,use_quota=True,user_id='ea18f1190bab494589a803742a7eb22a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:29:35 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-604a47c1-08f8-4cea-b695-371d2b902736 tempest-ProjectMemberTests-1570638723 None] Creating volume 38bc557b-49cd-489d-b83d-f96bddd0881d {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:29:35 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-604a47c1-08f8-4cea-b695-371d2b902736 tempest-ProjectMemberTests-1570638723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:29:35 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-604a47c1-08f8-4cea-b695-371d2b902736 tempest-ProjectMemberTests-1570638723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:29:35 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-604a47c1-08f8-4cea-b695-371d2b902736 tempest-ProjectMemberTests-1570638723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:29:35 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-604a47c1-08f8-4cea-b695-371d2b902736 tempest-ProjectMemberTests-1570638723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:29:35 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-604a47c1-08f8-4cea-b695-371d2b902736 tempest-ProjectMemberTests-1570638723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:29:35 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-604a47c1-08f8-4cea-b695-371d2b902736 tempest-ProjectMemberTests-1570638723 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:29:35 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-604a47c1-08f8-4cea-b695-371d2b902736 tempest-ProjectMemberTests-1570638723 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:29:35 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-604a47c1-08f8-4cea-b695-371d2b902736 tempest-ProjectMemberTests-1570638723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-38bc557b-49cd-489d-b83d-f96bddd0881d 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:35 devstack sudo[106123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-38bc557b-49cd-489d-b83d-f96bddd0881d 1073741824 Aug 29 01:29:35 devstack sudo[106123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:35 devstack sudo[106121]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:35 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-605dbd28-9592-4b23-b3e9-b20e4323797a tempest-ProjectReaderTests-475607422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-c3ff87ce-bcfd-43f1-a6f4-4b544f103a52" returned: 0 in 0.269s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:35 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-605dbd28-9592-4b23-b3e9-b20e4323797a tempest-ProjectReaderTests-475607422 None] Lock "cinder-quobyte-c3ff87ce-bcfd-43f1-a6f4-4b544f103a52" released by "delete_volume" :: held 0.766s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:29:35 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-605dbd28-9592-4b23-b3e9-b20e4323797a tempest-ProjectReaderTests-475607422 None] Created reservations ['fd70a2b5-2b4f-48c1-be81-1f6b2dd507b7', 'cf658574-46f3-4e53-b92c-cf68cab4c040', 'b47de313-7439-4217-a6e3-5784bea2fdc6', '7c66980b-3892-4585-93c8-ec2f15e56ef9'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:29:35 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-605dbd28-9592-4b23-b3e9-b20e4323797a tempest-ProjectReaderTests-475607422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:29:35 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-605dbd28-9592-4b23-b3e9-b20e4323797a tempest-ProjectReaderTests-475607422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:29:35 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-605dbd28-9592-4b23-b3e9-b20e4323797a tempest-ProjectReaderTests-475607422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:29:35 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-605dbd28-9592-4b23-b3e9-b20e4323797a tempest-ProjectReaderTests-475607422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:29:35 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-605dbd28-9592-4b23-b3e9-b20e4323797a tempest-ProjectReaderTests-475607422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:29:35 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-605dbd28-9592-4b23-b3e9-b20e4323797a tempest-ProjectReaderTests-475607422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:35 devstack sudo[106126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:29:35 devstack sudo[106126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:35 devstack sudo[106126]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:35 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-605dbd28-9592-4b23-b3e9-b20e4323797a tempest-ProjectReaderTests-475607422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.346s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:35 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-605dbd28-9592-4b23-b3e9-b20e4323797a tempest-ProjectReaderTests-475607422 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:29:35 devstack sudo[106123]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:35 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-605dbd28-9592-4b23-b3e9-b20e4323797a tempest-ProjectReaderTests-475607422 None] Deleted volume successfully. Aug 29 01:29:35 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-604a47c1-08f8-4cea-b695-371d2b902736 tempest-ProjectMemberTests-1570638723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-38bc557b-49cd-489d-b83d-f96bddd0881d 1073741824" returned: 0 in 0.579s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:35 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-605dbd28-9592-4b23-b3e9-b20e4323797a tempest-ProjectReaderTests-475607422 None] Lock "cinder-c3ff87ce-bcfd-43f1-a6f4-4b544f103a52-delete_volume" released by "delete_volume" :: held 1.365s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:29:35 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-604a47c1-08f8-4cea-b695-371d2b902736 tempest-ProjectMemberTests-1570638723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-38bc557b-49cd-489d-b83d-f96bddd0881d {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:35 devstack sudo[106133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-38bc557b-49cd-489d-b83d-f96bddd0881d Aug 29 01:29:35 devstack sudo[106133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:36 devstack sudo[106133]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:36 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-604a47c1-08f8-4cea-b695-371d2b902736 tempest-ProjectMemberTests-1570638723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-38bc557b-49cd-489d-b83d-f96bddd0881d" returned: 0 in 0.301s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:36 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-604a47c1-08f8-4cea-b695-371d2b902736 tempest-ProjectMemberTests-1570638723 None] <== create_volume: return (931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:29:36 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-604a47c1-08f8-4cea-b695-371d2b902736 tempest-ProjectMemberTests-1570638723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.934s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:29:36 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-604a47c1-08f8-4cea-b695-371d2b902736 tempest-ProjectMemberTests-1570638723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fce78d01-45a0-4bf0-a886-9ed702ec5927) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38bc557b-49cd-489d-b83d-f96bddd0881d', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:29:36 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-604a47c1-08f8-4cea-b695-371d2b902736 tempest-ProjectMemberTests-1570638723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6f1376c-faa1-46b4-bafe-6a16f66c9c1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:29:36 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-604a47c1-08f8-4cea-b695-371d2b902736 tempest-ProjectMemberTests-1570638723 None] Volume volume-38bc557b-49cd-489d-b83d-f96bddd0881d (38bc557b-49cd-489d-b83d-f96bddd0881d): created successfully Aug 29 01:29:36 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-604a47c1-08f8-4cea-b695-371d2b902736 tempest-ProjectMemberTests-1570638723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6f1376c-faa1-46b4-bafe-6a16f66c9c1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:29:36 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-604a47c1-08f8-4cea-b695-371d2b902736 tempest-ProjectMemberTests-1570638723 None] Flow 'volume_create_manager' (33c41cab-c4d8-4349-b359-7b570545ca81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:29:36 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-604a47c1-08f8-4cea-b695-371d2b902736 tempest-ProjectMemberTests-1570638723 None] Created volume successfully. Aug 29 01:29:36 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-9327a744-256b-4211-be71-cc6c524d40bf tempest-ProjectReaderTests-475607422 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:29:36 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-9327a744-256b-4211-be71-cc6c524d40bf tempest-ProjectReaderTests-475607422 None] Flow 'volume_create_manager' (77ff6f5e-f6a4-48cb-a25f-498967523689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:29:36 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-9327a744-256b-4211-be71-cc6c524d40bf tempest-ProjectReaderTests-475607422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (406c1508-f91a-4e75-bd01-18c175149b49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:29:36 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-9327a744-256b-4211-be71-cc6c524d40bf tempest-ProjectReaderTests-475607422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (406c1508-f91a-4e75-bd01-18c175149b49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:29:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1177437981',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c70e7fc-89ac-43f5-a5d9-9b76cadd0538,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7edd4d0eadce436f96866b71229d124e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:29:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:29:36Z,use_quota=True,user_id='4a18e6a5b80a4e8082854b3575bb284b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:29:36 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-9327a744-256b-4211-be71-cc6c524d40bf tempest-ProjectReaderTests-475607422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adcbb15f-1817-437b-9e3a-016e7d9dfc74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:29:36 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-9327a744-256b-4211-be71-cc6c524d40bf tempest-ProjectReaderTests-475607422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adcbb15f-1817-437b-9e3a-016e7d9dfc74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:29:36 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-9327a744-256b-4211-be71-cc6c524d40bf tempest-ProjectReaderTests-475607422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e179b23c-0d0a-46ea-b282-490d7cd7ec17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:29:36 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-9327a744-256b-4211-be71-cc6c524d40bf tempest-ProjectReaderTests-475607422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e179b23c-0d0a-46ea-b282-490d7cd7ec17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c70e7fc-89ac-43f5-a5d9-9b76cadd0538', 'volume_name': 'volume-8c70e7fc-89ac-43f5-a5d9-9b76cadd0538', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:29:36 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-9327a744-256b-4211-be71-cc6c524d40bf tempest-ProjectReaderTests-475607422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (147304d3-6e13-4347-825b-341dbca59eb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:29:36 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-9327a744-256b-4211-be71-cc6c524d40bf tempest-ProjectReaderTests-475607422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (147304d3-6e13-4347-825b-341dbca59eb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:29:36 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-9327a744-256b-4211-be71-cc6c524d40bf tempest-ProjectReaderTests-475607422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (774bf766-65d6-435b-bf2b-78e55b4a18b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:29:36 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-9327a744-256b-4211-be71-cc6c524d40bf tempest-ProjectReaderTests-475607422 None] Volume 8c70e7fc-89ac-43f5-a5d9-9b76cadd0538: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c70e7fc-89ac-43f5-a5d9-9b76cadd0538', 'volume_size': 1} Aug 29 01:29:36 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-9327a744-256b-4211-be71-cc6c524d40bf tempest-ProjectReaderTests-475607422 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:29:36 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-9327a744-256b-4211-be71-cc6c524d40bf tempest-ProjectReaderTests-475607422 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:29:36 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-9327a744-256b-4211-be71-cc6c524d40bf tempest-ProjectReaderTests-475607422 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:29:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1177437981',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c70e7fc-89ac-43f5-a5d9-9b76cadd0538,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7edd4d0eadce436f96866b71229d124e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:29:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:29:36Z,use_quota=True,user_id='4a18e6a5b80a4e8082854b3575bb284b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:29:36 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-9327a744-256b-4211-be71-cc6c524d40bf tempest-ProjectReaderTests-475607422 None] Creating volume 8c70e7fc-89ac-43f5-a5d9-9b76cadd0538 {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:29:36 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-9327a744-256b-4211-be71-cc6c524d40bf tempest-ProjectReaderTests-475607422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:29:36 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-9327a744-256b-4211-be71-cc6c524d40bf tempest-ProjectReaderTests-475607422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:29:36 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-9327a744-256b-4211-be71-cc6c524d40bf tempest-ProjectReaderTests-475607422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:29:36 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-9327a744-256b-4211-be71-cc6c524d40bf tempest-ProjectReaderTests-475607422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:29:36 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-9327a744-256b-4211-be71-cc6c524d40bf tempest-ProjectReaderTests-475607422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:29:36 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-9327a744-256b-4211-be71-cc6c524d40bf tempest-ProjectReaderTests-475607422 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:29:36 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-9327a744-256b-4211-be71-cc6c524d40bf tempest-ProjectReaderTests-475607422 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:29:36 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-9327a744-256b-4211-be71-cc6c524d40bf tempest-ProjectReaderTests-475607422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-8c70e7fc-89ac-43f5-a5d9-9b76cadd0538 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:36 devstack sudo[106136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-8c70e7fc-89ac-43f5-a5d9-9b76cadd0538 1073741824 Aug 29 01:29:36 devstack sudo[106136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:36 devstack sudo[106136]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:36 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-9327a744-256b-4211-be71-cc6c524d40bf tempest-ProjectReaderTests-475607422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-8c70e7fc-89ac-43f5-a5d9-9b76cadd0538 1073741824" returned: 0 in 0.467s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:36 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-9327a744-256b-4211-be71-cc6c524d40bf tempest-ProjectReaderTests-475607422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-8c70e7fc-89ac-43f5-a5d9-9b76cadd0538 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:36 devstack sudo[106142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-8c70e7fc-89ac-43f5-a5d9-9b76cadd0538 Aug 29 01:29:36 devstack sudo[106142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:36 devstack sudo[106142]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:37 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-9327a744-256b-4211-be71-cc6c524d40bf tempest-ProjectReaderTests-475607422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-8c70e7fc-89ac-43f5-a5d9-9b76cadd0538" returned: 0 in 0.251s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:37 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-9327a744-256b-4211-be71-cc6c524d40bf tempest-ProjectReaderTests-475607422 None] <== create_volume: return (756ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:29:37 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-9327a744-256b-4211-be71-cc6c524d40bf tempest-ProjectReaderTests-475607422 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.759s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:29:37 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-9327a744-256b-4211-be71-cc6c524d40bf tempest-ProjectReaderTests-475607422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (774bf766-65d6-435b-bf2b-78e55b4a18b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c70e7fc-89ac-43f5-a5d9-9b76cadd0538', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:29:37 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-9327a744-256b-4211-be71-cc6c524d40bf tempest-ProjectReaderTests-475607422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d3fddc7-8f9b-4782-abf4-e2ad346af34f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:29:37 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-9327a744-256b-4211-be71-cc6c524d40bf tempest-ProjectReaderTests-475607422 None] Volume volume-8c70e7fc-89ac-43f5-a5d9-9b76cadd0538 (8c70e7fc-89ac-43f5-a5d9-9b76cadd0538): created successfully Aug 29 01:29:37 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-9327a744-256b-4211-be71-cc6c524d40bf tempest-ProjectReaderTests-475607422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d3fddc7-8f9b-4782-abf4-e2ad346af34f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:29:37 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-9327a744-256b-4211-be71-cc6c524d40bf tempest-ProjectReaderTests-475607422 None] Flow 'volume_create_manager' (77ff6f5e-f6a4-48cb-a25f-498967523689) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:29:37 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-9327a744-256b-4211-be71-cc6c524d40bf tempest-ProjectReaderTests-475607422 None] Created volume successfully. Aug 29 01:29:37 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-bd0acc19-d482-45da-96e5-e1899c8e6a5f tempest-ProjectReaderTests-475607422 None] Acquiring lock "cinder-8c70e7fc-89ac-43f5-a5d9-9b76cadd0538-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:29:37 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-bd0acc19-d482-45da-96e5-e1899c8e6a5f tempest-ProjectReaderTests-475607422 None] Lock "cinder-8c70e7fc-89ac-43f5-a5d9-9b76cadd0538-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:29:37 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-bd0acc19-d482-45da-96e5-e1899c8e6a5f tempest-ProjectReaderTests-475607422 None] Acquiring lock "cinder-quobyte-8c70e7fc-89ac-43f5-a5d9-9b76cadd0538" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:29:37 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-bd0acc19-d482-45da-96e5-e1899c8e6a5f tempest-ProjectReaderTests-475607422 None] Lock "cinder-quobyte-8c70e7fc-89ac-43f5-a5d9-9b76cadd0538" acquired by "delete_volume" :: waited 0.025s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:29:37 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-e80a0700-a508-4496-9ce3-7115b25c8a69 tempest-ProjectMemberTests-1570638723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:29:37 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-e80a0700-a508-4496-9ce3-7115b25c8a69 tempest-ProjectMemberTests-1570638723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:29:37 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-e80a0700-a508-4496-9ce3-7115b25c8a69 tempest-ProjectMemberTests-1570638723 None] Creating offline snapshot 69802222-80f6-4206-8651-1f800ccac4f7 of volume 38bc557b-49cd-489d-b83d-f96bddd0881d {{(pid=86111) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 29 01:29:37 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ac84cd6-100a-4d30-9d48-c67385a8dbc6]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:29:37 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-bd0acc19-d482-45da-96e5-e1899c8e6a5f tempest-ProjectReaderTests-475607422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-8c70e7fc-89ac-43f5-a5d9-9b76cadd0538 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:37 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[baf4e281-71f9-4bfc-95c8-2a1884b30e8d]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:29:37 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-e80a0700-a508-4496-9ce3-7115b25c8a69 tempest-ProjectMemberTests-1570638723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-38bc557b-49cd-489d-b83d-f96bddd0881d {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:37 devstack sudo[106145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-8c70e7fc-89ac-43f5-a5d9-9b76cadd0538 Aug 29 01:29:37 devstack sudo[106145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:37 devstack sudo[106146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-38bc557b-49cd-489d-b83d-f96bddd0881d Aug 29 01:29:37 devstack sudo[106146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:37 devstack sudo[106145]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:37 devstack sudo[106146]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:37 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-e80a0700-a508-4496-9ce3-7115b25c8a69 tempest-ProjectMemberTests-1570638723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-38bc557b-49cd-489d-b83d-f96bddd0881d" returned: 0 in 0.415s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:37 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-bd0acc19-d482-45da-96e5-e1899c8e6a5f tempest-ProjectReaderTests-475607422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-8c70e7fc-89ac-43f5-a5d9-9b76cadd0538" returned: 0 in 0.434s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:37 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-e80a0700-a508-4496-9ce3-7115b25c8a69 tempest-ProjectMemberTests-1570638723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-38bc557b-49cd-489d-b83d-f96bddd0881d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-38bc557b-49cd-489d-b83d-f96bddd0881d.69802222-80f6-4206-8651-1f800ccac4f7 1G {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:37 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-bd0acc19-d482-45da-96e5-e1899c8e6a5f tempest-ProjectReaderTests-475607422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-8c70e7fc-89ac-43f5-a5d9-9b76cadd0538 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:37 devstack sudo[106155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-38bc557b-49cd-489d-b83d-f96bddd0881d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-38bc557b-49cd-489d-b83d-f96bddd0881d.69802222-80f6-4206-8651-1f800ccac4f7 1G Aug 29 01:29:37 devstack sudo[106155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:37 devstack sudo[106156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-8c70e7fc-89ac-43f5-a5d9-9b76cadd0538 Aug 29 01:29:37 devstack sudo[106156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:38 devstack sudo[106156]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:38 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-bd0acc19-d482-45da-96e5-e1899c8e6a5f tempest-ProjectReaderTests-475607422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-8c70e7fc-89ac-43f5-a5d9-9b76cadd0538" returned: 0 in 0.289s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:38 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-bd0acc19-d482-45da-96e5-e1899c8e6a5f tempest-ProjectReaderTests-475607422 None] Lock "cinder-quobyte-8c70e7fc-89ac-43f5-a5d9-9b76cadd0538" released by "delete_volume" :: held 0.787s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:29:38 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-bd0acc19-d482-45da-96e5-e1899c8e6a5f tempest-ProjectReaderTests-475607422 None] Created reservations ['8e9e3e27-8445-4ae0-9eb9-aed3e6a3c41c', '9b370272-0d5b-47b9-b97e-8f1b43a40e52', '02d3cb7e-55fd-4fc9-8ba1-a760975b0ec2', 'f18453d9-615e-4ca1-a0c9-f9510886e47b'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:29:38 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-bd0acc19-d482-45da-96e5-e1899c8e6a5f tempest-ProjectReaderTests-475607422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:29:38 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-bd0acc19-d482-45da-96e5-e1899c8e6a5f tempest-ProjectReaderTests-475607422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:29:38 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-bd0acc19-d482-45da-96e5-e1899c8e6a5f tempest-ProjectReaderTests-475607422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:29:38 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-bd0acc19-d482-45da-96e5-e1899c8e6a5f tempest-ProjectReaderTests-475607422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:29:38 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-bd0acc19-d482-45da-96e5-e1899c8e6a5f tempest-ProjectReaderTests-475607422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:29:38 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-bd0acc19-d482-45da-96e5-e1899c8e6a5f tempest-ProjectReaderTests-475607422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:38 devstack sudo[106155]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:38 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-e80a0700-a508-4496-9ce3-7115b25c8a69 tempest-ProjectMemberTests-1570638723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-38bc557b-49cd-489d-b83d-f96bddd0881d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-38bc557b-49cd-489d-b83d-f96bddd0881d.69802222-80f6-4206-8651-1f800ccac4f7 1G" returned: 0 in 0.464s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:38 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-e80a0700-a508-4496-9ce3-7115b25c8a69 tempest-ProjectMemberTests-1570638723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38bc557b-49cd-489d-b83d-f96bddd0881d -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-38bc557b-49cd-489d-b83d-f96bddd0881d.69802222-80f6-4206-8651-1f800ccac4f7 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:38 devstack sudo[106164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:29:38 devstack sudo[106164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:38 devstack sudo[106165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38bc557b-49cd-489d-b83d-f96bddd0881d -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-38bc557b-49cd-489d-b83d-f96bddd0881d.69802222-80f6-4206-8651-1f800ccac4f7 Aug 29 01:29:38 devstack sudo[106165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:38 devstack sudo[106165]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:38 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-e80a0700-a508-4496-9ce3-7115b25c8a69 tempest-ProjectMemberTests-1570638723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38bc557b-49cd-489d-b83d-f96bddd0881d -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-38bc557b-49cd-489d-b83d-f96bddd0881d.69802222-80f6-4206-8651-1f800ccac4f7" returned: 0 in 0.408s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:38 devstack cinder-volume[86111]: WARNING cinder.volume.drivers.remotefs [None req-e80a0700-a508-4496-9ce3-7115b25c8a69 tempest-ProjectMemberTests-1570638723 None] /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-38bc557b-49cd-489d-b83d-f96bddd0881d.69802222-80f6-4206-8651-1f800ccac4f7 is being set with open permissions: ugo+rw Aug 29 01:29:38 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-e80a0700-a508-4496-9ce3-7115b25c8a69 tempest-ProjectMemberTests-1570638723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-38bc557b-49cd-489d-b83d-f96bddd0881d.69802222-80f6-4206-8651-1f800ccac4f7 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:38 devstack sudo[106164]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:38 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-bd0acc19-d482-45da-96e5-e1899c8e6a5f tempest-ProjectReaderTests-475607422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.458s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:38 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-bd0acc19-d482-45da-96e5-e1899c8e6a5f tempest-ProjectReaderTests-475607422 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:29:38 devstack sudo[106173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-38bc557b-49cd-489d-b83d-f96bddd0881d.69802222-80f6-4206-8651-1f800ccac4f7 Aug 29 01:29:38 devstack sudo[106173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:38 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-bd0acc19-d482-45da-96e5-e1899c8e6a5f tempest-ProjectReaderTests-475607422 None] Deleted volume successfully. Aug 29 01:29:38 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-bd0acc19-d482-45da-96e5-e1899c8e6a5f tempest-ProjectReaderTests-475607422 None] Lock "cinder-8c70e7fc-89ac-43f5-a5d9-9b76cadd0538-delete_volume" released by "delete_volume" :: held 1.524s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:29:38 devstack sudo[106173]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:38 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-e80a0700-a508-4496-9ce3-7115b25c8a69 tempest-ProjectMemberTests-1570638723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-38bc557b-49cd-489d-b83d-f96bddd0881d.69802222-80f6-4206-8651-1f800ccac4f7" returned: 0 in 0.273s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:39 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-e80a0700-a508-4496-9ce3-7115b25c8a69 tempest-ProjectMemberTests-1570638723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-38bc557b-49cd-489d-b83d-f96bddd0881d.info {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:39 devstack sudo[106176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-38bc557b-49cd-489d-b83d-f96bddd0881d.info Aug 29 01:29:39 devstack sudo[106176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:39 devstack sudo[106176]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:39 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-e80a0700-a508-4496-9ce3-7115b25c8a69 tempest-ProjectMemberTests-1570638723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-38bc557b-49cd-489d-b83d-f96bddd0881d.info" returned: 0 in 0.293s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:39 devstack cinder-volume[86111]: WARNING cinder.volume.drivers.remotefs [None req-e80a0700-a508-4496-9ce3-7115b25c8a69 tempest-ProjectMemberTests-1570638723 None] /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-38bc557b-49cd-489d-b83d-f96bddd0881d.info is being set with open permissions: ugo+rw Aug 29 01:29:39 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-e80a0700-a508-4496-9ce3-7115b25c8a69 tempest-ProjectMemberTests-1570638723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-38bc557b-49cd-489d-b83d-f96bddd0881d.info {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:39 devstack sudo[106179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-38bc557b-49cd-489d-b83d-f96bddd0881d.info Aug 29 01:29:39 devstack sudo[106179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:39 devstack sudo[106179]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:39 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-e80a0700-a508-4496-9ce3-7115b25c8a69 tempest-ProjectMemberTests-1570638723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-38bc557b-49cd-489d-b83d-f96bddd0881d.info" returned: 0 in 0.300s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:39 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-e80a0700-a508-4496-9ce3-7115b25c8a69 tempest-ProjectMemberTests-1570638723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.261s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:29:39 devstack cinder-volume[86111]: DEBUG dbcounter [-] [86111] Writing DB stats cinder:SELECT=197,cinder:INSERT=70,cinder:UPDATE=255,cinder:DELETE=21 {{(pid=86111) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 29 01:29:39 devstack cinder-volume[86111]: DEBUG dbcounter [-] [86111] Writing DB stats cinder:SELECT=203,cinder:UPDATE=269,cinder:DELETE=23,cinder:INSERT=70 {{(pid=86111) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 29 01:29:39 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-e80a0700-a508-4496-9ce3-7115b25c8a69 tempest-ProjectMemberTests-1570638723 None] Create snapshot completed successfully Aug 29 01:29:40 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-299f4253-91b8-45fe-856d-da019e70c91b tempest-ProjectMemberTests-1570638723 None] Acquiring lock "cinder-69802222-80f6-4206-8651-1f800ccac4f7-delete_snapshot" by "delete_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:29:40 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-299f4253-91b8-45fe-856d-da019e70c91b tempest-ProjectMemberTests-1570638723 None] Lock "cinder-69802222-80f6-4206-8651-1f800ccac4f7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:29:40 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-299f4253-91b8-45fe-856d-da019e70c91b tempest-ProjectMemberTests-1570638723 None] Acquiring lock "cinder-quobyte-38bc557b-49cd-489d-b83d-f96bddd0881d" by "delete_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:29:40 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-299f4253-91b8-45fe-856d-da019e70c91b tempest-ProjectMemberTests-1570638723 None] Lock "cinder-quobyte-38bc557b-49cd-489d-b83d-f96bddd0881d" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:29:40 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-299f4253-91b8-45fe-856d-da019e70c91b tempest-ProjectMemberTests-1570638723 None] Acquiring lock "cinder-quobyte-69802222-80f6-4206-8651-1f800ccac4f7" by "_delete_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:29:40 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-299f4253-91b8-45fe-856d-da019e70c91b tempest-ProjectMemberTests-1570638723 None] Lock "cinder-quobyte-69802222-80f6-4206-8651-1f800ccac4f7" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:29:40 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-299f4253-91b8-45fe-856d-da019e70c91b tempest-ProjectMemberTests-1570638723 None] Deleting offline snapshot 69802222-80f6-4206-8651-1f800ccac4f7 of volume 38bc557b-49cd-489d-b83d-f96bddd0881d {{(pid=86111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 29 01:29:40 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-299f4253-91b8-45fe-856d-da019e70c91b tempest-ProjectMemberTests-1570638723 None] snapshot_file for this snap is: volume-38bc557b-49cd-489d-b83d-f96bddd0881d.69802222-80f6-4206-8651-1f800ccac4f7 {{(pid=86111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 29 01:29:40 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[163fa0cc-aaef-4aa3-b562-7b5deb135252]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:29:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-299f4253-91b8-45fe-856d-da019e70c91b tempest-ProjectMemberTests-1570638723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-38bc557b-49cd-489d-b83d-f96bddd0881d.69802222-80f6-4206-8651-1f800ccac4f7 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:40 devstack cinder-volume[86111]: DEBUG oslo_service.periodic_task [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86111) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 29 01:29:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:29:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:29:40 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:29:40 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:29:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:29:40 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:40 devstack sudo[106185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:29:40 devstack sudo[106185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:40 devstack sudo[106184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-38bc557b-49cd-489d-b83d-f96bddd0881d.69802222-80f6-4206-8651-1f800ccac4f7 Aug 29 01:29:40 devstack sudo[106184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:41 devstack sudo[106185]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:41 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-de752545-d617-440e-8362-d04fae0901a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.296s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:41 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:29:41 devstack cinder-volume[86111]: DEBUG oslo_service.periodic_task [None req-de752545-d617-440e-8362-d04fae0901a5 None None] Running periodic task VolumeManager._thread_info {{(pid=86111) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 29 01:29:41 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-de752545-d617-440e-8362-d04fae0901a5 None None] thread count: 28 {{(pid=86111) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 29 01:29:41 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-de752545-d617-440e-8362-d04fae0901a5 None None] thread info: [<_MainThread(MainThread, started 129173440548992)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86111) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 29 01:29:41 devstack sudo[106184]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:41 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-299f4253-91b8-45fe-856d-da019e70c91b tempest-ProjectMemberTests-1570638723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-38bc557b-49cd-489d-b83d-f96bddd0881d.69802222-80f6-4206-8651-1f800ccac4f7" returned: 0 in 0.461s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:41 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-299f4253-91b8-45fe-856d-da019e70c91b tempest-ProjectMemberTests-1570638723 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-38bc557b-49cd-489d-b83d-f96bddd0881d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 29 01:29:41 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fcf7815-6197-42cd-aab2-712d7c167aad]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:29:41 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-299f4253-91b8-45fe-856d-da019e70c91b tempest-ProjectMemberTests-1570638723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-38bc557b-49cd-489d-b83d-f96bddd0881d {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:41 devstack sudo[106192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-38bc557b-49cd-489d-b83d-f96bddd0881d Aug 29 01:29:41 devstack sudo[106192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:41 devstack sudo[106192]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:41 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-299f4253-91b8-45fe-856d-da019e70c91b tempest-ProjectMemberTests-1570638723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-38bc557b-49cd-489d-b83d-f96bddd0881d" returned: 0 in 0.418s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:41 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-299f4253-91b8-45fe-856d-da019e70c91b tempest-ProjectMemberTests-1570638723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-38bc557b-49cd-489d-b83d-f96bddd0881d.69802222-80f6-4206-8651-1f800ccac4f7 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:41 devstack sudo[106197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-38bc557b-49cd-489d-b83d-f96bddd0881d.69802222-80f6-4206-8651-1f800ccac4f7 Aug 29 01:29:41 devstack sudo[106197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:41 devstack sudo[106197]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:41 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-299f4253-91b8-45fe-856d-da019e70c91b tempest-ProjectMemberTests-1570638723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-38bc557b-49cd-489d-b83d-f96bddd0881d.69802222-80f6-4206-8651-1f800ccac4f7" returned: 0 in 0.352s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:41 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-299f4253-91b8-45fe-856d-da019e70c91b tempest-ProjectMemberTests-1570638723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-38bc557b-49cd-489d-b83d-f96bddd0881d.69802222-80f6-4206-8651-1f800ccac4f7 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:42 devstack sudo[106203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-38bc557b-49cd-489d-b83d-f96bddd0881d.69802222-80f6-4206-8651-1f800ccac4f7 Aug 29 01:29:42 devstack sudo[106203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:42 devstack sudo[106203]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:42 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-299f4253-91b8-45fe-856d-da019e70c91b tempest-ProjectMemberTests-1570638723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-38bc557b-49cd-489d-b83d-f96bddd0881d.69802222-80f6-4206-8651-1f800ccac4f7" returned: 0 in 0.266s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:42 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-299f4253-91b8-45fe-856d-da019e70c91b tempest-ProjectMemberTests-1570638723 None] Lock "cinder-quobyte-69802222-80f6-4206-8651-1f800ccac4f7" released by "_delete_snapshot" :: held 1.631s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:29:42 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-299f4253-91b8-45fe-856d-da019e70c91b tempest-ProjectMemberTests-1570638723 None] Lock "cinder-quobyte-38bc557b-49cd-489d-b83d-f96bddd0881d" released by "delete_snapshot" :: held 1.665s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:29:42 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-299f4253-91b8-45fe-856d-da019e70c91b tempest-ProjectMemberTests-1570638723 None] Created reservations ['5e4c3f25-2fcf-4963-938b-cca19eda196f', '170bf288-df4e-4481-86f5-d434c22833a4', 'd5e39d07-e376-40d7-9dd6-e5e6fa8b3dc9', '05a8e0dd-d7b5-42e0-84b4-1ef635a98616'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:29:42 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-299f4253-91b8-45fe-856d-da019e70c91b tempest-ProjectMemberTests-1570638723 None] Delete snapshot completed successfully. Aug 29 01:29:42 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-299f4253-91b8-45fe-856d-da019e70c91b tempest-ProjectMemberTests-1570638723 None] Lock "cinder-69802222-80f6-4206-8651-1f800ccac4f7-delete_snapshot" released by "delete_snapshot" :: held 1.931s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:29:42 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-3ce040cb-9573-4fd1-9bea-19261815d998 tempest-ProjectMemberTests-1570638723 None] Acquiring lock "cinder-38bc557b-49cd-489d-b83d-f96bddd0881d-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:29:42 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-3ce040cb-9573-4fd1-9bea-19261815d998 tempest-ProjectMemberTests-1570638723 None] Lock "cinder-38bc557b-49cd-489d-b83d-f96bddd0881d-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:29:42 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-3ce040cb-9573-4fd1-9bea-19261815d998 tempest-ProjectMemberTests-1570638723 None] Acquiring lock "cinder-quobyte-38bc557b-49cd-489d-b83d-f96bddd0881d" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:29:42 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-3ce040cb-9573-4fd1-9bea-19261815d998 tempest-ProjectMemberTests-1570638723 None] Lock "cinder-quobyte-38bc557b-49cd-489d-b83d-f96bddd0881d" acquired by "delete_volume" :: waited 0.021s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:29:42 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[4076c569-71b9-458d-93e7-6a16e5445c3d]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:29:42 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-3ce040cb-9573-4fd1-9bea-19261815d998 tempest-ProjectMemberTests-1570638723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-38bc557b-49cd-489d-b83d-f96bddd0881d {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:43 devstack sudo[106206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-38bc557b-49cd-489d-b83d-f96bddd0881d Aug 29 01:29:43 devstack sudo[106206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:43 devstack sudo[106206]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:43 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-3ce040cb-9573-4fd1-9bea-19261815d998 tempest-ProjectMemberTests-1570638723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-38bc557b-49cd-489d-b83d-f96bddd0881d" returned: 0 in 0.469s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:43 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-3ce040cb-9573-4fd1-9bea-19261815d998 tempest-ProjectMemberTests-1570638723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-38bc557b-49cd-489d-b83d-f96bddd0881d {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:43 devstack sudo[106212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-38bc557b-49cd-489d-b83d-f96bddd0881d Aug 29 01:29:43 devstack sudo[106212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:43 devstack sudo[106212]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:43 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-3ce040cb-9573-4fd1-9bea-19261815d998 tempest-ProjectMemberTests-1570638723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-38bc557b-49cd-489d-b83d-f96bddd0881d" returned: 0 in 0.311s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:43 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-3ce040cb-9573-4fd1-9bea-19261815d998 tempest-ProjectMemberTests-1570638723 None] Lock "cinder-quobyte-38bc557b-49cd-489d-b83d-f96bddd0881d" released by "delete_volume" :: held 0.858s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:29:43 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-3ce040cb-9573-4fd1-9bea-19261815d998 tempest-ProjectMemberTests-1570638723 None] Created reservations ['c3c1b027-b2f1-405e-a760-22692e3937be', '74ac6a56-acc5-462d-ac7f-58d9b59d9fef', 'e7030eda-1073-43ab-9f40-dcfdcb3ab12e', '4bb0e227-5938-481f-ae7c-10547ee05c52'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:29:43 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-3ce040cb-9573-4fd1-9bea-19261815d998 tempest-ProjectMemberTests-1570638723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:29:43 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-3ce040cb-9573-4fd1-9bea-19261815d998 tempest-ProjectMemberTests-1570638723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:29:43 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-3ce040cb-9573-4fd1-9bea-19261815d998 tempest-ProjectMemberTests-1570638723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:29:43 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-3ce040cb-9573-4fd1-9bea-19261815d998 tempest-ProjectMemberTests-1570638723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:29:43 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-3ce040cb-9573-4fd1-9bea-19261815d998 tempest-ProjectMemberTests-1570638723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:29:43 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-3ce040cb-9573-4fd1-9bea-19261815d998 tempest-ProjectMemberTests-1570638723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:43 devstack sudo[106215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:29:43 devstack sudo[106215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:44 devstack sudo[106215]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:44 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-3ce040cb-9573-4fd1-9bea-19261815d998 tempest-ProjectMemberTests-1570638723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.290s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:44 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-3ce040cb-9573-4fd1-9bea-19261815d998 tempest-ProjectMemberTests-1570638723 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:29:44 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-3ce040cb-9573-4fd1-9bea-19261815d998 tempest-ProjectMemberTests-1570638723 None] Deleted volume successfully. Aug 29 01:29:44 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-3ce040cb-9573-4fd1-9bea-19261815d998 tempest-ProjectMemberTests-1570638723 None] Lock "cinder-38bc557b-49cd-489d-b83d-f96bddd0881d-delete_volume" released by "delete_volume" :: held 1.410s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:29:44 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-40f762cb-31d4-4015-9fd1-ed8a63db08c4 tempest-ProjectMemberTests-1570638723 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:29:44 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-40f762cb-31d4-4015-9fd1-ed8a63db08c4 tempest-ProjectMemberTests-1570638723 None] Flow 'volume_create_manager' (113816f1-aa87-40f4-adc6-176dbfc06581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:29:44 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-40f762cb-31d4-4015-9fd1-ed8a63db08c4 tempest-ProjectMemberTests-1570638723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98e6cd78-6563-459b-897a-3948cf3afdfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:29:44 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-40f762cb-31d4-4015-9fd1-ed8a63db08c4 tempest-ProjectMemberTests-1570638723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98e6cd78-6563-459b-897a-3948cf3afdfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:29:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-747530083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b63d9166-737f-4a1d-8467-79bb78590062,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc3e18b86dee456398aada5b169dc198',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:29:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:29:44Z,use_quota=True,user_id='ea18f1190bab494589a803742a7eb22a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:29:44 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-40f762cb-31d4-4015-9fd1-ed8a63db08c4 tempest-ProjectMemberTests-1570638723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1eb1c5ec-4bec-4917-864c-7511c8e44719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:29:44 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-40f762cb-31d4-4015-9fd1-ed8a63db08c4 tempest-ProjectMemberTests-1570638723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1eb1c5ec-4bec-4917-864c-7511c8e44719) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:29:44 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-40f762cb-31d4-4015-9fd1-ed8a63db08c4 tempest-ProjectMemberTests-1570638723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afde03c0-d828-4552-afcd-ef0968a0afe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:29:44 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-40f762cb-31d4-4015-9fd1-ed8a63db08c4 tempest-ProjectMemberTests-1570638723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afde03c0-d828-4552-afcd-ef0968a0afe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b63d9166-737f-4a1d-8467-79bb78590062', 'volume_name': 'volume-b63d9166-737f-4a1d-8467-79bb78590062', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:29:44 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-40f762cb-31d4-4015-9fd1-ed8a63db08c4 tempest-ProjectMemberTests-1570638723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adba476d-fc37-4611-9c0e-b018a2623c19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:29:44 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-40f762cb-31d4-4015-9fd1-ed8a63db08c4 tempest-ProjectMemberTests-1570638723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adba476d-fc37-4611-9c0e-b018a2623c19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:29:44 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-40f762cb-31d4-4015-9fd1-ed8a63db08c4 tempest-ProjectMemberTests-1570638723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27fa766e-85b2-4bef-be9a-8b363c164316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:29:44 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-40f762cb-31d4-4015-9fd1-ed8a63db08c4 tempest-ProjectMemberTests-1570638723 None] Volume b63d9166-737f-4a1d-8467-79bb78590062: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b63d9166-737f-4a1d-8467-79bb78590062', 'volume_size': 1} Aug 29 01:29:44 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-40f762cb-31d4-4015-9fd1-ed8a63db08c4 tempest-ProjectMemberTests-1570638723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:29:44 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-40f762cb-31d4-4015-9fd1-ed8a63db08c4 tempest-ProjectMemberTests-1570638723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:29:44 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-40f762cb-31d4-4015-9fd1-ed8a63db08c4 tempest-ProjectMemberTests-1570638723 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:29:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-747530083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b63d9166-737f-4a1d-8467-79bb78590062,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc3e18b86dee456398aada5b169dc198',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:29:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:29:44Z,use_quota=True,user_id='ea18f1190bab494589a803742a7eb22a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:29:44 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-40f762cb-31d4-4015-9fd1-ed8a63db08c4 tempest-ProjectMemberTests-1570638723 None] Creating volume b63d9166-737f-4a1d-8467-79bb78590062 {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:29:44 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-40f762cb-31d4-4015-9fd1-ed8a63db08c4 tempest-ProjectMemberTests-1570638723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:29:44 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-40f762cb-31d4-4015-9fd1-ed8a63db08c4 tempest-ProjectMemberTests-1570638723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:29:44 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-40f762cb-31d4-4015-9fd1-ed8a63db08c4 tempest-ProjectMemberTests-1570638723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:29:44 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-40f762cb-31d4-4015-9fd1-ed8a63db08c4 tempest-ProjectMemberTests-1570638723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:29:44 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-40f762cb-31d4-4015-9fd1-ed8a63db08c4 tempest-ProjectMemberTests-1570638723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:29:44 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-40f762cb-31d4-4015-9fd1-ed8a63db08c4 tempest-ProjectMemberTests-1570638723 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:29:44 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-40f762cb-31d4-4015-9fd1-ed8a63db08c4 tempest-ProjectMemberTests-1570638723 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:29:44 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-40f762cb-31d4-4015-9fd1-ed8a63db08c4 tempest-ProjectMemberTests-1570638723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-b63d9166-737f-4a1d-8467-79bb78590062 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:44 devstack sudo[106218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-b63d9166-737f-4a1d-8467-79bb78590062 1073741824 Aug 29 01:29:44 devstack sudo[106218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:45 devstack sudo[106218]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:45 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-40f762cb-31d4-4015-9fd1-ed8a63db08c4 tempest-ProjectMemberTests-1570638723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-b63d9166-737f-4a1d-8467-79bb78590062 1073741824" returned: 0 in 0.506s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:45 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-40f762cb-31d4-4015-9fd1-ed8a63db08c4 tempest-ProjectMemberTests-1570638723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-b63d9166-737f-4a1d-8467-79bb78590062 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:45 devstack sudo[106224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-b63d9166-737f-4a1d-8467-79bb78590062 Aug 29 01:29:45 devstack sudo[106224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:45 devstack sudo[106224]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:45 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-40f762cb-31d4-4015-9fd1-ed8a63db08c4 tempest-ProjectMemberTests-1570638723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-b63d9166-737f-4a1d-8467-79bb78590062" returned: 0 in 0.272s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:45 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-40f762cb-31d4-4015-9fd1-ed8a63db08c4 tempest-ProjectMemberTests-1570638723 None] <== create_volume: return (836ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:29:45 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-40f762cb-31d4-4015-9fd1-ed8a63db08c4 tempest-ProjectMemberTests-1570638723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.840s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:29:45 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-40f762cb-31d4-4015-9fd1-ed8a63db08c4 tempest-ProjectMemberTests-1570638723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27fa766e-85b2-4bef-be9a-8b363c164316) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b63d9166-737f-4a1d-8467-79bb78590062', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:29:45 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-40f762cb-31d4-4015-9fd1-ed8a63db08c4 tempest-ProjectMemberTests-1570638723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dff3384-2baf-4481-ba9b-23279765b4b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:29:45 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-40f762cb-31d4-4015-9fd1-ed8a63db08c4 tempest-ProjectMemberTests-1570638723 None] Volume volume-b63d9166-737f-4a1d-8467-79bb78590062 (b63d9166-737f-4a1d-8467-79bb78590062): created successfully Aug 29 01:29:45 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-40f762cb-31d4-4015-9fd1-ed8a63db08c4 tempest-ProjectMemberTests-1570638723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dff3384-2baf-4481-ba9b-23279765b4b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:29:45 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-40f762cb-31d4-4015-9fd1-ed8a63db08c4 tempest-ProjectMemberTests-1570638723 None] Flow 'volume_create_manager' (113816f1-aa87-40f4-adc6-176dbfc06581) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:29:45 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-40f762cb-31d4-4015-9fd1-ed8a63db08c4 tempest-ProjectMemberTests-1570638723 None] Created volume successfully. Aug 29 01:29:46 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-687f9faf-e1a2-4eba-af0a-0a41d81dd685 tempest-ProjectMemberTests-1570638723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:29:46 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-687f9faf-e1a2-4eba-af0a-0a41d81dd685 tempest-ProjectMemberTests-1570638723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:29:46 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-687f9faf-e1a2-4eba-af0a-0a41d81dd685 tempest-ProjectMemberTests-1570638723 None] Creating offline snapshot 3e404ca2-51f9-4fca-9d39-dadbf2f1afb3 of volume b63d9166-737f-4a1d-8467-79bb78590062 {{(pid=86111) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 29 01:29:46 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3a38e24-9636-4e27-b361-da78540623b6]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:29:46 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-687f9faf-e1a2-4eba-af0a-0a41d81dd685 tempest-ProjectMemberTests-1570638723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-b63d9166-737f-4a1d-8467-79bb78590062 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:46 devstack sudo[106227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-b63d9166-737f-4a1d-8467-79bb78590062 Aug 29 01:29:46 devstack sudo[106227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:47 devstack sudo[106227]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:47 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-687f9faf-e1a2-4eba-af0a-0a41d81dd685 tempest-ProjectMemberTests-1570638723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-b63d9166-737f-4a1d-8467-79bb78590062" returned: 0 in 0.364s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:47 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-687f9faf-e1a2-4eba-af0a-0a41d81dd685 tempest-ProjectMemberTests-1570638723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-b63d9166-737f-4a1d-8467-79bb78590062,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-b63d9166-737f-4a1d-8467-79bb78590062.3e404ca2-51f9-4fca-9d39-dadbf2f1afb3 1G {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:47 devstack sudo[106232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-b63d9166-737f-4a1d-8467-79bb78590062,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-b63d9166-737f-4a1d-8467-79bb78590062.3e404ca2-51f9-4fca-9d39-dadbf2f1afb3 1G Aug 29 01:29:47 devstack sudo[106232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:47 devstack sudo[106232]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:47 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-687f9faf-e1a2-4eba-af0a-0a41d81dd685 tempest-ProjectMemberTests-1570638723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-b63d9166-737f-4a1d-8467-79bb78590062,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-b63d9166-737f-4a1d-8467-79bb78590062.3e404ca2-51f9-4fca-9d39-dadbf2f1afb3 1G" returned: 0 in 0.432s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:47 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-687f9faf-e1a2-4eba-af0a-0a41d81dd685 tempest-ProjectMemberTests-1570638723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b63d9166-737f-4a1d-8467-79bb78590062 -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-b63d9166-737f-4a1d-8467-79bb78590062.3e404ca2-51f9-4fca-9d39-dadbf2f1afb3 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:47 devstack sudo[106238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b63d9166-737f-4a1d-8467-79bb78590062 -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-b63d9166-737f-4a1d-8467-79bb78590062.3e404ca2-51f9-4fca-9d39-dadbf2f1afb3 Aug 29 01:29:47 devstack sudo[106238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:47 devstack sudo[106238]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:47 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-687f9faf-e1a2-4eba-af0a-0a41d81dd685 tempest-ProjectMemberTests-1570638723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b63d9166-737f-4a1d-8467-79bb78590062 -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-b63d9166-737f-4a1d-8467-79bb78590062.3e404ca2-51f9-4fca-9d39-dadbf2f1afb3" returned: 0 in 0.292s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:47 devstack cinder-volume[86111]: WARNING cinder.volume.drivers.remotefs [None req-687f9faf-e1a2-4eba-af0a-0a41d81dd685 tempest-ProjectMemberTests-1570638723 None] /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-b63d9166-737f-4a1d-8467-79bb78590062.3e404ca2-51f9-4fca-9d39-dadbf2f1afb3 is being set with open permissions: ugo+rw Aug 29 01:29:47 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-687f9faf-e1a2-4eba-af0a-0a41d81dd685 tempest-ProjectMemberTests-1570638723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-b63d9166-737f-4a1d-8467-79bb78590062.3e404ca2-51f9-4fca-9d39-dadbf2f1afb3 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:47 devstack sudo[106243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-b63d9166-737f-4a1d-8467-79bb78590062.3e404ca2-51f9-4fca-9d39-dadbf2f1afb3 Aug 29 01:29:47 devstack sudo[106243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:48 devstack sudo[106243]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:48 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-687f9faf-e1a2-4eba-af0a-0a41d81dd685 tempest-ProjectMemberTests-1570638723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-b63d9166-737f-4a1d-8467-79bb78590062.3e404ca2-51f9-4fca-9d39-dadbf2f1afb3" returned: 0 in 0.263s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:48 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-687f9faf-e1a2-4eba-af0a-0a41d81dd685 tempest-ProjectMemberTests-1570638723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-b63d9166-737f-4a1d-8467-79bb78590062.info {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:48 devstack sudo[106246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-b63d9166-737f-4a1d-8467-79bb78590062.info Aug 29 01:29:48 devstack sudo[106246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:48 devstack sudo[106246]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:48 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-687f9faf-e1a2-4eba-af0a-0a41d81dd685 tempest-ProjectMemberTests-1570638723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-b63d9166-737f-4a1d-8467-79bb78590062.info" returned: 0 in 0.280s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:48 devstack cinder-volume[86111]: WARNING cinder.volume.drivers.remotefs [None req-687f9faf-e1a2-4eba-af0a-0a41d81dd685 tempest-ProjectMemberTests-1570638723 None] /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-b63d9166-737f-4a1d-8467-79bb78590062.info is being set with open permissions: ugo+rw Aug 29 01:29:48 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-687f9faf-e1a2-4eba-af0a-0a41d81dd685 tempest-ProjectMemberTests-1570638723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-b63d9166-737f-4a1d-8467-79bb78590062.info {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:48 devstack sudo[106249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-b63d9166-737f-4a1d-8467-79bb78590062.info Aug 29 01:29:48 devstack sudo[106249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:48 devstack sudo[106249]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:48 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-687f9faf-e1a2-4eba-af0a-0a41d81dd685 tempest-ProjectMemberTests-1570638723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-b63d9166-737f-4a1d-8467-79bb78590062.info" returned: 0 in 0.265s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:48 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-687f9faf-e1a2-4eba-af0a-0a41d81dd685 tempest-ProjectMemberTests-1570638723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.985s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:29:48 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-687f9faf-e1a2-4eba-af0a-0a41d81dd685 tempest-ProjectMemberTests-1570638723 None] Create snapshot completed successfully Aug 29 01:29:48 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-18733528-aedc-4062-9c32-fab8000d3ab6 tempest-ProjectMemberTests-1570638723 None] Acquiring lock "cinder-3e404ca2-51f9-4fca-9d39-dadbf2f1afb3-delete_snapshot" by "delete_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:29:48 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-18733528-aedc-4062-9c32-fab8000d3ab6 tempest-ProjectMemberTests-1570638723 None] Lock "cinder-3e404ca2-51f9-4fca-9d39-dadbf2f1afb3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:29:48 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-18733528-aedc-4062-9c32-fab8000d3ab6 tempest-ProjectMemberTests-1570638723 None] Acquiring lock "cinder-quobyte-b63d9166-737f-4a1d-8467-79bb78590062" by "delete_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:29:48 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-18733528-aedc-4062-9c32-fab8000d3ab6 tempest-ProjectMemberTests-1570638723 None] Lock "cinder-quobyte-b63d9166-737f-4a1d-8467-79bb78590062" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:29:48 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-18733528-aedc-4062-9c32-fab8000d3ab6 tempest-ProjectMemberTests-1570638723 None] Acquiring lock "cinder-quobyte-3e404ca2-51f9-4fca-9d39-dadbf2f1afb3" by "_delete_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:29:48 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-18733528-aedc-4062-9c32-fab8000d3ab6 tempest-ProjectMemberTests-1570638723 None] Lock "cinder-quobyte-3e404ca2-51f9-4fca-9d39-dadbf2f1afb3" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:29:48 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-18733528-aedc-4062-9c32-fab8000d3ab6 tempest-ProjectMemberTests-1570638723 None] Deleting offline snapshot 3e404ca2-51f9-4fca-9d39-dadbf2f1afb3 of volume b63d9166-737f-4a1d-8467-79bb78590062 {{(pid=86111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 29 01:29:49 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-18733528-aedc-4062-9c32-fab8000d3ab6 tempest-ProjectMemberTests-1570638723 None] snapshot_file for this snap is: volume-b63d9166-737f-4a1d-8467-79bb78590062.3e404ca2-51f9-4fca-9d39-dadbf2f1afb3 {{(pid=86111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 29 01:29:49 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[525b78ef-914d-42a9-bc5c-fce078526397]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:29:49 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-18733528-aedc-4062-9c32-fab8000d3ab6 tempest-ProjectMemberTests-1570638723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-b63d9166-737f-4a1d-8467-79bb78590062.3e404ca2-51f9-4fca-9d39-dadbf2f1afb3 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:49 devstack sudo[106252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-b63d9166-737f-4a1d-8467-79bb78590062.3e404ca2-51f9-4fca-9d39-dadbf2f1afb3 Aug 29 01:29:49 devstack sudo[106252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:49 devstack sudo[106252]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:49 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-18733528-aedc-4062-9c32-fab8000d3ab6 tempest-ProjectMemberTests-1570638723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-b63d9166-737f-4a1d-8467-79bb78590062.3e404ca2-51f9-4fca-9d39-dadbf2f1afb3" returned: 0 in 0.365s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:49 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-18733528-aedc-4062-9c32-fab8000d3ab6 tempest-ProjectMemberTests-1570638723 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b63d9166-737f-4a1d-8467-79bb78590062(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 29 01:29:49 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[12cef32d-34c4-4b0d-a0a7-bc2f72dbbc31]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:29:49 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-18733528-aedc-4062-9c32-fab8000d3ab6 tempest-ProjectMemberTests-1570638723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-b63d9166-737f-4a1d-8467-79bb78590062 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:49 devstack sudo[106257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-b63d9166-737f-4a1d-8467-79bb78590062 Aug 29 01:29:49 devstack sudo[106257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:49 devstack sudo[106257]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:49 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-18733528-aedc-4062-9c32-fab8000d3ab6 tempest-ProjectMemberTests-1570638723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-b63d9166-737f-4a1d-8467-79bb78590062" returned: 0 in 0.383s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:49 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-18733528-aedc-4062-9c32-fab8000d3ab6 tempest-ProjectMemberTests-1570638723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-b63d9166-737f-4a1d-8467-79bb78590062.3e404ca2-51f9-4fca-9d39-dadbf2f1afb3 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:49 devstack sudo[106263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-b63d9166-737f-4a1d-8467-79bb78590062.3e404ca2-51f9-4fca-9d39-dadbf2f1afb3 Aug 29 01:29:49 devstack sudo[106263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:50 devstack sudo[106263]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:50 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-18733528-aedc-4062-9c32-fab8000d3ab6 tempest-ProjectMemberTests-1570638723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-b63d9166-737f-4a1d-8467-79bb78590062.3e404ca2-51f9-4fca-9d39-dadbf2f1afb3" returned: 0 in 0.379s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:50 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-18733528-aedc-4062-9c32-fab8000d3ab6 tempest-ProjectMemberTests-1570638723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-b63d9166-737f-4a1d-8467-79bb78590062.3e404ca2-51f9-4fca-9d39-dadbf2f1afb3 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:50 devstack sudo[106268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-b63d9166-737f-4a1d-8467-79bb78590062.3e404ca2-51f9-4fca-9d39-dadbf2f1afb3 Aug 29 01:29:50 devstack sudo[106268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:50 devstack sudo[106268]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:50 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-18733528-aedc-4062-9c32-fab8000d3ab6 tempest-ProjectMemberTests-1570638723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-b63d9166-737f-4a1d-8467-79bb78590062.3e404ca2-51f9-4fca-9d39-dadbf2f1afb3" returned: 0 in 0.266s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:50 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-18733528-aedc-4062-9c32-fab8000d3ab6 tempest-ProjectMemberTests-1570638723 None] Lock "cinder-quobyte-3e404ca2-51f9-4fca-9d39-dadbf2f1afb3" released by "_delete_snapshot" :: held 1.489s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:29:50 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-18733528-aedc-4062-9c32-fab8000d3ab6 tempest-ProjectMemberTests-1570638723 None] Lock "cinder-quobyte-b63d9166-737f-4a1d-8467-79bb78590062" released by "delete_snapshot" :: held 1.518s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:29:50 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-18733528-aedc-4062-9c32-fab8000d3ab6 tempest-ProjectMemberTests-1570638723 None] Created reservations ['0ef98466-92ba-4018-abbe-1757c9ecef10', '9d4645ad-16d0-48cf-ba50-5ac3a8fc55dc', '984682d7-86fe-48b4-8dcf-ffe03bf4017e', '2d297cbc-fc99-4b7e-8133-8913eb1bf331'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:29:50 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-18733528-aedc-4062-9c32-fab8000d3ab6 tempest-ProjectMemberTests-1570638723 None] Delete snapshot completed successfully. Aug 29 01:29:50 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-18733528-aedc-4062-9c32-fab8000d3ab6 tempest-ProjectMemberTests-1570638723 None] Lock "cinder-3e404ca2-51f9-4fca-9d39-dadbf2f1afb3-delete_snapshot" released by "delete_snapshot" :: held 1.719s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:29:51 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-ac84bf46-c185-477c-bbfe-0a6712aa57f5 tempest-ProjectMemberTests-1570638723 None] Acquiring lock "cinder-b63d9166-737f-4a1d-8467-79bb78590062-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:29:51 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-ac84bf46-c185-477c-bbfe-0a6712aa57f5 tempest-ProjectMemberTests-1570638723 None] Lock "cinder-b63d9166-737f-4a1d-8467-79bb78590062-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:29:51 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-ac84bf46-c185-477c-bbfe-0a6712aa57f5 tempest-ProjectMemberTests-1570638723 None] Acquiring lock "cinder-quobyte-b63d9166-737f-4a1d-8467-79bb78590062" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:29:51 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-ac84bf46-c185-477c-bbfe-0a6712aa57f5 tempest-ProjectMemberTests-1570638723 None] Lock "cinder-quobyte-b63d9166-737f-4a1d-8467-79bb78590062" acquired by "delete_volume" :: waited 0.015s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:29:51 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebfb6d36-c961-47a1-b92e-5dc0d6d3763d]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:29:51 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-ac84bf46-c185-477c-bbfe-0a6712aa57f5 tempest-ProjectMemberTests-1570638723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-b63d9166-737f-4a1d-8467-79bb78590062 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:51 devstack sudo[106271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-b63d9166-737f-4a1d-8467-79bb78590062 Aug 29 01:29:51 devstack sudo[106271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:51 devstack sudo[106271]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:51 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-ac84bf46-c185-477c-bbfe-0a6712aa57f5 tempest-ProjectMemberTests-1570638723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-b63d9166-737f-4a1d-8467-79bb78590062" returned: 0 in 0.356s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:51 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-ac84bf46-c185-477c-bbfe-0a6712aa57f5 tempest-ProjectMemberTests-1570638723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-b63d9166-737f-4a1d-8467-79bb78590062 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:51 devstack sudo[106276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-b63d9166-737f-4a1d-8467-79bb78590062 Aug 29 01:29:51 devstack sudo[106276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:51 devstack sudo[106276]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:51 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-ac84bf46-c185-477c-bbfe-0a6712aa57f5 tempest-ProjectMemberTests-1570638723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-b63d9166-737f-4a1d-8467-79bb78590062" returned: 0 in 0.249s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:51 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-ac84bf46-c185-477c-bbfe-0a6712aa57f5 tempest-ProjectMemberTests-1570638723 None] Lock "cinder-quobyte-b63d9166-737f-4a1d-8467-79bb78590062" released by "delete_volume" :: held 0.658s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:29:51 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-ac84bf46-c185-477c-bbfe-0a6712aa57f5 tempest-ProjectMemberTests-1570638723 None] Created reservations ['8b45f7e0-1d97-482d-9524-fb8e9578cf89', 'b1ba2a47-a1e4-451a-a409-4b27dee806cf', 'a0a66024-758d-48ae-833f-514177870382', '63eb06dd-3e2f-4c7f-a493-94990d8194dc'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:29:51 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-ac84bf46-c185-477c-bbfe-0a6712aa57f5 tempest-ProjectMemberTests-1570638723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:29:51 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-ac84bf46-c185-477c-bbfe-0a6712aa57f5 tempest-ProjectMemberTests-1570638723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:29:51 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-ac84bf46-c185-477c-bbfe-0a6712aa57f5 tempest-ProjectMemberTests-1570638723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:29:51 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-ac84bf46-c185-477c-bbfe-0a6712aa57f5 tempest-ProjectMemberTests-1570638723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:29:51 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-ac84bf46-c185-477c-bbfe-0a6712aa57f5 tempest-ProjectMemberTests-1570638723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:29:51 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-ac84bf46-c185-477c-bbfe-0a6712aa57f5 tempest-ProjectMemberTests-1570638723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:51 devstack sudo[106279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:29:51 devstack sudo[106279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:52 devstack sudo[106279]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:52 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-ac84bf46-c185-477c-bbfe-0a6712aa57f5 tempest-ProjectMemberTests-1570638723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.243s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:52 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-ac84bf46-c185-477c-bbfe-0a6712aa57f5 tempest-ProjectMemberTests-1570638723 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:29:52 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-ac84bf46-c185-477c-bbfe-0a6712aa57f5 tempest-ProjectMemberTests-1570638723 None] Deleted volume successfully. Aug 29 01:29:52 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-ac84bf46-c185-477c-bbfe-0a6712aa57f5 tempest-ProjectMemberTests-1570638723 None] Lock "cinder-b63d9166-737f-4a1d-8467-79bb78590062-delete_volume" released by "delete_volume" :: held 1.093s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:29:52 devstack cinder-volume[86111]: DEBUG cinder.volume.flows.manager.create_volume [None req-dae13480-03ae-4b0d-a109-b6ae6e824f61 tempest-ProjectMemberTests-1570638723 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86111) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 29 01:29:52 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-dae13480-03ae-4b0d-a109-b6ae6e824f61 tempest-ProjectMemberTests-1570638723 None] Flow 'volume_create_manager' (7a5fea47-7f46-4279-9474-622da356e593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:29:52 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-dae13480-03ae-4b0d-a109-b6ae6e824f61 tempest-ProjectMemberTests-1570638723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45229509-dd56-476b-8bcf-60aac5420dec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:29:52 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-dae13480-03ae-4b0d-a109-b6ae6e824f61 tempest-ProjectMemberTests-1570638723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45229509-dd56-476b-8bcf-60aac5420dec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:29:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1692649709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ee14909-52cd-4c0d-ab8a-5074f80f0627,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc3e18b86dee456398aada5b169dc198',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:29:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:29:53Z,use_quota=True,user_id='ea18f1190bab494589a803742a7eb22a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:29:52 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-dae13480-03ae-4b0d-a109-b6ae6e824f61 tempest-ProjectMemberTests-1570638723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (260cda8d-2b4f-48a6-bfa1-136d1c3e2b52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:29:52 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-dae13480-03ae-4b0d-a109-b6ae6e824f61 tempest-ProjectMemberTests-1570638723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (260cda8d-2b4f-48a6-bfa1-136d1c3e2b52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:29:52 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-dae13480-03ae-4b0d-a109-b6ae6e824f61 tempest-ProjectMemberTests-1570638723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76d87b0c-4bb2-47f1-94a2-08331367a36a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:29:52 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-dae13480-03ae-4b0d-a109-b6ae6e824f61 tempest-ProjectMemberTests-1570638723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76d87b0c-4bb2-47f1-94a2-08331367a36a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ee14909-52cd-4c0d-ab8a-5074f80f0627', 'volume_name': 'volume-4ee14909-52cd-4c0d-ab8a-5074f80f0627', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:29:52 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-dae13480-03ae-4b0d-a109-b6ae6e824f61 tempest-ProjectMemberTests-1570638723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea3bb496-3f6a-444b-8916-dc713a5b5a67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:29:52 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-dae13480-03ae-4b0d-a109-b6ae6e824f61 tempest-ProjectMemberTests-1570638723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea3bb496-3f6a-444b-8916-dc713a5b5a67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:29:52 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-dae13480-03ae-4b0d-a109-b6ae6e824f61 tempest-ProjectMemberTests-1570638723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13f8850f-597b-4bda-8b01-6881fde1102b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:29:52 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-dae13480-03ae-4b0d-a109-b6ae6e824f61 tempest-ProjectMemberTests-1570638723 None] Volume 4ee14909-52cd-4c0d-ab8a-5074f80f0627: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ee14909-52cd-4c0d-ab8a-5074f80f0627', 'volume_size': 1} Aug 29 01:29:52 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-dae13480-03ae-4b0d-a109-b6ae6e824f61 tempest-ProjectMemberTests-1570638723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:29:52 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-dae13480-03ae-4b0d-a109-b6ae6e824f61 tempest-ProjectMemberTests-1570638723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:29:52 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-dae13480-03ae-4b0d-a109-b6ae6e824f61 tempest-ProjectMemberTests-1570638723 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-28T23:29:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1692649709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ee14909-52cd-4c0d-ab8a-5074f80f0627,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc3e18b86dee456398aada5b169dc198',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-28T23:29:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-28T23:29:53Z,use_quota=True,user_id='ea18f1190bab494589a803742a7eb22a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7abfdc43-9986-42ff-a559-8f75f24f2b09),volume_type_id=7abfdc43-9986-42ff-a559-8f75f24f2b09)}" {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 29 01:29:52 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-dae13480-03ae-4b0d-a109-b6ae6e824f61 tempest-ProjectMemberTests-1570638723 None] Creating volume 4ee14909-52cd-4c0d-ab8a-5074f80f0627 {{(pid=86111) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 29 01:29:52 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-dae13480-03ae-4b0d-a109-b6ae6e824f61 tempest-ProjectMemberTests-1570638723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:29:52 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-dae13480-03ae-4b0d-a109-b6ae6e824f61 tempest-ProjectMemberTests-1570638723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:29:52 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-dae13480-03ae-4b0d-a109-b6ae6e824f61 tempest-ProjectMemberTests-1570638723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:29:52 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-dae13480-03ae-4b0d-a109-b6ae6e824f61 tempest-ProjectMemberTests-1570638723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:29:52 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-dae13480-03ae-4b0d-a109-b6ae6e824f61 tempest-ProjectMemberTests-1570638723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:29:52 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-dae13480-03ae-4b0d-a109-b6ae6e824f61 tempest-ProjectMemberTests-1570638723 None] Selected osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 as target Quobyte volume. {{(pid=86111) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 29 01:29:52 devstack cinder-volume[86111]: INFO cinder.volume.drivers.remotefs [None req-dae13480-03ae-4b0d-a109-b6ae6e824f61 tempest-ProjectMemberTests-1570638723 None] casted to osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630 Aug 29 01:29:52 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-dae13480-03ae-4b0d-a109-b6ae6e824f61 tempest-ProjectMemberTests-1570638723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-4ee14909-52cd-4c0d-ab8a-5074f80f0627 1073741824 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:52 devstack sudo[106282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-4ee14909-52cd-4c0d-ab8a-5074f80f0627 1073741824 Aug 29 01:29:52 devstack sudo[106282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:53 devstack sudo[106282]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:53 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-dae13480-03ae-4b0d-a109-b6ae6e824f61 tempest-ProjectMemberTests-1570638723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-4ee14909-52cd-4c0d-ab8a-5074f80f0627 1073741824" returned: 0 in 0.404s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:53 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-dae13480-03ae-4b0d-a109-b6ae6e824f61 tempest-ProjectMemberTests-1570638723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-4ee14909-52cd-4c0d-ab8a-5074f80f0627 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:53 devstack sudo[106287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-4ee14909-52cd-4c0d-ab8a-5074f80f0627 Aug 29 01:29:53 devstack sudo[106287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:53 devstack sudo[106287]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:53 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-dae13480-03ae-4b0d-a109-b6ae6e824f61 tempest-ProjectMemberTests-1570638723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-4ee14909-52cd-4c0d-ab8a-5074f80f0627" returned: 0 in 0.245s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:53 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-dae13480-03ae-4b0d-a109-b6ae6e824f61 tempest-ProjectMemberTests-1570638723 None] <== create_volume: return (692ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'} {{(pid=86111) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 29 01:29:53 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-dae13480-03ae-4b0d-a109-b6ae6e824f61 tempest-ProjectMemberTests-1570638723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.696s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:29:53 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-dae13480-03ae-4b0d-a109-b6ae6e824f61 tempest-ProjectMemberTests-1570638723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13f8850f-597b-4bda-8b01-6881fde1102b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ee14909-52cd-4c0d-ab8a-5074f80f0627', 'volume_size': 1}' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:29:53 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-dae13480-03ae-4b0d-a109-b6ae6e824f61 tempest-ProjectMemberTests-1570638723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f227d70e-63c6-4d62-9a88-3ecd4610815e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 29 01:29:53 devstack cinder-volume[86111]: INFO cinder.volume.flows.manager.create_volume [None req-dae13480-03ae-4b0d-a109-b6ae6e824f61 tempest-ProjectMemberTests-1570638723 None] Volume volume-4ee14909-52cd-4c0d-ab8a-5074f80f0627 (4ee14909-52cd-4c0d-ab8a-5074f80f0627): created successfully Aug 29 01:29:53 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-dae13480-03ae-4b0d-a109-b6ae6e824f61 tempest-ProjectMemberTests-1570638723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f227d70e-63c6-4d62-9a88-3ecd4610815e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86111) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 29 01:29:53 devstack cinder-volume[86111]: DEBUG cinder.volume.manager [None req-dae13480-03ae-4b0d-a109-b6ae6e824f61 tempest-ProjectMemberTests-1570638723 None] Flow 'volume_create_manager' (7a5fea47-7f46-4279-9474-622da356e593) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86111) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 29 01:29:53 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-dae13480-03ae-4b0d-a109-b6ae6e824f61 tempest-ProjectMemberTests-1570638723 None] Created volume successfully. Aug 29 01:29:53 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-0611c713-6cc8-43ab-9a11-e4701aa334d3 tempest-ProjectMemberTests-1570638723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:29:53 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-0611c713-6cc8-43ab-9a11-e4701aa334d3 tempest-ProjectMemberTests-1570638723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:29:53 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-0611c713-6cc8-43ab-9a11-e4701aa334d3 tempest-ProjectMemberTests-1570638723 None] Creating offline snapshot 7de50e59-895a-444b-b816-5bb7deef62c2 of volume 4ee14909-52cd-4c0d-ab8a-5074f80f0627 {{(pid=86111) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 29 01:29:53 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[620e56fc-7cf5-47cd-828c-4a2a1b16c7bf]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:29:53 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-0611c713-6cc8-43ab-9a11-e4701aa334d3 tempest-ProjectMemberTests-1570638723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-4ee14909-52cd-4c0d-ab8a-5074f80f0627 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:53 devstack sudo[106290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-4ee14909-52cd-4c0d-ab8a-5074f80f0627 Aug 29 01:29:53 devstack sudo[106290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:54 devstack sudo[106290]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:54 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-0611c713-6cc8-43ab-9a11-e4701aa334d3 tempest-ProjectMemberTests-1570638723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-4ee14909-52cd-4c0d-ab8a-5074f80f0627" returned: 0 in 0.354s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:54 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-0611c713-6cc8-43ab-9a11-e4701aa334d3 tempest-ProjectMemberTests-1570638723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-4ee14909-52cd-4c0d-ab8a-5074f80f0627,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-4ee14909-52cd-4c0d-ab8a-5074f80f0627.7de50e59-895a-444b-b816-5bb7deef62c2 1G {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:54 devstack sudo[106295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-4ee14909-52cd-4c0d-ab8a-5074f80f0627,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-4ee14909-52cd-4c0d-ab8a-5074f80f0627.7de50e59-895a-444b-b816-5bb7deef62c2 1G Aug 29 01:29:54 devstack sudo[106295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:54 devstack sudo[106295]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:54 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-0611c713-6cc8-43ab-9a11-e4701aa334d3 tempest-ProjectMemberTests-1570638723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-4ee14909-52cd-4c0d-ab8a-5074f80f0627,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-4ee14909-52cd-4c0d-ab8a-5074f80f0627.7de50e59-895a-444b-b816-5bb7deef62c2 1G" returned: 0 in 0.384s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:54 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-0611c713-6cc8-43ab-9a11-e4701aa334d3 tempest-ProjectMemberTests-1570638723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ee14909-52cd-4c0d-ab8a-5074f80f0627 -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-4ee14909-52cd-4c0d-ab8a-5074f80f0627.7de50e59-895a-444b-b816-5bb7deef62c2 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:54 devstack sudo[106301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ee14909-52cd-4c0d-ab8a-5074f80f0627 -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-4ee14909-52cd-4c0d-ab8a-5074f80f0627.7de50e59-895a-444b-b816-5bb7deef62c2 Aug 29 01:29:54 devstack sudo[106301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:54 devstack sudo[106301]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:54 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-0611c713-6cc8-43ab-9a11-e4701aa334d3 tempest-ProjectMemberTests-1570638723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ee14909-52cd-4c0d-ab8a-5074f80f0627 -F qcow2 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-4ee14909-52cd-4c0d-ab8a-5074f80f0627.7de50e59-895a-444b-b816-5bb7deef62c2" returned: 0 in 0.291s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:54 devstack cinder-volume[86111]: WARNING cinder.volume.drivers.remotefs [None req-0611c713-6cc8-43ab-9a11-e4701aa334d3 tempest-ProjectMemberTests-1570638723 None] /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-4ee14909-52cd-4c0d-ab8a-5074f80f0627.7de50e59-895a-444b-b816-5bb7deef62c2 is being set with open permissions: ugo+rw Aug 29 01:29:54 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-0611c713-6cc8-43ab-9a11-e4701aa334d3 tempest-ProjectMemberTests-1570638723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-4ee14909-52cd-4c0d-ab8a-5074f80f0627.7de50e59-895a-444b-b816-5bb7deef62c2 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:54 devstack sudo[106307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-4ee14909-52cd-4c0d-ab8a-5074f80f0627.7de50e59-895a-444b-b816-5bb7deef62c2 Aug 29 01:29:54 devstack sudo[106307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:55 devstack sudo[106307]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:55 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-0611c713-6cc8-43ab-9a11-e4701aa334d3 tempest-ProjectMemberTests-1570638723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-4ee14909-52cd-4c0d-ab8a-5074f80f0627.7de50e59-895a-444b-b816-5bb7deef62c2" returned: 0 in 0.244s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:55 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-0611c713-6cc8-43ab-9a11-e4701aa334d3 tempest-ProjectMemberTests-1570638723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-4ee14909-52cd-4c0d-ab8a-5074f80f0627.info {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:55 devstack sudo[106310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-4ee14909-52cd-4c0d-ab8a-5074f80f0627.info Aug 29 01:29:55 devstack sudo[106310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:55 devstack sudo[106310]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:55 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-0611c713-6cc8-43ab-9a11-e4701aa334d3 tempest-ProjectMemberTests-1570638723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-4ee14909-52cd-4c0d-ab8a-5074f80f0627.info" returned: 0 in 0.245s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:55 devstack cinder-volume[86111]: WARNING cinder.volume.drivers.remotefs [None req-0611c713-6cc8-43ab-9a11-e4701aa334d3 tempest-ProjectMemberTests-1570638723 None] /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-4ee14909-52cd-4c0d-ab8a-5074f80f0627.info is being set with open permissions: ugo+rw Aug 29 01:29:55 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-0611c713-6cc8-43ab-9a11-e4701aa334d3 tempest-ProjectMemberTests-1570638723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-4ee14909-52cd-4c0d-ab8a-5074f80f0627.info {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:55 devstack sudo[106313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-4ee14909-52cd-4c0d-ab8a-5074f80f0627.info Aug 29 01:29:55 devstack sudo[106313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:55 devstack sudo[106313]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:55 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-0611c713-6cc8-43ab-9a11-e4701aa334d3 tempest-ProjectMemberTests-1570638723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-4ee14909-52cd-4c0d-ab8a-5074f80f0627.info" returned: 0 in 0.235s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:55 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-0611c713-6cc8-43ab-9a11-e4701aa334d3 tempest-ProjectMemberTests-1570638723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.827s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:29:55 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-0611c713-6cc8-43ab-9a11-e4701aa334d3 tempest-ProjectMemberTests-1570638723 None] Create snapshot completed successfully Aug 29 01:29:56 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-ef306f8f-72d9-4d98-a723-c44c742bf407 tempest-ProjectMemberTests-1570638723 None] Acquiring lock "cinder-7de50e59-895a-444b-b816-5bb7deef62c2-delete_snapshot" by "delete_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:29:56 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-ef306f8f-72d9-4d98-a723-c44c742bf407 tempest-ProjectMemberTests-1570638723 None] Lock "cinder-7de50e59-895a-444b-b816-5bb7deef62c2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:29:56 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-ef306f8f-72d9-4d98-a723-c44c742bf407 tempest-ProjectMemberTests-1570638723 None] Acquiring lock "cinder-quobyte-4ee14909-52cd-4c0d-ab8a-5074f80f0627" by "delete_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:29:56 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-ef306f8f-72d9-4d98-a723-c44c742bf407 tempest-ProjectMemberTests-1570638723 None] Lock "cinder-quobyte-4ee14909-52cd-4c0d-ab8a-5074f80f0627" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:29:56 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-ef306f8f-72d9-4d98-a723-c44c742bf407 tempest-ProjectMemberTests-1570638723 None] Acquiring lock "cinder-quobyte-7de50e59-895a-444b-b816-5bb7deef62c2" by "_delete_snapshot" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:29:56 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-ef306f8f-72d9-4d98-a723-c44c742bf407 tempest-ProjectMemberTests-1570638723 None] Lock "cinder-quobyte-7de50e59-895a-444b-b816-5bb7deef62c2" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:29:56 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-ef306f8f-72d9-4d98-a723-c44c742bf407 tempest-ProjectMemberTests-1570638723 None] Deleting offline snapshot 7de50e59-895a-444b-b816-5bb7deef62c2 of volume 4ee14909-52cd-4c0d-ab8a-5074f80f0627 {{(pid=86111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 29 01:29:56 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-ef306f8f-72d9-4d98-a723-c44c742bf407 tempest-ProjectMemberTests-1570638723 None] snapshot_file for this snap is: volume-4ee14909-52cd-4c0d-ab8a-5074f80f0627.7de50e59-895a-444b-b816-5bb7deef62c2 {{(pid=86111) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 29 01:29:56 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb04f57b-4388-4a39-b550-f928f0b27f70]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:29:56 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-ef306f8f-72d9-4d98-a723-c44c742bf407 tempest-ProjectMemberTests-1570638723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-4ee14909-52cd-4c0d-ab8a-5074f80f0627.7de50e59-895a-444b-b816-5bb7deef62c2 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:56 devstack sudo[106316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-4ee14909-52cd-4c0d-ab8a-5074f80f0627.7de50e59-895a-444b-b816-5bb7deef62c2 Aug 29 01:29:56 devstack sudo[106316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:56 devstack sudo[106316]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:56 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-ef306f8f-72d9-4d98-a723-c44c742bf407 tempest-ProjectMemberTests-1570638723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-4ee14909-52cd-4c0d-ab8a-5074f80f0627.7de50e59-895a-444b-b816-5bb7deef62c2" returned: 0 in 0.341s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:56 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.remotefs [None req-ef306f8f-72d9-4d98-a723-c44c742bf407 tempest-ProjectMemberTests-1570638723 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4ee14909-52cd-4c0d-ab8a-5074f80f0627(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86111) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 29 01:29:56 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[74c80cea-87bb-480b-aa74-fe89c27ff7ee]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:29:56 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-ef306f8f-72d9-4d98-a723-c44c742bf407 tempest-ProjectMemberTests-1570638723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-4ee14909-52cd-4c0d-ab8a-5074f80f0627 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:56 devstack sudo[106321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-4ee14909-52cd-4c0d-ab8a-5074f80f0627 Aug 29 01:29:56 devstack sudo[106321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:56 devstack sudo[106321]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:56 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-ef306f8f-72d9-4d98-a723-c44c742bf407 tempest-ProjectMemberTests-1570638723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-4ee14909-52cd-4c0d-ab8a-5074f80f0627" returned: 0 in 0.368s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:56 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-ef306f8f-72d9-4d98-a723-c44c742bf407 tempest-ProjectMemberTests-1570638723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-4ee14909-52cd-4c0d-ab8a-5074f80f0627.7de50e59-895a-444b-b816-5bb7deef62c2 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:56 devstack sudo[106327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-4ee14909-52cd-4c0d-ab8a-5074f80f0627.7de50e59-895a-444b-b816-5bb7deef62c2 Aug 29 01:29:56 devstack sudo[106327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:57 devstack sudo[106327]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:57 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-ef306f8f-72d9-4d98-a723-c44c742bf407 tempest-ProjectMemberTests-1570638723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-4ee14909-52cd-4c0d-ab8a-5074f80f0627.7de50e59-895a-444b-b816-5bb7deef62c2" returned: 0 in 0.352s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:57 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-ef306f8f-72d9-4d98-a723-c44c742bf407 tempest-ProjectMemberTests-1570638723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-4ee14909-52cd-4c0d-ab8a-5074f80f0627.7de50e59-895a-444b-b816-5bb7deef62c2 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:57 devstack sudo[106333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-4ee14909-52cd-4c0d-ab8a-5074f80f0627.7de50e59-895a-444b-b816-5bb7deef62c2 Aug 29 01:29:57 devstack sudo[106333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:57 devstack sudo[106333]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:57 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-ef306f8f-72d9-4d98-a723-c44c742bf407 tempest-ProjectMemberTests-1570638723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-4ee14909-52cd-4c0d-ab8a-5074f80f0627.7de50e59-895a-444b-b816-5bb7deef62c2" returned: 0 in 0.249s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:57 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-ef306f8f-72d9-4d98-a723-c44c742bf407 tempest-ProjectMemberTests-1570638723 None] Lock "cinder-quobyte-7de50e59-895a-444b-b816-5bb7deef62c2" released by "_delete_snapshot" :: held 1.408s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:29:57 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-ef306f8f-72d9-4d98-a723-c44c742bf407 tempest-ProjectMemberTests-1570638723 None] Lock "cinder-quobyte-4ee14909-52cd-4c0d-ab8a-5074f80f0627" released by "delete_snapshot" :: held 1.431s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:29:57 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-ef306f8f-72d9-4d98-a723-c44c742bf407 tempest-ProjectMemberTests-1570638723 None] Created reservations ['6849510f-17aa-4683-b001-dbf154faa93c', '643c8831-5ca7-459c-ba16-e5dc49428e72', '850e693f-15ae-4b95-9ba6-4061f1efe120', 'db6b31b3-253f-4975-bbd6-afd76639db20'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:29:57 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-ef306f8f-72d9-4d98-a723-c44c742bf407 tempest-ProjectMemberTests-1570638723 None] Delete snapshot completed successfully. Aug 29 01:29:57 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-ef306f8f-72d9-4d98-a723-c44c742bf407 tempest-ProjectMemberTests-1570638723 None] Lock "cinder-7de50e59-895a-444b-b816-5bb7deef62c2-delete_snapshot" released by "delete_snapshot" :: held 1.555s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:29:58 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-0ec16e0f-3e5d-4b54-b5b3-ab6fc03b08f6 tempest-ProjectMemberTests-1570638723 None] Acquiring lock "cinder-4ee14909-52cd-4c0d-ab8a-5074f80f0627-delete_volume" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:29:58 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-0ec16e0f-3e5d-4b54-b5b3-ab6fc03b08f6 tempest-ProjectMemberTests-1570638723 None] Lock "cinder-4ee14909-52cd-4c0d-ab8a-5074f80f0627-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:29:58 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-0ec16e0f-3e5d-4b54-b5b3-ab6fc03b08f6 tempest-ProjectMemberTests-1570638723 None] Acquiring lock "cinder-quobyte-4ee14909-52cd-4c0d-ab8a-5074f80f0627" by "delete_volume" {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 29 01:29:58 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-0ec16e0f-3e5d-4b54-b5b3-ab6fc03b08f6 tempest-ProjectMemberTests-1570638723 None] Lock "cinder-quobyte-4ee14909-52cd-4c0d-ab8a-5074f80f0627" acquired by "delete_volume" :: waited 0.014s {{(pid=86111) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 29 01:29:58 devstack cinder-volume[86111]: DEBUG oslo.privsep.daemon [-] privsep: reply[7917b566-7d1a-4fbb-9824-a65dd5b436b3]: (4, 'qcow2') {{(pid=87199) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 29 01:29:58 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-0ec16e0f-3e5d-4b54-b5b3-ab6fc03b08f6 tempest-ProjectMemberTests-1570638723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-4ee14909-52cd-4c0d-ab8a-5074f80f0627 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:58 devstack sudo[106336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-4ee14909-52cd-4c0d-ab8a-5074f80f0627 Aug 29 01:29:58 devstack sudo[106336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:58 devstack sudo[106336]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:58 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-0ec16e0f-3e5d-4b54-b5b3-ab6fc03b08f6 tempest-ProjectMemberTests-1570638723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-4ee14909-52cd-4c0d-ab8a-5074f80f0627" returned: 0 in 0.355s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:58 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-0ec16e0f-3e5d-4b54-b5b3-ab6fc03b08f6 tempest-ProjectMemberTests-1570638723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-4ee14909-52cd-4c0d-ab8a-5074f80f0627 {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:58 devstack sudo[106341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-4ee14909-52cd-4c0d-ab8a-5074f80f0627 Aug 29 01:29:58 devstack sudo[106341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:58 devstack sudo[106341]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:58 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-0ec16e0f-3e5d-4b54-b5b3-ab6fc03b08f6 tempest-ProjectMemberTests-1570638723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac/volume-4ee14909-52cd-4c0d-ab8a-5074f80f0627" returned: 0 in 0.241s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:58 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-0ec16e0f-3e5d-4b54-b5b3-ab6fc03b08f6 tempest-ProjectMemberTests-1570638723 None] Lock "cinder-quobyte-4ee14909-52cd-4c0d-ab8a-5074f80f0627" released by "delete_volume" :: held 0.653s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:29:58 devstack cinder-volume[86111]: DEBUG cinder.quota [None req-0ec16e0f-3e5d-4b54-b5b3-ab6fc03b08f6 tempest-ProjectMemberTests-1570638723 None] Created reservations ['909c0e81-3963-4872-a28b-f45d7819c37c', '61b1cc5e-db8d-40d6-ab60-9d260a27c6ab', '3d22602c-6abb-4d96-927c-d1721ffd5998', 'a1372fac-b69b-45f8-a298-2e5635e927cf'] {{(pid=86111) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 29 01:29:59 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-0ec16e0f-3e5d-4b54-b5b3-ab6fc03b08f6 tempest-ProjectMemberTests-1570638723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 29 01:29:59 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-0ec16e0f-3e5d-4b54-b5b3-ab6fc03b08f6 tempest-ProjectMemberTests-1570638723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 29 01:29:59 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-0ec16e0f-3e5d-4b54-b5b3-ab6fc03b08f6 tempest-ProjectMemberTests-1570638723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630': None} {{(pid=86111) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 29 01:29:59 devstack cinder-volume[86111]: DEBUG cinder.volume.drivers.quobyte [None req-0ec16e0f-3e5d-4b54-b5b3-ab6fc03b08f6 tempest-ProjectMemberTests-1570638723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23402d5e-6c11-4043-96f1-bad91657b630'] {{(pid=86111) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 29 01:29:59 devstack cinder-volume[86111]: DEBUG oslo_concurrency.lockutils [None req-0ec16e0f-3e5d-4b54-b5b3-ab6fc03b08f6 tempest-ProjectMemberTests-1570638723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86111) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 29 01:29:59 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-0ec16e0f-3e5d-4b54-b5b3-ab6fc03b08f6 tempest-ProjectMemberTests-1570638723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 29 01:29:59 devstack sudo[106344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac Aug 29 01:29:59 devstack sudo[106344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 29 01:29:59 devstack sudo[106344]: pam_unix(sudo:session): session closed for user root Aug 29 01:29:59 devstack cinder-volume[86111]: DEBUG oslo_concurrency.processutils [None req-0ec16e0f-3e5d-4b54-b5b3-ab6fc03b08f6 tempest-ProjectMemberTests-1570638723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3be93083fa0cfdfb0208c489cb20f4ac" returned: 0 in 0.252s {{(pid=86111) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 29 01:29:59 devstack cinder-volume[86111]: DEBUG cinder.manager [None req-0ec16e0f-3e5d-4b54-b5b3-ab6fc03b08f6 tempest-ProjectMemberTests-1570638723 None] Notifying Schedulers of capabilities ... {{(pid=86111) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 29 01:29:59 devstack cinder-volume[86111]: INFO cinder.volume.manager [None req-0ec16e0f-3e5d-4b54-b5b3-ab6fc03b08f6 tempest-ProjectMemberTests-1570638723 None] Deleted volume successfully. Aug 29 01:29:59 devstack cinder-volume[86111]: DEBUG cinder.coordination [None req-0ec16e0f-3e5d-4b54-b5b3-ab6fc03b08f6 tempest-ProjectMemberTests-1570638723 None] Lock "cinder-4ee14909-52cd-4c0d-ab8a-5074f80f0627-delete_volume" released by "delete_volume" :: held 1.104s {{(pid=86111) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 29 01:30:09 devstack cinder-volume[86111]: DEBUG dbcounter [-] [86111] Writing DB stats cinder:DELETE=6,cinder:SELECT=35,cinder:INSERT=13,cinder:UPDATE=52 {{(pid=86111) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 29 01:30:09 devstack cinder-volume[86111]: DEBUG dbcounter [-] [86111] Writing DB stats cinder:SELECT=40,cinder:INSERT=15,cinder:UPDATE=47,cinder:DELETE=2 {{(pid=86111) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}